2023-10-06T02:46:08.046 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T02:46:08.046 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi --description fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173 --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/orig.config.yaml 2023-10-06T02:46:08.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T02:46:08.185 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} email: yweinste@redhat.com first_in_suite: false job_id: '7412173' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 - - client.2 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi124.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi158.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - pexec: clients: - cd $TESTDIR - wget http://download.ceph.com/qa/mdtest-1.9.3.tgz - mkdir mdtest-1.9.3 - cd mdtest-1.9.3 - tar xvfz $TESTDIR/mdtest-1.9.3.tgz - rm $TESTDIR/mdtest-1.9.3.tgz - MPI_CC=mpicc make - ln -s $TESTDIR/mnt.* $TESTDIR/gmnt - ssh_keys: null - mpi: exec: $TESTDIR/mdtest-1.9.3/mdtest -d $TESTDIR/gmnt -I 20 -z 5 -b 2 -R - pexec: clients: - rm -f $TESTDIR/gmnt - rm -rf $TESTDIR/mdtest-1.9.3 - rm -rf $TESTDIR/._mdtest-1.9.3 teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T02:46:08.185 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T02:46:08.186 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T02:46:08.186 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T02:46:08.188 INFO:teuthology.task.internal:Checking packages... 2023-10-06T02:46:08.214 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T02:46:08.214 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T02:46:08.214 INFO:teuthology.packaging:ref: None 2023-10-06T02:46:08.214 INFO:teuthology.packaging:tag: None 2023-10-06T02:46:08.214 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:46:08.214 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:46:08.215 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:46:08.460 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296-gf1e315a9-1focal 2023-10-06T02:46:08.461 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T02:46:08.466 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T02:46:08.467 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T02:46:08.507 INFO:teuthology.task.internal:Saving configuration 2023-10-06T02:46:08.525 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T02:46:08.531 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T02:46:08.554 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:39:15.710676', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-06T02:46:08.580 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:39:15.712409', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-06T02:46:08.600 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:39:15.708913', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-06T02:46:08.619 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:39:15.706880', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-06T02:46:08.644 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:39:15.713515', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-06T02:46:08.645 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T02:46:08.652 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-06T02:46:08.653 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-10-06T02:46:08.653 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['client.0'] 2023-10-06T02:46:08.654 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['client.1'] 2023-10-06T02:46:08.654 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['client.2'] 2023-10-06T02:46:08.654 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T02:46:08.836 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc1c328db80>, signals=[15]) 2023-10-06T02:46:08.836 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T02:46:08.843 INFO:teuthology.task.internal:Opening connections... 2023-10-06T02:46:08.843 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2023-10-06T02:46:08.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:46:08.901 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2023-10-06T02:46:08.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:46:08.950 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T02:46:08.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:46:08.997 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T02:46:08.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:46:09.045 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2023-10-06T02:46:09.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:46:09.094 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T02:46:09.100 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-10-06T02:46:09.107 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-10-06T02:46:09.107 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-10-06T02:46:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Ubuntu" 2023-10-06T02:46:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-06T02:46:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:ID=ubuntu 2023-10-06T02:46:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE=debian 2023-10-06T02:46:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-06T02:46:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="20.04" 2023-10-06T02:46:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-06T02:46:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-06T02:46:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-06T02:46:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-06T02:46:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_CODENAME=focal 2023-10-06T02:46:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:UBUNTU_CODENAME=focal 2023-10-06T02:46:09.158 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-10-06T02:46:09.192 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-10-06T02:46:09.199 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-10-06T02:46:09.200 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-10-06T02:46:09.206 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-10-06T02:46:09.206 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-06T02:46:09.206 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-10-06T02:46:09.206 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-10-06T02:46:09.207 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-06T02:46:09.207 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="20.04" 2023-10-06T02:46:09.207 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-06T02:46:09.207 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-06T02:46:09.207 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-06T02:46:09.207 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-06T02:46:09.207 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=focal 2023-10-06T02:46:09.207 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=focal 2023-10-06T02:46:09.208 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-10-06T02:46:09.233 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-10-06T02:46:09.241 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-10-06T02:46:09.241 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-06T02:46:09.289 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Ubuntu" 2023-10-06T02:46:09.290 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-06T02:46:09.290 INFO:teuthology.orchestra.run.smithi124.stdout:ID=ubuntu 2023-10-06T02:46:09.290 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE=debian 2023-10-06T02:46:09.290 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-06T02:46:09.290 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="20.04" 2023-10-06T02:46:09.290 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-06T02:46:09.290 INFO:teuthology.orchestra.run.smithi124.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-06T02:46:09.290 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-06T02:46:09.290 INFO:teuthology.orchestra.run.smithi124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-06T02:46:09.291 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_CODENAME=focal 2023-10-06T02:46:09.291 INFO:teuthology.orchestra.run.smithi124.stdout:UBUNTU_CODENAME=focal 2023-10-06T02:46:09.291 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-06T02:46:09.308 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-10-06T02:46:09.316 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-10-06T02:46:09.317 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-10-06T02:46:09.365 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Ubuntu" 2023-10-06T02:46:09.365 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-06T02:46:09.365 INFO:teuthology.orchestra.run.smithi158.stdout:ID=ubuntu 2023-10-06T02:46:09.365 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE=debian 2023-10-06T02:46:09.365 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-06T02:46:09.365 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="20.04" 2023-10-06T02:46:09.365 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-06T02:46:09.365 INFO:teuthology.orchestra.run.smithi158.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-06T02:46:09.365 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-06T02:46:09.366 INFO:teuthology.orchestra.run.smithi158.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-06T02:46:09.366 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_CODENAME=focal 2023-10-06T02:46:09.366 INFO:teuthology.orchestra.run.smithi158.stdout:UBUNTU_CODENAME=focal 2023-10-06T02:46:09.366 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-10-06T02:46:09.400 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-10-06T02:46:09.407 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-10-06T02:46:09.407 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-10-06T02:46:09.455 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu" 2023-10-06T02:46:09.456 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-06T02:46:09.456 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu 2023-10-06T02:46:09.456 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian 2023-10-06T02:46:09.456 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-06T02:46:09.456 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="20.04" 2023-10-06T02:46:09.456 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-06T02:46:09.456 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-06T02:46:09.456 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-06T02:46:09.456 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-06T02:46:09.456 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=focal 2023-10-06T02:46:09.457 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=focal 2023-10-06T02:46:09.457 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-10-06T02:46:09.475 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T02:46:09.487 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T02:46:09.497 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T02:46:09.497 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:46:09.501 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:46:09.503 DEBUG:teuthology.orchestra.run.smithi124:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:46:09.506 DEBUG:teuthology.orchestra.run.smithi158:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:46:09.508 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:46:09.514 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T02:46:09.532 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T02:46:09.532 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:46:09.548 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:46:09.551 DEBUG:teuthology.orchestra.run.smithi124:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:46:09.553 DEBUG:teuthology.orchestra.run.smithi158:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:46:09.555 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:46:09.576 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T02:46:09.703 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T02:46:09.718 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-06T02:46:09.718 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-06T02:46:09.718 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:46:09.719 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:46:09.720 DEBUG:teuthology.orchestra.run.smithi124:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:46:09.720 DEBUG:teuthology.orchestra.run.smithi158:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:46:09.721 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:46:09.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:46:09.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:46:09.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:46:09.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:46:09.729 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-10-06T02:46:09.730 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2023-10-06T02:46:09.730 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2023-10-06T02:46:09.731 DEBUG:teuthology.orchestra.run.smithi124:> uname -r 2023-10-06T02:46:09.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:46:09.732 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2023-10-06T02:46:09.737 INFO:teuthology.orchestra.run.smithi158.stdout:5.4.0-124-generic 2023-10-06T02:46:09.737 INFO:teuthology.task.kernel:Running kernel on smithi158: 5.4.0-124-generic 2023-10-06T02:46:09.738 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-get clean 2023-10-06T02:46:09.739 INFO:teuthology.orchestra.run.smithi124.stdout:5.4.0-124-generic 2023-10-06T02:46:09.739 INFO:teuthology.task.kernel:Running kernel on smithi124: 5.4.0-124-generic 2023-10-06T02:46:09.739 DEBUG:teuthology.orchestra.run.smithi124:> sudo apt-get clean 2023-10-06T02:46:09.775 INFO:teuthology.orchestra.run.smithi123.stdout:5.4.0-124-generic 2023-10-06T02:46:09.776 INFO:teuthology.task.kernel:Running kernel on smithi123: 5.4.0-124-generic 2023-10-06T02:46:09.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get clean 2023-10-06T02:46:09.778 INFO:teuthology.orchestra.run.smithi027.stdout:5.4.0-124-generic 2023-10-06T02:46:09.779 INFO:teuthology.task.kernel:Running kernel on smithi027: 5.4.0-124-generic 2023-10-06T02:46:09.779 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get clean 2023-10-06T02:46:09.780 INFO:teuthology.orchestra.run.smithi174.stdout:5.4.0-124-generic 2023-10-06T02:46:09.781 INFO:teuthology.task.kernel:Running kernel on smithi174: 5.4.0-124-generic 2023-10-06T02:46:09.781 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get clean 2023-10-06T02:46:09.841 DEBUG:teuthology.orchestra.run.smithi124:> sudo apt-get update 2023-10-06T02:46:09.877 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get update 2023-10-06T02:46:09.883 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get update 2023-10-06T02:46:09.898 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-get update 2023-10-06T02:46:09.922 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2023-10-06T02:46:10.008 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:46:10.008 INFO:teuthology.orchestra.run.smithi124.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-06T02:46:10.008 INFO:teuthology.orchestra.run.smithi124.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-06T02:46:10.043 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:46:10.048 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:46:10.051 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-06T02:46:10.051 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-06T02:46:10.052 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-06T02:46:10.052 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-06T02:46:10.083 INFO:teuthology.orchestra.run.smithi124.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-06T02:46:10.087 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-06T02:46:10.109 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-06T02:46:10.115 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-06T02:46:10.120 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-06T02:46:10.194 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:46:10.221 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:46:10.276 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-06T02:46:10.303 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-06T02:46:10.394 INFO:teuthology.orchestra.run.smithi124.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-06T02:46:10.400 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-06T02:46:10.426 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-06T02:46:10.426 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,888 kB] 2023-10-06T02:46:10.436 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-06T02:46:10.486 INFO:teuthology.orchestra.run.smithi124.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-06T02:46:10.528 INFO:teuthology.orchestra.run.smithi124.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-06T02:46:10.532 INFO:teuthology.orchestra.run.smithi124.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-06T02:46:10.533 INFO:teuthology.orchestra.run.smithi124.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-06T02:46:10.534 INFO:teuthology.orchestra.run.smithi124.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-06T02:46:10.543 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-06T02:46:10.551 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-06T02:46:10.554 INFO:teuthology.orchestra.run.smithi124.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-06T02:46:10.554 INFO:teuthology.orchestra.run.smithi124.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-06T02:46:10.555 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-06T02:46:10.556 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-06T02:46:10.556 INFO:teuthology.orchestra.run.smithi124.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T02:46:10.556 INFO:teuthology.orchestra.run.smithi124.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-06T02:46:10.557 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-06T02:46:10.560 INFO:teuthology.orchestra.run.smithi124.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-06T02:46:10.566 INFO:teuthology.orchestra.run.smithi124.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-06T02:46:10.567 INFO:teuthology.orchestra.run.smithi124.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-06T02:46:10.567 INFO:teuthology.orchestra.run.smithi124.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-06T02:46:10.568 INFO:teuthology.orchestra.run.smithi124.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-06T02:46:10.574 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-06T02:46:10.577 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-06T02:46:10.579 INFO:teuthology.orchestra.run.smithi124.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-06T02:46:10.579 INFO:teuthology.orchestra.run.smithi124.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-06T02:46:10.581 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-06T02:46:10.583 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-06T02:46:10.586 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-06T02:46:10.586 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-06T02:46:10.587 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T02:46:10.587 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-06T02:46:10.591 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-06T02:46:10.594 INFO:teuthology.orchestra.run.smithi174.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-06T02:46:10.595 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-06T02:46:10.595 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-06T02:46:10.595 INFO:teuthology.orchestra.run.smithi123.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-06T02:46:10.600 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-06T02:46:10.608 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-06T02:46:10.612 INFO:teuthology.orchestra.run.smithi174.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-06T02:46:10.612 INFO:teuthology.orchestra.run.smithi123.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-06T02:46:10.612 INFO:teuthology.orchestra.run.smithi123.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-06T02:46:10.612 INFO:teuthology.orchestra.run.smithi174.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-06T02:46:10.614 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-06T02:46:10.614 INFO:teuthology.orchestra.run.smithi123.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T02:46:10.615 INFO:teuthology.orchestra.run.smithi123.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-06T02:46:10.616 INFO:teuthology.orchestra.run.smithi174.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T02:46:10.616 INFO:teuthology.orchestra.run.smithi174.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-06T02:46:10.617 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-06T02:46:10.621 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-06T02:46:10.622 INFO:teuthology.orchestra.run.smithi123.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-06T02:46:10.623 INFO:teuthology.orchestra.run.smithi174.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-06T02:46:10.626 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-06T02:46:10.629 INFO:teuthology.orchestra.run.smithi123.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-06T02:46:10.630 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-06T02:46:10.631 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-06T02:46:10.631 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-06T02:46:10.632 INFO:teuthology.orchestra.run.smithi123.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-06T02:46:10.632 INFO:teuthology.orchestra.run.smithi174.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-06T02:46:10.633 INFO:teuthology.orchestra.run.smithi123.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-06T02:46:10.633 INFO:teuthology.orchestra.run.smithi123.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-06T02:46:10.635 INFO:teuthology.orchestra.run.smithi174.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-06T02:46:10.635 INFO:teuthology.orchestra.run.smithi174.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-06T02:46:10.635 INFO:teuthology.orchestra.run.smithi174.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-06T02:46:10.635 INFO:teuthology.orchestra.run.smithi174.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-06T02:46:10.636 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-06T02:46:10.636 INFO:teuthology.orchestra.run.smithi174.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-06T02:46:10.637 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-06T02:46:10.637 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-06T02:46:10.637 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-06T02:46:10.644 INFO:teuthology.orchestra.run.smithi123.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-06T02:46:10.645 INFO:teuthology.orchestra.run.smithi123.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-06T02:46:10.646 INFO:teuthology.orchestra.run.smithi158.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-06T02:46:10.665 INFO:teuthology.orchestra.run.smithi158.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-06T02:46:10.669 INFO:teuthology.orchestra.run.smithi158.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T02:46:10.669 INFO:teuthology.orchestra.run.smithi158.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-06T02:46:10.675 INFO:teuthology.orchestra.run.smithi158.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-06T02:46:10.684 INFO:teuthology.orchestra.run.smithi158.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-06T02:46:10.685 INFO:teuthology.orchestra.run.smithi123.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-06T02:46:10.693 INFO:teuthology.orchestra.run.smithi158.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-06T02:46:10.694 INFO:teuthology.orchestra.run.smithi124.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,888 kB] 2023-10-06T02:46:10.703 INFO:teuthology.orchestra.run.smithi123.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-06T02:46:10.704 INFO:teuthology.orchestra.run.smithi158.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-06T02:46:10.705 INFO:teuthology.orchestra.run.smithi158.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-06T02:46:10.705 INFO:teuthology.orchestra.run.smithi123.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-06T02:46:10.705 INFO:teuthology.orchestra.run.smithi123.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-06T02:46:10.705 INFO:teuthology.orchestra.run.smithi123.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-06T02:46:10.705 INFO:teuthology.orchestra.run.smithi123.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-06T02:46:10.706 INFO:teuthology.orchestra.run.smithi158.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-06T02:46:10.706 INFO:teuthology.orchestra.run.smithi158.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-06T02:46:10.750 INFO:teuthology.orchestra.run.smithi123.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-06T02:46:10.763 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-06T02:46:10.764 INFO:teuthology.orchestra.run.smithi174.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,888 kB] 2023-10-06T02:46:10.787 INFO:teuthology.orchestra.run.smithi158.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-06T02:46:10.793 INFO:teuthology.orchestra.run.smithi124.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-06T02:46:10.801 INFO:teuthology.orchestra.run.smithi124.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-06T02:46:10.802 INFO:teuthology.orchestra.run.smithi124.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-06T02:46:10.849 INFO:teuthology.orchestra.run.smithi124.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-06T02:46:10.849 INFO:teuthology.orchestra.run.smithi124.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-06T02:46:10.855 INFO:teuthology.orchestra.run.smithi124.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T02:46:10.855 INFO:teuthology.orchestra.run.smithi124.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-06T02:46:10.870 INFO:teuthology.orchestra.run.smithi124.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-06T02:46:10.891 INFO:teuthology.orchestra.run.smithi124.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-06T02:46:10.896 INFO:teuthology.orchestra.run.smithi124.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-06T02:46:10.897 INFO:teuthology.orchestra.run.smithi123.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-06T02:46:10.897 INFO:teuthology.orchestra.run.smithi124.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-06T02:46:10.897 INFO:teuthology.orchestra.run.smithi124.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-06T02:46:10.911 INFO:teuthology.orchestra.run.smithi123.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-06T02:46:10.911 INFO:teuthology.orchestra.run.smithi123.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-06T02:46:10.913 INFO:teuthology.orchestra.run.smithi123.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-06T02:46:10.926 INFO:teuthology.orchestra.run.smithi124.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-06T02:46:10.926 INFO:teuthology.orchestra.run.smithi124.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-06T02:46:10.926 INFO:teuthology.orchestra.run.smithi124.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-06T02:46:10.926 INFO:teuthology.orchestra.run.smithi124.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-06T02:46:10.926 INFO:teuthology.orchestra.run.smithi124.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-06T02:46:10.963 INFO:teuthology.orchestra.run.smithi123.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-06T02:46:10.964 INFO:teuthology.orchestra.run.smithi124.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-06T02:46:10.965 INFO:teuthology.orchestra.run.smithi124.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-06T02:46:10.965 INFO:teuthology.orchestra.run.smithi124.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-06T02:46:10.967 INFO:teuthology.orchestra.run.smithi174.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-06T02:46:10.969 INFO:teuthology.orchestra.run.smithi123.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T02:46:10.969 INFO:teuthology.orchestra.run.smithi123.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-06T02:46:10.984 INFO:teuthology.orchestra.run.smithi174.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-06T02:46:10.985 INFO:teuthology.orchestra.run.smithi174.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-06T02:46:10.986 INFO:teuthology.orchestra.run.smithi123.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-06T02:46:10.986 INFO:teuthology.orchestra.run.smithi174.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-06T02:46:10.998 INFO:teuthology.orchestra.run.smithi123.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-06T02:46:11.000 INFO:teuthology.orchestra.run.smithi123.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-06T02:46:11.002 INFO:teuthology.orchestra.run.smithi123.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-06T02:46:11.002 INFO:teuthology.orchestra.run.smithi123.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-06T02:46:11.002 INFO:teuthology.orchestra.run.smithi123.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-06T02:46:11.008 INFO:teuthology.orchestra.run.smithi123.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-06T02:46:11.011 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,888 kB] 2023-10-06T02:46:11.033 INFO:teuthology.orchestra.run.smithi158.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,888 kB] 2023-10-06T02:46:11.040 INFO:teuthology.orchestra.run.smithi174.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-06T02:46:11.044 INFO:teuthology.orchestra.run.smithi174.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T02:46:11.044 INFO:teuthology.orchestra.run.smithi174.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-06T02:46:11.055 INFO:teuthology.orchestra.run.smithi174.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-06T02:46:11.072 INFO:teuthology.orchestra.run.smithi174.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-06T02:46:11.074 INFO:teuthology.orchestra.run.smithi174.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-06T02:46:11.075 INFO:teuthology.orchestra.run.smithi174.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-06T02:46:11.076 INFO:teuthology.orchestra.run.smithi174.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-06T02:46:11.076 INFO:teuthology.orchestra.run.smithi174.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-06T02:46:11.076 INFO:teuthology.orchestra.run.smithi174.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-06T02:46:11.092 INFO:teuthology.orchestra.run.smithi174.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-06T02:46:11.092 INFO:teuthology.orchestra.run.smithi174.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-06T02:46:11.093 INFO:teuthology.orchestra.run.smithi174.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-06T02:46:11.112 INFO:teuthology.orchestra.run.smithi174.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-06T02:46:11.114 INFO:teuthology.orchestra.run.smithi174.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-06T02:46:11.114 INFO:teuthology.orchestra.run.smithi174.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-06T02:46:11.175 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-06T02:46:11.187 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-06T02:46:11.188 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-06T02:46:11.197 INFO:teuthology.orchestra.run.smithi158.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-06T02:46:11.210 INFO:teuthology.orchestra.run.smithi158.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-06T02:46:11.210 INFO:teuthology.orchestra.run.smithi158.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-06T02:46:11.211 INFO:teuthology.orchestra.run.smithi158.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-06T02:46:11.249 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-06T02:46:11.250 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-06T02:46:11.269 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T02:46:11.272 INFO:teuthology.orchestra.run.smithi158.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-06T02:46:11.292 INFO:teuthology.orchestra.run.smithi158.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T02:46:11.433 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-06T02:46:11.455 INFO:teuthology.orchestra.run.smithi158.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-06T02:46:12.022 INFO:teuthology.orchestra.run.smithi027.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-06T02:46:12.089 INFO:teuthology.orchestra.run.smithi158.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-06T02:46:12.128 INFO:teuthology.orchestra.run.smithi158.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-06T02:46:12.131 INFO:teuthology.orchestra.run.smithi027.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-06T02:46:12.141 INFO:teuthology.orchestra.run.smithi158.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-06T02:46:12.142 INFO:teuthology.orchestra.run.smithi158.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-06T02:46:12.143 INFO:teuthology.orchestra.run.smithi158.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-06T02:46:12.144 INFO:teuthology.orchestra.run.smithi158.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-06T02:46:12.144 INFO:teuthology.orchestra.run.smithi158.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-06T02:46:12.145 INFO:teuthology.orchestra.run.smithi158.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-06T02:46:12.151 INFO:teuthology.orchestra.run.smithi027.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-06T02:46:12.153 INFO:teuthology.orchestra.run.smithi027.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-06T02:46:12.154 INFO:teuthology.orchestra.run.smithi027.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-06T02:46:12.155 INFO:teuthology.orchestra.run.smithi027.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-06T02:46:12.156 INFO:teuthology.orchestra.run.smithi027.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-06T02:46:12.157 INFO:teuthology.orchestra.run.smithi027.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-06T02:46:12.160 INFO:teuthology.orchestra.run.smithi027.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-06T02:46:12.162 INFO:teuthology.orchestra.run.smithi027.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-06T02:46:12.171 INFO:teuthology.orchestra.run.smithi158.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-06T02:46:12.172 INFO:teuthology.orchestra.run.smithi158.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-06T02:46:12.326 INFO:teuthology.orchestra.run.smithi027.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-06T02:46:12.336 INFO:teuthology.orchestra.run.smithi158.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-06T02:46:12.489 INFO:teuthology.orchestra.run.smithi027.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-06T02:46:12.519 INFO:teuthology.orchestra.run.smithi158.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-06T02:46:12.540 INFO:teuthology.orchestra.run.smithi027.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-06T02:46:12.541 INFO:teuthology.orchestra.run.smithi158.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-06T02:46:14.354 INFO:teuthology.orchestra.run.smithi124.stdout:Fetched 17.6 MB in 3s (6,936 kB/s) 2023-10-06T02:46:14.452 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 17.6 MB in 3s (6,835 kB/s) 2023-10-06T02:46:14.515 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 17.6 MB in 3s (6,898 kB/s) 2023-10-06T02:46:14.522 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 17.6 MB in 3s (6,879 kB/s) 2023-10-06T02:46:14.583 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 17.6 MB in 3s (6,664 kB/s) 2023-10-06T02:46:15.778 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2023-10-06T02:46:15.803 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T02:46:15.819 INFO:teuthology.orchestra.run.smithi124.stdout:Reading package lists... 2023-10-06T02:46:15.846 DEBUG:teuthology.orchestra.run.smithi124:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T02:46:15.854 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2023-10-06T02:46:15.879 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T02:46:15.888 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2023-10-06T02:46:15.918 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2023-10-06T02:46:15.918 INFO:teuthology.orchestra.run.smithi124.stdout:Reading package lists... 2023-10-06T02:46:15.944 DEBUG:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T02:46:15.965 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2023-10-06T02:46:15.986 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-06T02:46:16.012 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T02:46:16.022 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2023-10-06T02:46:16.066 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2023-10-06T02:46:16.067 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2023-10-06T02:46:16.079 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-06T02:46:16.122 INFO:teuthology.orchestra.run.smithi124.stdout:Building dependency tree... 2023-10-06T02:46:16.122 INFO:teuthology.orchestra.run.smithi124.stdout:Reading state information... 2023-10-06T02:46:16.166 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2023-10-06T02:46:16.166 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2023-10-06T02:46:16.200 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2023-10-06T02:46:16.200 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2023-10-06T02:46:16.240 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2023-10-06T02:46:16.240 INFO:teuthology.orchestra.run.smithi174.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T02:46:16.240 INFO:teuthology.orchestra.run.smithi174.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-06T02:46:16.240 INFO:teuthology.orchestra.run.smithi174.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-06T02:46:16.241 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2023-10-06T02:46:16.241 INFO:teuthology.orchestra.run.smithi174.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-06T02:46:16.241 INFO:teuthology.orchestra.run.smithi174.stdout:Recommended packages: 2023-10-06T02:46:16.241 INFO:teuthology.orchestra.run.smithi174.stdout: thermald 2023-10-06T02:46:16.285 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2023-10-06T02:46:16.286 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2023-10-06T02:46:16.299 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2023-10-06T02:46:16.299 INFO:teuthology.orchestra.run.smithi174.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T02:46:16.299 INFO:teuthology.orchestra.run.smithi174.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-06T02:46:16.299 INFO:teuthology.orchestra.run.smithi174.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-06T02:46:16.300 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages will be upgraded: 2023-10-06T02:46:16.301 INFO:teuthology.orchestra.run.smithi174.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-06T02:46:16.322 INFO:teuthology.orchestra.run.smithi124.stdout:The following additional packages will be installed: 2023-10-06T02:46:16.322 INFO:teuthology.orchestra.run.smithi124.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T02:46:16.323 INFO:teuthology.orchestra.run.smithi124.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-06T02:46:16.323 INFO:teuthology.orchestra.run.smithi124.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-06T02:46:16.324 INFO:teuthology.orchestra.run.smithi124.stdout:Suggested packages: 2023-10-06T02:46:16.324 INFO:teuthology.orchestra.run.smithi124.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-06T02:46:16.324 INFO:teuthology.orchestra.run.smithi124.stdout:Recommended packages: 2023-10-06T02:46:16.324 INFO:teuthology.orchestra.run.smithi124.stdout: thermald 2023-10-06T02:46:16.351 INFO:teuthology.orchestra.run.smithi123.stdout:The following additional packages will be installed: 2023-10-06T02:46:16.351 INFO:teuthology.orchestra.run.smithi123.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T02:46:16.352 INFO:teuthology.orchestra.run.smithi123.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-06T02:46:16.352 INFO:teuthology.orchestra.run.smithi123.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-06T02:46:16.353 INFO:teuthology.orchestra.run.smithi123.stdout:Suggested packages: 2023-10-06T02:46:16.353 INFO:teuthology.orchestra.run.smithi123.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-06T02:46:16.353 INFO:teuthology.orchestra.run.smithi123.stdout:Recommended packages: 2023-10-06T02:46:16.353 INFO:teuthology.orchestra.run.smithi123.stdout: thermald 2023-10-06T02:46:16.358 INFO:teuthology.orchestra.run.smithi174.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T02:46:16.358 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 77.0 MB of archives. 2023-10-06T02:46:16.359 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-06T02:46:16.359 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-06T02:46:16.371 INFO:teuthology.orchestra.run.smithi158.stdout:The following additional packages will be installed: 2023-10-06T02:46:16.371 INFO:teuthology.orchestra.run.smithi158.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T02:46:16.371 INFO:teuthology.orchestra.run.smithi158.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-06T02:46:16.371 INFO:teuthology.orchestra.run.smithi158.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-06T02:46:16.372 INFO:teuthology.orchestra.run.smithi158.stdout:Suggested packages: 2023-10-06T02:46:16.372 INFO:teuthology.orchestra.run.smithi158.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-06T02:46:16.372 INFO:teuthology.orchestra.run.smithi158.stdout:Recommended packages: 2023-10-06T02:46:16.372 INFO:teuthology.orchestra.run.smithi158.stdout: thermald 2023-10-06T02:46:16.381 INFO:teuthology.orchestra.run.smithi124.stdout:The following NEW packages will be installed: 2023-10-06T02:46:16.381 INFO:teuthology.orchestra.run.smithi124.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T02:46:16.381 INFO:teuthology.orchestra.run.smithi124.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-06T02:46:16.381 INFO:teuthology.orchestra.run.smithi124.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-06T02:46:16.383 INFO:teuthology.orchestra.run.smithi124.stdout:The following packages will be upgraded: 2023-10-06T02:46:16.383 INFO:teuthology.orchestra.run.smithi124.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-06T02:46:16.411 INFO:teuthology.orchestra.run.smithi123.stdout:The following NEW packages will be installed: 2023-10-06T02:46:16.411 INFO:teuthology.orchestra.run.smithi123.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T02:46:16.411 INFO:teuthology.orchestra.run.smithi123.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-06T02:46:16.411 INFO:teuthology.orchestra.run.smithi123.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-06T02:46:16.412 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages will be upgraded: 2023-10-06T02:46:16.413 INFO:teuthology.orchestra.run.smithi123.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-06T02:46:16.450 INFO:teuthology.orchestra.run.smithi158.stdout:The following NEW packages will be installed: 2023-10-06T02:46:16.450 INFO:teuthology.orchestra.run.smithi158.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T02:46:16.450 INFO:teuthology.orchestra.run.smithi158.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-06T02:46:16.451 INFO:teuthology.orchestra.run.smithi158.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-06T02:46:16.452 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages will be upgraded: 2023-10-06T02:46:16.452 INFO:teuthology.orchestra.run.smithi158.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-06T02:46:16.474 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2023-10-06T02:46:16.474 INFO:teuthology.orchestra.run.smithi027.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T02:46:16.474 INFO:teuthology.orchestra.run.smithi027.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-06T02:46:16.474 INFO:teuthology.orchestra.run.smithi027.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-06T02:46:16.475 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2023-10-06T02:46:16.475 INFO:teuthology.orchestra.run.smithi027.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-06T02:46:16.475 INFO:teuthology.orchestra.run.smithi027.stdout:Recommended packages: 2023-10-06T02:46:16.475 INFO:teuthology.orchestra.run.smithi027.stdout: thermald 2023-10-06T02:46:16.506 INFO:teuthology.orchestra.run.smithi158.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T02:46:16.506 INFO:teuthology.orchestra.run.smithi158.stdout:Need to get 77.0 MB of archives. 2023-10-06T02:46:16.506 INFO:teuthology.orchestra.run.smithi158.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-06T02:46:16.506 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-06T02:46:16.531 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2023-10-06T02:46:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T02:46:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-06T02:46:16.531 INFO:teuthology.orchestra.run.smithi027.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-06T02:46:16.532 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages will be upgraded: 2023-10-06T02:46:16.532 INFO:teuthology.orchestra.run.smithi027.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-06T02:46:16.564 INFO:teuthology.orchestra.run.smithi124.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T02:46:16.564 INFO:teuthology.orchestra.run.smithi124.stdout:Need to get 77.0 MB of archives. 2023-10-06T02:46:16.565 INFO:teuthology.orchestra.run.smithi124.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-06T02:46:16.565 INFO:teuthology.orchestra.run.smithi124.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-06T02:46:16.595 INFO:teuthology.orchestra.run.smithi123.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T02:46:16.595 INFO:teuthology.orchestra.run.smithi123.stdout:Need to get 77.0 MB of archives. 2023-10-06T02:46:16.595 INFO:teuthology.orchestra.run.smithi123.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-06T02:46:16.595 INFO:teuthology.orchestra.run.smithi123.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-06T02:46:16.633 INFO:teuthology.orchestra.run.smithi027.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T02:46:16.633 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 77.0 MB of archives. 2023-10-06T02:46:16.633 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-06T02:46:16.633 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-06T02:46:16.769 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-06T02:46:16.807 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-06T02:46:16.898 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-06T02:46:16.923 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-06T02:46:17.374 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-06T02:46:17.374 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-06T02:46:17.375 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-06T02:46:17.468 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-06T02:46:17.478 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-06T02:46:17.699 INFO:teuthology.orchestra.run.smithi124.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-06T02:46:17.742 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-06T02:46:17.757 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-06T02:46:17.967 INFO:teuthology.orchestra.run.smithi124.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-06T02:46:17.980 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-06T02:46:17.980 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-06T02:46:17.980 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-06T02:46:18.014 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-06T02:46:18.137 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-06T02:46:18.194 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 77.0 MB in 1s (75.5 MB/s) 2023-10-06T02:46:18.234 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-06T02:46:18.246 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-06T02:46:18.386 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-06T02:46:18.936 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 77.0 MB in 2s (39.7 MB/s) 2023-10-06T02:46:19.125 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-06T02:46:19.225 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-06T02:46:19.226 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-06T02:46:19.226 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-06T02:46:19.253 INFO:teuthology.orchestra.run.smithi124.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-06T02:46:19.253 INFO:teuthology.orchestra.run.smithi124.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-06T02:46:19.253 INFO:teuthology.orchestra.run.smithi124.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-06T02:46:19.309 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-06T02:46:19.310 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-06T02:46:19.310 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-06T02:46:19.392 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-06T02:46:19.417 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-06T02:46:19.534 INFO:teuthology.orchestra.run.smithi124.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-06T02:46:19.569 INFO:teuthology.orchestra.run.smithi124.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-06T02:46:19.798 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-06T02:46:19.867 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-06T02:46:20.091 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-06T02:46:20.095 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:20.141 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 77.0 MB in 3s (26.8 MB/s) 2023-10-06T02:46:20.166 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:20.224 INFO:teuthology.orchestra.run.smithi124.stdout:Fetched 77.0 MB in 3s (24.2 MB/s) 2023-10-06T02:46:20.320 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-06T02:46:20.418 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-06T02:46:20.555 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 77.0 MB in 3s (22.3 MB/s) 2023-10-06T02:46:20.745 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-06T02:46:20.772 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-06T02:46:20.777 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:20.838 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:22.049 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-06T02:46:22.054 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:22.117 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-06T02:46:22.130 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:22.145 INFO:teuthology.orchestra.run.smithi124.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-06T02:46:22.150 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:22.167 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:22.228 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:22.232 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:22.469 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-06T02:46:22.474 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:22.567 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:22.687 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-06T02:46:22.704 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:22.804 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:23.303 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-06T02:46:23.316 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:23.361 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:23.816 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-06T02:46:23.828 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:23.856 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:24.133 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-06T02:46:24.146 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:24.159 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-06T02:46:24.174 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:24.243 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:24.283 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:24.509 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-06T02:46:24.525 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:24.622 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:25.278 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-06T02:46:25.292 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:25.328 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:25.378 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-06T02:46:25.392 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:25.428 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:25.686 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-06T02:46:25.701 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:25.736 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:28.057 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:28.183 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:28.511 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:28.524 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:28.636 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:28.653 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:28.985 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:29.006 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-06T02:46:29.022 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-06T02:46:29.064 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T02:46:29.105 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:29.433 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-06T02:46:29.448 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-06T02:46:29.491 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T02:46:30.074 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:30.234 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:30.283 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:30.409 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:30.472 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:30.585 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:30.597 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:30.712 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:30.744 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:30.894 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:30.966 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:31.049 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-06T02:46:31.065 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-06T02:46:31.092 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:31.107 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T02:46:31.247 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-06T02:46:31.263 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-06T02:46:31.305 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T02:46:31.437 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-06T02:46:31.451 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-06T02:46:31.495 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T02:46:34.428 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-06T02:46:34.449 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:34.494 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:34.714 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-06T02:46:34.736 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:34.780 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:36.314 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-06T02:46:36.336 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:36.406 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:36.842 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-06T02:46:36.865 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:36.909 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:37.046 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-06T02:46:37.069 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T02:46:37.112 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:37.149 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:37.278 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:37.582 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:37.602 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T02:46:37.704 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:37.724 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:37.850 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:38.057 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T02:46:38.184 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:38.310 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:39.061 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:39.520 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:39.824 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:39.845 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:39.966 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:39.970 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:40.283 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T02:46:40.304 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T02:46:40.308 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T02:46:40.367 INFO:teuthology.orchestra.run.smithi158.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:46:40.368 INFO:teuthology.orchestra.run.smithi158.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-06T02:46:40.411 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T02:46:40.433 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:40.446 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:40.559 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:40.572 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:40.638 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-06T02:46:40.682 INFO:teuthology.orchestra.run.smithi174.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:46:40.683 INFO:teuthology.orchestra.run.smithi174.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-06T02:46:40.749 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T02:46:40.764 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:40.813 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-06T02:46:40.874 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:40.939 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:41.003 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:41.782 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:41.794 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:41.982 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-06T02:46:42.108 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-06T02:46:42.213 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:42.234 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:42.312 INFO:teuthology.orchestra.run.smithi158.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-06T02:46:42.313 INFO:teuthology.orchestra.run.smithi158.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:46:43.007 INFO:teuthology.orchestra.run.smithi027.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:46:43.308 INFO:teuthology.orchestra.run.smithi027.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-06T02:46:43.309 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-06T02:46:43.309 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-06T02:46:43.309 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:43.309 INFO:teuthology.orchestra.run.smithi123.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:46:43.310 INFO:teuthology.orchestra.run.smithi123.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-06T02:46:43.310 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-06T02:46:43.351 INFO:teuthology.orchestra.run.smithi124.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:46:43.351 INFO:teuthology.orchestra.run.smithi124.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-06T02:46:43.384 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-06T02:46:43.410 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:43.482 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-06T02:46:43.510 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:43.582 INFO:teuthology.orchestra.run.smithi174.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-06T02:46:43.583 INFO:teuthology.orchestra.run.smithi174.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:46:43.608 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:44.595 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-06T02:46:44.811 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-06T02:46:44.811 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-06T02:46:44.881 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:44.927 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-06T02:46:44.956 INFO:teuthology.orchestra.run.smithi123.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-06T02:46:45.666 INFO:teuthology.orchestra.run.smithi123.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:46:45.667 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:45.668 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-06T02:46:45.668 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-06T02:46:45.668 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T02:46:45.668 INFO:teuthology.orchestra.run.smithi027.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-06T02:46:45.668 INFO:teuthology.orchestra.run.smithi027.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:46:46.492 INFO:teuthology.orchestra.run.smithi124.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-06T02:46:46.493 INFO:teuthology.orchestra.run.smithi124.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:47:04.076 INFO:teuthology.orchestra.run.smithi158.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-06T02:47:04.077 INFO:teuthology.orchestra.run.smithi158.stdout:Sourcing file `/etc/default/grub' 2023-10-06T02:47:04.085 INFO:teuthology.orchestra.run.smithi158.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:47:04.096 INFO:teuthology.orchestra.run.smithi158.stdout:Generating grub configuration file ... 2023-10-06T02:47:04.423 INFO:teuthology.orchestra.run.smithi158.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:47:04.447 INFO:teuthology.orchestra.run.smithi158.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:47:04.833 INFO:teuthology.orchestra.run.smithi158.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:47:04.842 INFO:teuthology.orchestra.run.smithi158.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:47:05.354 INFO:teuthology.orchestra.run.smithi174.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-06T02:47:05.355 INFO:teuthology.orchestra.run.smithi174.stdout:Sourcing file `/etc/default/grub' 2023-10-06T02:47:05.364 INFO:teuthology.orchestra.run.smithi174.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:47:05.384 INFO:teuthology.orchestra.run.smithi174.stdout:Generating grub configuration file ... 2023-10-06T02:47:05.686 INFO:teuthology.orchestra.run.smithi174.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:47:05.709 INFO:teuthology.orchestra.run.smithi174.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:47:06.088 INFO:teuthology.orchestra.run.smithi174.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:47:06.099 INFO:teuthology.orchestra.run.smithi174.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:47:06.893 INFO:teuthology.orchestra.run.smithi123.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-06T02:47:06.893 INFO:teuthology.orchestra.run.smithi123.stdout:Sourcing file `/etc/default/grub' 2023-10-06T02:47:06.904 INFO:teuthology.orchestra.run.smithi123.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:47:06.915 INFO:teuthology.orchestra.run.smithi123.stdout:Generating grub configuration file ... 2023-10-06T02:47:07.252 INFO:teuthology.orchestra.run.smithi123.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:47:07.278 INFO:teuthology.orchestra.run.smithi123.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:47:07.486 INFO:teuthology.orchestra.run.smithi158.stdout:done 2023-10-06T02:47:07.680 INFO:teuthology.orchestra.run.smithi123.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:47:07.693 INFO:teuthology.orchestra.run.smithi123.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:47:07.901 DEBUG:teuthology.orchestra.run.smithi158:> dpkg -s linux-image-generic 2023-10-06T02:47:07.926 INFO:teuthology.orchestra.run.smithi174.stdout:done 2023-10-06T02:47:07.945 INFO:teuthology.orchestra.run.smithi158.stdout:Package: linux-image-generic 2023-10-06T02:47:07.945 INFO:teuthology.orchestra.run.smithi158.stdout:Status: install ok installed 2023-10-06T02:47:07.946 INFO:teuthology.orchestra.run.smithi158.stdout:Priority: optional 2023-10-06T02:47:07.946 INFO:teuthology.orchestra.run.smithi158.stdout:Section: kernel 2023-10-06T02:47:07.946 INFO:teuthology.orchestra.run.smithi158.stdout:Installed-Size: 20 2023-10-06T02:47:07.946 INFO:teuthology.orchestra.run.smithi158.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T02:47:07.946 INFO:teuthology.orchestra.run.smithi158.stdout:Architecture: amd64 2023-10-06T02:47:07.946 INFO:teuthology.orchestra.run.smithi158.stdout:Source: linux-meta 2023-10-06T02:47:07.947 INFO:teuthology.orchestra.run.smithi158.stdout:Version: 5.4.0.164.161 2023-10-06T02:47:07.949 INFO:teuthology.orchestra.run.smithi158.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T02:47:07.949 INFO:teuthology.orchestra.run.smithi158.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T02:47:07.949 INFO:teuthology.orchestra.run.smithi158.stdout:Recommends: thermald 2023-10-06T02:47:07.949 INFO:teuthology.orchestra.run.smithi158.stdout:Description: Generic Linux kernel image 2023-10-06T02:47:07.950 INFO:teuthology.orchestra.run.smithi158.stdout: This package will always depend on the latest generic kernel image 2023-10-06T02:47:07.950 INFO:teuthology.orchestra.run.smithi158.stdout: available. 2023-10-06T02:47:07.950 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-06T02:47:07.950 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:47:07.951 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:47:07.951 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-06T02:47:07.951 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi158.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:47:07.951 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-get clean 2023-10-06T02:47:08.033 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-get update 2023-10-06T02:47:08.161 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:47:08.168 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T02:47:08.186 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T02:47:08.282 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T02:47:08.311 INFO:teuthology.orchestra.run.smithi027.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-06T02:47:08.311 INFO:teuthology.orchestra.run.smithi027.stdout:Sourcing file `/etc/default/grub' 2023-10-06T02:47:08.331 DEBUG:teuthology.orchestra.run.smithi174:> dpkg -s linux-image-generic 2023-10-06T02:47:08.333 INFO:teuthology.orchestra.run.smithi027.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:47:08.367 INFO:teuthology.orchestra.run.smithi027.stdout:Generating grub configuration file ... 2023-10-06T02:47:08.374 INFO:teuthology.orchestra.run.smithi174.stdout:Package: linux-image-generic 2023-10-06T02:47:08.374 INFO:teuthology.orchestra.run.smithi174.stdout:Status: install ok installed 2023-10-06T02:47:08.374 INFO:teuthology.orchestra.run.smithi174.stdout:Priority: optional 2023-10-06T02:47:08.375 INFO:teuthology.orchestra.run.smithi174.stdout:Section: kernel 2023-10-06T02:47:08.375 INFO:teuthology.orchestra.run.smithi174.stdout:Installed-Size: 20 2023-10-06T02:47:08.375 INFO:teuthology.orchestra.run.smithi174.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T02:47:08.375 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: amd64 2023-10-06T02:47:08.375 INFO:teuthology.orchestra.run.smithi174.stdout:Source: linux-meta 2023-10-06T02:47:08.375 INFO:teuthology.orchestra.run.smithi174.stdout:Version: 5.4.0.164.161 2023-10-06T02:47:08.375 INFO:teuthology.orchestra.run.smithi174.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T02:47:08.375 INFO:teuthology.orchestra.run.smithi174.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T02:47:08.375 INFO:teuthology.orchestra.run.smithi174.stdout:Recommends: thermald 2023-10-06T02:47:08.376 INFO:teuthology.orchestra.run.smithi174.stdout:Description: Generic Linux kernel image 2023-10-06T02:47:08.376 INFO:teuthology.orchestra.run.smithi174.stdout: This package will always depend on the latest generic kernel image 2023-10-06T02:47:08.376 INFO:teuthology.orchestra.run.smithi174.stdout: available. 2023-10-06T02:47:08.376 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-06T02:47:08.376 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:47:08.376 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:47:08.376 INFO:teuthology.task.kernel:Installing distro kernel on client.2... 2023-10-06T02:47:08.377 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi174.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:47:08.377 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get clean 2023-10-06T02:47:08.461 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get update 2023-10-06T02:47:08.590 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:47:08.596 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T02:47:08.613 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T02:47:08.709 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T02:47:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:47:08.814 INFO:teuthology.orchestra.run.smithi027.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:47:08.823 INFO:teuthology.orchestra.run.smithi124.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-06T02:47:08.823 INFO:teuthology.orchestra.run.smithi124.stdout:Sourcing file `/etc/default/grub' 2023-10-06T02:47:08.835 INFO:teuthology.orchestra.run.smithi124.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:47:08.859 INFO:teuthology.orchestra.run.smithi124.stdout:Generating grub configuration file ... 2023-10-06T02:47:09.140 INFO:teuthology.orchestra.run.smithi124.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:47:09.161 INFO:teuthology.orchestra.run.smithi124.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:47:09.302 INFO:teuthology.orchestra.run.smithi027.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:47:09.313 INFO:teuthology.orchestra.run.smithi027.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:47:09.564 INFO:teuthology.orchestra.run.smithi124.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:47:09.574 INFO:teuthology.orchestra.run.smithi124.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:47:09.918 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2023-10-06T02:47:09.944 DEBUG:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T02:47:10.010 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2023-10-06T02:47:10.210 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2023-10-06T02:47:10.211 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2023-10-06T02:47:10.344 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2023-10-06T02:47:10.370 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T02:47:10.413 INFO:teuthology.orchestra.run.smithi123.stdout:done 2023-10-06T02:47:10.421 INFO:teuthology.orchestra.run.smithi158.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-06T02:47:10.421 INFO:teuthology.orchestra.run.smithi158.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T02:47:10.423 DEBUG:teuthology.orchestra.run.smithi158:> dpkg -s linux-image-generic 2023-10-06T02:47:10.441 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2023-10-06T02:47:10.444 INFO:teuthology.orchestra.run.smithi158.stdout:Package: linux-image-generic 2023-10-06T02:47:10.444 INFO:teuthology.orchestra.run.smithi158.stdout:Status: install ok installed 2023-10-06T02:47:10.444 INFO:teuthology.orchestra.run.smithi158.stdout:Priority: optional 2023-10-06T02:47:10.444 INFO:teuthology.orchestra.run.smithi158.stdout:Section: kernel 2023-10-06T02:47:10.444 INFO:teuthology.orchestra.run.smithi158.stdout:Installed-Size: 20 2023-10-06T02:47:10.444 INFO:teuthology.orchestra.run.smithi158.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T02:47:10.444 INFO:teuthology.orchestra.run.smithi158.stdout:Architecture: amd64 2023-10-06T02:47:10.444 INFO:teuthology.orchestra.run.smithi158.stdout:Source: linux-meta 2023-10-06T02:47:10.444 INFO:teuthology.orchestra.run.smithi158.stdout:Version: 5.4.0.164.161 2023-10-06T02:47:10.444 INFO:teuthology.orchestra.run.smithi158.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T02:47:10.445 INFO:teuthology.orchestra.run.smithi158.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T02:47:10.445 INFO:teuthology.orchestra.run.smithi158.stdout:Recommends: thermald 2023-10-06T02:47:10.445 INFO:teuthology.orchestra.run.smithi158.stdout:Description: Generic Linux kernel image 2023-10-06T02:47:10.445 INFO:teuthology.orchestra.run.smithi158.stdout: This package will always depend on the latest generic kernel image 2023-10-06T02:47:10.445 INFO:teuthology.orchestra.run.smithi158.stdout: available. 2023-10-06T02:47:10.445 DEBUG:teuthology.orchestra.run.smithi158:> mktemp 2023-10-06T02:47:10.493 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.KiCE2rcSee 2023-10-06T02:47:10.530 DEBUG:teuthology.orchestra.run.smithi158:> sudo cp /boot/grub/grub.cfg /tmp/tmp.KiCE2rcSee 2023-10-06T02:47:10.552 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.KiCE2rcSee 2023-10-06T02:47:10.620 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2023-10-06T02:47:10.621 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2023-10-06T02:47:10.643 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.KiCE2rcSee is 9KB 2023-10-06T02:47:10.657 DEBUG:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.KiCE2rcSee 2023-10-06T02:47:10.663 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-06T02:47:10.718 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T02:47:10.719 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-06T02:47:10.719 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-06T02:47:10.752 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-06T02:47:10.753 DEBUG:teuthology.orchestra.run.smithi158:> sudo update-grub 2023-10-06T02:47:10.824 INFO:teuthology.orchestra.run.smithi174.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-06T02:47:10.824 INFO:teuthology.orchestra.run.smithi174.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T02:47:10.826 DEBUG:teuthology.orchestra.run.smithi174:> dpkg -s linux-image-generic 2023-10-06T02:47:10.846 INFO:teuthology.orchestra.run.smithi174.stdout:Package: linux-image-generic 2023-10-06T02:47:10.846 INFO:teuthology.orchestra.run.smithi174.stdout:Status: install ok installed 2023-10-06T02:47:10.846 INFO:teuthology.orchestra.run.smithi174.stdout:Priority: optional 2023-10-06T02:47:10.846 INFO:teuthology.orchestra.run.smithi174.stdout:Section: kernel 2023-10-06T02:47:10.846 INFO:teuthology.orchestra.run.smithi174.stdout:Installed-Size: 20 2023-10-06T02:47:10.846 INFO:teuthology.orchestra.run.smithi174.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T02:47:10.847 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: amd64 2023-10-06T02:47:10.847 INFO:teuthology.orchestra.run.smithi174.stdout:Source: linux-meta 2023-10-06T02:47:10.847 INFO:teuthology.orchestra.run.smithi174.stdout:Version: 5.4.0.164.161 2023-10-06T02:47:10.847 INFO:teuthology.orchestra.run.smithi174.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T02:47:10.847 INFO:teuthology.orchestra.run.smithi174.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T02:47:10.847 INFO:teuthology.orchestra.run.smithi174.stdout:Recommends: thermald 2023-10-06T02:47:10.847 INFO:teuthology.orchestra.run.smithi174.stdout:Description: Generic Linux kernel image 2023-10-06T02:47:10.847 INFO:teuthology.orchestra.run.smithi174.stdout: This package will always depend on the latest generic kernel image 2023-10-06T02:47:10.847 INFO:teuthology.orchestra.run.smithi174.stdout: available. 2023-10-06T02:47:10.847 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2023-10-06T02:47:10.850 DEBUG:teuthology.orchestra.run.smithi123:> dpkg -s linux-image-generic 2023-10-06T02:47:10.892 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.LnjGKA08xX 2023-10-06T02:47:10.892 DEBUG:teuthology.orchestra.run.smithi174:> sudo cp /boot/grub/grub.cfg /tmp/tmp.LnjGKA08xX 2023-10-06T02:47:10.896 INFO:teuthology.orchestra.run.smithi123.stdout:Package: linux-image-generic 2023-10-06T02:47:10.896 INFO:teuthology.orchestra.run.smithi123.stdout:Status: install ok installed 2023-10-06T02:47:10.896 INFO:teuthology.orchestra.run.smithi123.stdout:Priority: optional 2023-10-06T02:47:10.897 INFO:teuthology.orchestra.run.smithi123.stdout:Section: kernel 2023-10-06T02:47:10.897 INFO:teuthology.orchestra.run.smithi123.stdout:Installed-Size: 20 2023-10-06T02:47:10.897 INFO:teuthology.orchestra.run.smithi123.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T02:47:10.897 INFO:teuthology.orchestra.run.smithi123.stdout:Architecture: amd64 2023-10-06T02:47:10.897 INFO:teuthology.orchestra.run.smithi123.stdout:Source: linux-meta 2023-10-06T02:47:10.897 INFO:teuthology.orchestra.run.smithi123.stdout:Version: 5.4.0.164.161 2023-10-06T02:47:10.897 INFO:teuthology.orchestra.run.smithi123.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T02:47:10.897 INFO:teuthology.orchestra.run.smithi123.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T02:47:10.897 INFO:teuthology.orchestra.run.smithi123.stdout:Recommends: thermald 2023-10-06T02:47:10.897 INFO:teuthology.orchestra.run.smithi123.stdout:Description: Generic Linux kernel image 2023-10-06T02:47:10.897 INFO:teuthology.orchestra.run.smithi123.stdout: This package will always depend on the latest generic kernel image 2023-10-06T02:47:10.897 INFO:teuthology.orchestra.run.smithi123.stdout: available. 2023-10-06T02:47:10.898 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-06T02:47:10.898 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:47:10.898 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:47:10.898 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-06T02:47:10.898 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi123.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:47:10.898 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get clean 2023-10-06T02:47:10.907 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.LnjGKA08xX 2023-10-06T02:47:10.953 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.LnjGKA08xX is 9KB 2023-10-06T02:47:10.966 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.LnjGKA08xX 2023-10-06T02:47:10.972 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-06T02:47:10.998 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get update 2023-10-06T02:47:11.029 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T02:47:11.029 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-06T02:47:11.029 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-06T02:47:11.072 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-06T02:47:11.072 DEBUG:teuthology.orchestra.run.smithi174:> sudo update-grub 2023-10-06T02:47:11.127 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T02:47:11.127 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:47:11.141 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T02:47:11.161 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T02:47:11.346 INFO:teuthology.orchestra.run.smithi124.stdout:done 2023-10-06T02:47:11.791 DEBUG:teuthology.orchestra.run.smithi124:> dpkg -s linux-image-generic 2023-10-06T02:47:11.841 INFO:teuthology.orchestra.run.smithi124.stdout:Package: linux-image-generic 2023-10-06T02:47:11.842 INFO:teuthology.orchestra.run.smithi124.stdout:Status: install ok installed 2023-10-06T02:47:11.843 INFO:teuthology.orchestra.run.smithi124.stdout:Priority: optional 2023-10-06T02:47:11.843 INFO:teuthology.orchestra.run.smithi124.stdout:Section: kernel 2023-10-06T02:47:11.843 INFO:teuthology.orchestra.run.smithi124.stdout:Installed-Size: 20 2023-10-06T02:47:11.843 INFO:teuthology.orchestra.run.smithi124.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T02:47:11.843 INFO:teuthology.orchestra.run.smithi124.stdout:Architecture: amd64 2023-10-06T02:47:11.843 INFO:teuthology.orchestra.run.smithi124.stdout:Source: linux-meta 2023-10-06T02:47:11.843 INFO:teuthology.orchestra.run.smithi124.stdout:Version: 5.4.0.164.161 2023-10-06T02:47:11.843 INFO:teuthology.orchestra.run.smithi124.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T02:47:11.843 INFO:teuthology.orchestra.run.smithi124.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T02:47:11.843 INFO:teuthology.orchestra.run.smithi124.stdout:Recommends: thermald 2023-10-06T02:47:11.845 INFO:teuthology.orchestra.run.smithi124.stdout:Description: Generic Linux kernel image 2023-10-06T02:47:11.845 INFO:teuthology.orchestra.run.smithi124.stdout: This package will always depend on the latest generic kernel image 2023-10-06T02:47:11.845 INFO:teuthology.orchestra.run.smithi124.stdout: available. 2023-10-06T02:47:11.846 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-06T02:47:11.846 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:47:11.846 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:47:11.846 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-06T02:47:11.846 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi124.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:47:11.846 DEBUG:teuthology.orchestra.run.smithi124:> sudo apt-get clean 2023-10-06T02:47:11.940 DEBUG:teuthology.orchestra.run.smithi124:> sudo apt-get update 2023-10-06T02:47:11.981 INFO:teuthology.orchestra.run.smithi158.stderr:Sourcing file `/etc/default/grub' 2023-10-06T02:47:11.991 INFO:teuthology.orchestra.run.smithi158.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:47:12.001 INFO:teuthology.orchestra.run.smithi158.stderr:Generating grub configuration file ... 2023-10-06T02:47:12.015 INFO:teuthology.orchestra.run.smithi027.stdout:done 2023-10-06T02:47:12.074 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:47:12.084 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T02:47:12.105 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T02:47:12.191 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T02:47:12.281 INFO:teuthology.orchestra.run.smithi158.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:47:12.292 INFO:teuthology.orchestra.run.smithi158.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:47:12.308 INFO:teuthology.orchestra.run.smithi174.stderr:Sourcing file `/etc/default/grub' 2023-10-06T02:47:12.313 INFO:teuthology.orchestra.run.smithi174.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:47:12.329 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2023-10-06T02:47:12.449 DEBUG:teuthology.orchestra.run.smithi027:> dpkg -s linux-image-generic 2023-10-06T02:47:12.496 INFO:teuthology.orchestra.run.smithi027.stdout:Package: linux-image-generic 2023-10-06T02:47:12.496 INFO:teuthology.orchestra.run.smithi027.stdout:Status: install ok installed 2023-10-06T02:47:12.496 INFO:teuthology.orchestra.run.smithi027.stdout:Priority: optional 2023-10-06T02:47:12.497 INFO:teuthology.orchestra.run.smithi027.stdout:Section: kernel 2023-10-06T02:47:12.497 INFO:teuthology.orchestra.run.smithi027.stdout:Installed-Size: 20 2023-10-06T02:47:12.497 INFO:teuthology.orchestra.run.smithi027.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T02:47:12.497 INFO:teuthology.orchestra.run.smithi027.stdout:Architecture: amd64 2023-10-06T02:47:12.497 INFO:teuthology.orchestra.run.smithi027.stdout:Source: linux-meta 2023-10-06T02:47:12.497 INFO:teuthology.orchestra.run.smithi027.stdout:Version: 5.4.0.164.161 2023-10-06T02:47:12.497 INFO:teuthology.orchestra.run.smithi027.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T02:47:12.497 INFO:teuthology.orchestra.run.smithi027.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T02:47:12.497 INFO:teuthology.orchestra.run.smithi027.stdout:Recommends: thermald 2023-10-06T02:47:12.497 INFO:teuthology.orchestra.run.smithi027.stdout:Description: Generic Linux kernel image 2023-10-06T02:47:12.497 INFO:teuthology.orchestra.run.smithi027.stdout: This package will always depend on the latest generic kernel image 2023-10-06T02:47:12.498 INFO:teuthology.orchestra.run.smithi027.stdout: available. 2023-10-06T02:47:12.498 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-06T02:47:12.498 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:47:12.498 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:47:12.498 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-06T02:47:12.498 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi027.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:47:12.498 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get clean 2023-10-06T02:47:12.579 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:47:12.581 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2023-10-06T02:47:12.590 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:47:12.651 INFO:teuthology.orchestra.run.smithi158.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:47:12.661 INFO:teuthology.orchestra.run.smithi158.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:47:12.719 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T02:47:12.832 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:47:12.862 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2023-10-06T02:47:12.888 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T02:47:12.914 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-06T02:47:12.930 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:47:12.942 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:47:12.956 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2023-10-06T02:47:13.134 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2023-10-06T02:47:13.135 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2023-10-06T02:47:13.256 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T02:47:13.343 INFO:teuthology.orchestra.run.smithi123.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-06T02:47:13.343 INFO:teuthology.orchestra.run.smithi123.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T02:47:13.345 DEBUG:teuthology.orchestra.run.smithi123:> dpkg -s linux-image-generic 2023-10-06T02:47:13.366 INFO:teuthology.orchestra.run.smithi123.stdout:Package: linux-image-generic 2023-10-06T02:47:13.366 INFO:teuthology.orchestra.run.smithi123.stdout:Status: install ok installed 2023-10-06T02:47:13.366 INFO:teuthology.orchestra.run.smithi123.stdout:Priority: optional 2023-10-06T02:47:13.366 INFO:teuthology.orchestra.run.smithi123.stdout:Section: kernel 2023-10-06T02:47:13.366 INFO:teuthology.orchestra.run.smithi123.stdout:Installed-Size: 20 2023-10-06T02:47:13.366 INFO:teuthology.orchestra.run.smithi123.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T02:47:13.366 INFO:teuthology.orchestra.run.smithi123.stdout:Architecture: amd64 2023-10-06T02:47:13.367 INFO:teuthology.orchestra.run.smithi123.stdout:Source: linux-meta 2023-10-06T02:47:13.367 INFO:teuthology.orchestra.run.smithi123.stdout:Version: 5.4.0.164.161 2023-10-06T02:47:13.367 INFO:teuthology.orchestra.run.smithi123.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T02:47:13.367 INFO:teuthology.orchestra.run.smithi123.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T02:47:13.367 INFO:teuthology.orchestra.run.smithi123.stdout:Recommends: thermald 2023-10-06T02:47:13.367 INFO:teuthology.orchestra.run.smithi123.stdout:Description: Generic Linux kernel image 2023-10-06T02:47:13.367 INFO:teuthology.orchestra.run.smithi123.stdout: This package will always depend on the latest generic kernel image 2023-10-06T02:47:13.367 INFO:teuthology.orchestra.run.smithi123.stdout: available. 2023-10-06T02:47:13.367 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2023-10-06T02:47:13.371 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.2mZQzPidLw 2023-10-06T02:47:13.372 DEBUG:teuthology.orchestra.run.smithi123:> sudo cp /boot/grub/grub.cfg /tmp/tmp.2mZQzPidLw 2023-10-06T02:47:13.438 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.2mZQzPidLw 2023-10-06T02:47:13.477 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.2mZQzPidLw is 9KB 2023-10-06T02:47:13.491 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.2mZQzPidLw 2023-10-06T02:47:13.498 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-06T02:47:13.556 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:47:13.557 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-06T02:47:13.557 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-06T02:47:13.589 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-06T02:47:13.590 DEBUG:teuthology.orchestra.run.smithi123:> sudo update-grub 2023-10-06T02:47:13.597 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 114 kB in 1s (139 kB/s) 2023-10-06T02:47:13.653 INFO:teuthology.orchestra.run.smithi174.stderr:done 2023-10-06T02:47:13.655 DEBUG:teuthology.orchestra.run.smithi174:> sudo shutdown -r now 2023-10-06T02:47:13.787 INFO:teuthology.orchestra.run.smithi124.stdout:Reading package lists... 2023-10-06T02:47:13.813 DEBUG:teuthology.orchestra.run.smithi124:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T02:47:13.876 INFO:teuthology.orchestra.run.smithi124.stdout:Reading package lists... 2023-10-06T02:47:14.056 INFO:teuthology.orchestra.run.smithi124.stdout:Building dependency tree... 2023-10-06T02:47:14.056 INFO:teuthology.orchestra.run.smithi124.stdout:Reading state information... 2023-10-06T02:47:14.262 INFO:teuthology.orchestra.run.smithi124.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-06T02:47:14.262 INFO:teuthology.orchestra.run.smithi124.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T02:47:14.264 DEBUG:teuthology.orchestra.run.smithi124:> dpkg -s linux-image-generic 2023-10-06T02:47:14.286 INFO:teuthology.orchestra.run.smithi124.stdout:Package: linux-image-generic 2023-10-06T02:47:14.286 INFO:teuthology.orchestra.run.smithi124.stdout:Status: install ok installed 2023-10-06T02:47:14.287 INFO:teuthology.orchestra.run.smithi124.stdout:Priority: optional 2023-10-06T02:47:14.287 INFO:teuthology.orchestra.run.smithi124.stdout:Section: kernel 2023-10-06T02:47:14.287 INFO:teuthology.orchestra.run.smithi124.stdout:Installed-Size: 20 2023-10-06T02:47:14.287 INFO:teuthology.orchestra.run.smithi124.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T02:47:14.287 INFO:teuthology.orchestra.run.smithi124.stdout:Architecture: amd64 2023-10-06T02:47:14.287 INFO:teuthology.orchestra.run.smithi124.stdout:Source: linux-meta 2023-10-06T02:47:14.287 INFO:teuthology.orchestra.run.smithi124.stdout:Version: 5.4.0.164.161 2023-10-06T02:47:14.287 INFO:teuthology.orchestra.run.smithi124.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T02:47:14.287 INFO:teuthology.orchestra.run.smithi124.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T02:47:14.287 INFO:teuthology.orchestra.run.smithi124.stdout:Recommends: thermald 2023-10-06T02:47:14.287 INFO:teuthology.orchestra.run.smithi124.stdout:Description: Generic Linux kernel image 2023-10-06T02:47:14.288 INFO:teuthology.orchestra.run.smithi124.stdout: This package will always depend on the latest generic kernel image 2023-10-06T02:47:14.288 INFO:teuthology.orchestra.run.smithi124.stdout: available. 2023-10-06T02:47:14.288 DEBUG:teuthology.orchestra.run.smithi124:> mktemp 2023-10-06T02:47:14.293 INFO:teuthology.orchestra.run.smithi124.stdout:/tmp/tmp.zmcaHM3leN 2023-10-06T02:47:14.293 DEBUG:teuthology.orchestra.run.smithi124:> sudo cp /boot/grub/grub.cfg /tmp/tmp.zmcaHM3leN 2023-10-06T02:47:14.295 INFO:teuthology.orchestra.run.smithi158.stderr:done 2023-10-06T02:47:14.297 DEBUG:teuthology.orchestra.run.smithi158:> sudo shutdown -r now 2023-10-06T02:47:14.307 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0666 /tmp/tmp.zmcaHM3leN 2023-10-06T02:47:14.390 DEBUG:teuthology.orchestra.remote:smithi124:/tmp/tmp.zmcaHM3leN is 9KB 2023-10-06T02:47:14.403 DEBUG:teuthology.orchestra.run.smithi124:> rm -fr /tmp/tmp.zmcaHM3leN 2023-10-06T02:47:14.409 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-06T02:47:14.467 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T02:47:14.467 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-06T02:47:14.467 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-06T02:47:14.500 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-06T02:47:14.501 DEBUG:teuthology.orchestra.run.smithi124:> sudo update-grub 2023-10-06T02:47:14.699 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-06T02:47:14.726 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T02:47:14.796 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-06T02:47:14.833 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub' 2023-10-06T02:47:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:47:14.852 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2023-10-06T02:47:14.981 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2023-10-06T02:47:14.981 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2023-10-06T02:47:15.075 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:47:15.087 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:47:15.200 INFO:teuthology.orchestra.run.smithi027.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-06T02:47:15.200 INFO:teuthology.orchestra.run.smithi027.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T02:47:15.202 DEBUG:teuthology.orchestra.run.smithi027:> dpkg -s linux-image-generic 2023-10-06T02:47:15.223 INFO:teuthology.orchestra.run.smithi027.stdout:Package: linux-image-generic 2023-10-06T02:47:15.224 INFO:teuthology.orchestra.run.smithi027.stdout:Status: install ok installed 2023-10-06T02:47:15.224 INFO:teuthology.orchestra.run.smithi027.stdout:Priority: optional 2023-10-06T02:47:15.224 INFO:teuthology.orchestra.run.smithi027.stdout:Section: kernel 2023-10-06T02:47:15.224 INFO:teuthology.orchestra.run.smithi027.stdout:Installed-Size: 20 2023-10-06T02:47:15.224 INFO:teuthology.orchestra.run.smithi027.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T02:47:15.224 INFO:teuthology.orchestra.run.smithi027.stdout:Architecture: amd64 2023-10-06T02:47:15.224 INFO:teuthology.orchestra.run.smithi027.stdout:Source: linux-meta 2023-10-06T02:47:15.224 INFO:teuthology.orchestra.run.smithi027.stdout:Version: 5.4.0.164.161 2023-10-06T02:47:15.224 INFO:teuthology.orchestra.run.smithi027.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T02:47:15.224 INFO:teuthology.orchestra.run.smithi027.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T02:47:15.225 INFO:teuthology.orchestra.run.smithi027.stdout:Recommends: thermald 2023-10-06T02:47:15.225 INFO:teuthology.orchestra.run.smithi027.stdout:Description: Generic Linux kernel image 2023-10-06T02:47:15.225 INFO:teuthology.orchestra.run.smithi027.stdout: This package will always depend on the latest generic kernel image 2023-10-06T02:47:15.225 INFO:teuthology.orchestra.run.smithi027.stdout: available. 2023-10-06T02:47:15.225 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2023-10-06T02:47:15.230 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.VKFyFKzXx2 2023-10-06T02:47:15.230 DEBUG:teuthology.orchestra.run.smithi027:> sudo cp /boot/grub/grub.cfg /tmp/tmp.VKFyFKzXx2 2023-10-06T02:47:15.288 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.VKFyFKzXx2 2023-10-06T02:47:15.322 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.VKFyFKzXx2 is 9KB 2023-10-06T02:47:15.336 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.VKFyFKzXx2 2023-10-06T02:47:15.342 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-06T02:47:15.395 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:47:15.395 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-06T02:47:15.395 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-06T02:47:15.424 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-06T02:47:15.424 DEBUG:teuthology.orchestra.run.smithi027:> sudo update-grub 2023-10-06T02:47:15.448 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:47:15.459 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:47:15.734 INFO:teuthology.orchestra.run.smithi124.stderr:Sourcing file `/etc/default/grub' 2023-10-06T02:47:15.738 INFO:teuthology.orchestra.run.smithi124.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:47:15.749 INFO:teuthology.orchestra.run.smithi124.stderr:Generating grub configuration file ... 2023-10-06T02:47:15.989 INFO:teuthology.orchestra.run.smithi124.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:47:16.001 INFO:teuthology.orchestra.run.smithi124.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:47:16.393 INFO:teuthology.orchestra.run.smithi124.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:47:16.404 INFO:teuthology.orchestra.run.smithi124.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:47:16.707 INFO:teuthology.orchestra.run.smithi027.stderr:Sourcing file `/etc/default/grub' 2023-10-06T02:47:16.715 INFO:teuthology.orchestra.run.smithi027.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:47:16.724 INFO:teuthology.orchestra.run.smithi027.stderr:Generating grub configuration file ... 2023-10-06T02:47:17.035 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T02:47:17.047 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T02:47:17.088 INFO:teuthology.orchestra.run.smithi123.stderr:done 2023-10-06T02:47:17.090 DEBUG:teuthology.orchestra.run.smithi123:> sudo shutdown -r now 2023-10-06T02:47:17.140 INFO:teuthology.orchestra.run.smithi124.stderr:done 2023-10-06T02:47:17.142 DEBUG:teuthology.orchestra.run.smithi124:> sudo shutdown -r now 2023-10-06T02:47:17.449 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:47:17.461 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:47:19.075 INFO:teuthology.orchestra.run.smithi027.stderr:done 2023-10-06T02:47:19.077 DEBUG:teuthology.orchestra.run.smithi027:> sudo shutdown -r now 2023-10-06T02:47:43.682 INFO:teuthology.task.kernel:Checking client client.2 for new kernel version... 2023-10-06T02:47:43.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-10-06T02:47:43.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:47:44.300 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T02:47:44.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T02:47:44.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:47:47.094 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-06T02:47:47.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-06T02:47:47.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:47:47.145 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T02:47:47.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-06T02:47:47.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:47:49.082 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-06T02:47:49.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-06T02:47:49.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:48:18.302 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-10-06T02:48:18.810 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-06T02:48:21.626 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-06T02:48:21.627 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-06T02:48:23.674 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-06T02:48:27.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-10-06T02:48:27.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:48:27.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T02:48:27.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:48:30.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-06T02:48:30.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:48:30.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-06T02:48:30.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:48:30.878 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-06T02:48:32.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-06T02:48:32.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:48:35.738 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-06T02:48:42.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T02:48:42.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:48:45.690 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-10-06T02:48:47.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-06T02:48:47.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:48:49.022 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-06T02:48:49.023 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-06T02:48:50.810 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-06T02:48:57.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-10-06T02:48:57.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:48:58.060 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-10-06T02:48:58.871 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-10-06T02:48:58.872 INFO:teuthology.task.kernel:Checking kernel version of client.2, want "5.4.0-164-generic"... 2023-10-06T02:48:58.872 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2023-10-06T02:48:58.877 INFO:teuthology.orchestra.run.smithi174.stdout:5.4.0-164-generic 2023-10-06T02:48:58.878 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-06T02:48:58.878 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:48:58.878 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-06T02:48:59.879 INFO:teuthology.task.kernel:Enabling kdb on client.2... 2023-10-06T02:48:59.880 DEBUG:teuthology.orchestra.run.smithi174:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T02:49:00.021 INFO:teuthology.orchestra.run.smithi174.stdout:ttyS1 2023-10-06T02:49:00.049 DEBUG:teuthology.parallel:result is None 2023-10-06T02:49:01.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-06T02:49:01.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:49:01.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-06T02:49:01.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:49:01.310 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-06T02:49:01.412 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-10-06T02:49:01.530 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-10-06T02:49:02.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-06T02:49:02.286 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.4.0-164-generic"... 2023-10-06T02:49:02.286 DEBUG:teuthology.orchestra.run.smithi124:> uname -r 2023-10-06T02:49:02.292 INFO:teuthology.orchestra.run.smithi124.stdout:5.4.0-164-generic 2023-10-06T02:49:02.292 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-06T02:49:02.292 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:49:02.292 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-06T02:49:02.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-06T02:49:02.479 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-164-generic"... 2023-10-06T02:49:02.480 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2023-10-06T02:49:02.486 INFO:teuthology.orchestra.run.smithi123.stdout:5.4.0-164-generic 2023-10-06T02:49:02.486 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-06T02:49:02.486 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:49:02.487 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-06T02:49:03.294 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-10-06T02:49:03.294 DEBUG:teuthology.orchestra.run.smithi124:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T02:49:03.370 INFO:teuthology.orchestra.run.smithi124.stdout:ttyS1 2023-10-06T02:49:03.403 DEBUG:teuthology.parallel:result is None 2023-10-06T02:49:03.489 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-06T02:49:03.489 DEBUG:teuthology.orchestra.run.smithi123:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T02:49:03.591 INFO:teuthology.orchestra.run.smithi123.stdout:ttyS1 2023-10-06T02:49:03.635 DEBUG:teuthology.parallel:result is None 2023-10-06T02:49:05.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-06T02:49:05.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:49:16.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T02:49:16.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:49:16.517 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-10-06T02:49:17.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T02:49:17.085 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.4.0-164-generic"... 2023-10-06T02:49:17.085 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-10-06T02:49:17.091 INFO:teuthology.orchestra.run.smithi158.stdout:5.4.0-164-generic 2023-10-06T02:49:17.091 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-06T02:49:17.091 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:49:17.092 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-06T02:49:18.093 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2023-10-06T02:49:18.093 DEBUG:teuthology.orchestra.run.smithi158:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T02:49:18.179 INFO:teuthology.orchestra.run.smithi158.stdout:ttyS1 2023-10-06T02:49:18.199 DEBUG:teuthology.parallel:result is None 2023-10-06T02:49:24.350 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-06T02:49:42.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-06T02:49:42.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:49:42.714 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-10-06T02:49:43.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-06T02:49:43.645 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-164-generic"... 2023-10-06T02:49:43.646 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2023-10-06T02:49:43.651 INFO:teuthology.orchestra.run.smithi027.stdout:5.4.0-164-generic 2023-10-06T02:49:43.651 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-06T02:49:43.651 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:49:43.651 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-06T02:49:44.652 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-06T02:49:44.653 DEBUG:teuthology.orchestra.run.smithi027:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T02:49:44.828 INFO:teuthology.orchestra.run.smithi027.stdout:ttyS1 2023-10-06T02:49:44.849 DEBUG:teuthology.parallel:result is None 2023-10-06T02:49:44.849 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T02:49:44.856 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T02:49:44.856 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:49:44.859 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:49:44.861 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:49:44.864 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:49:44.866 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:49:44.873 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T02:49:44.879 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T02:49:44.887 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T02:49:44.887 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:49:44.889 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:49:44.891 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:49:44.894 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:49:44.896 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:49:44.934 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T02:49:44.940 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T02:49:44.940 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:49:44.964 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:49:44.967 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:49:44.970 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:49:44.973 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:49:44.989 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:49:44.990 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:49:44.994 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:49:44.994 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:49:44.996 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:49:45.000 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:49:45.001 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:49:45.004 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:49:45.005 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:49:45.007 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:49:45.009 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T02:49:45.017 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T02:49:45.017 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:49:45.019 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:49:45.022 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:49:45.048 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:49:45.050 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:49:45.067 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T02:49:45.075 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T02:49:45.075 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:49:45.077 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:49:45.080 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:49:45.082 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:49:45.106 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:49:45.114 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:49:45.133 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:49:45.138 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:49:45.139 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:49:45.293 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:49:45.300 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:49:45.307 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:49:45.307 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:49:45.330 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:49:45.337 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:49:45.384 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T02:49:45.385 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:49:45.404 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:49:45.411 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:49:45.460 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T02:49:45.460 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:49:45.484 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:49:45.491 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:49:45.499 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T02:49:45.499 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:49:45.571 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2023-10-06T02:49:45.573 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2023-10-06T02:49:45.575 DEBUG:teuthology.orchestra.run.smithi124:> sudo service rsyslog restart 2023-10-06T02:49:45.577 DEBUG:teuthology.orchestra.run.smithi158:> sudo service rsyslog restart 2023-10-06T02:49:45.580 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2023-10-06T02:49:45.635 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T02:49:45.643 INFO:teuthology.task.internal:Starting timer... 2023-10-06T02:49:45.643 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T02:49:45.653 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T02:49:45.661 DEBUG:teuthology.task.selinux:Excluding smithi027: OS 'ubuntu' does not support SELinux 2023-10-06T02:49:45.661 DEBUG:teuthology.task.selinux:Excluding smithi123: OS 'ubuntu' does not support SELinux 2023-10-06T02:49:45.662 DEBUG:teuthology.task.selinux:Excluding smithi124: OS 'ubuntu' does not support SELinux 2023-10-06T02:49:45.662 DEBUG:teuthology.task.selinux:Excluding smithi158: OS 'ubuntu' does not support SELinux 2023-10-06T02:49:45.662 DEBUG:teuthology.task.selinux:Excluding smithi174: OS 'ubuntu' does not support SELinux 2023-10-06T02:49:45.662 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T02:49:45.662 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-06T02:49:45.662 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T02:49:45.663 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T02:49:45.672 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-06T02:49:45.678 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-06T02:49:45.789 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T02:49:45.805 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T02:49:45.806 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi027.front.sepia.ceph.com,smithi123.front.sepia.ceph.com,smithi124.front.sepia.ceph.com,smithi158.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T02:55:45.058 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi027.front.sepia.ceph.com'), Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi124.front.sepia.ceph.com'), Remote(name='ubuntu@smithi158.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2023-10-06T02:55:45.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-06T02:55:45.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:55:45.108 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-10-06T02:55:45.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-06T02:55:45.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-06T02:55:45.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:55:45.287 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-10-06T02:55:45.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-06T02:55:45.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-06T02:55:45.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:55:45.462 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-10-06T02:55:45.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-06T02:55:45.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T02:55:45.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:55:45.633 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-10-06T02:55:45.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-06T02:55:45.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-10-06T02:55:45.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:55:45.802 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-10-06T02:55:45.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-10-06T02:55:45.924 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T02:55:45.934 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T02:55:45.934 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:55:45.934 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:55:45.936 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:55:45.937 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:55:45.939 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:55:45.939 DEBUG:teuthology.orchestra.run.smithi124:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:55:45.941 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:55:45.942 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:55:45.944 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:55:45.944 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:55:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: 6 Oct 02:55:45 ntpd[22911]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-06T02:55:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: 6 Oct 02:55:45 ntpd[22911]: Command line: ntpd -gq 2023-10-06T02:55:45.970 INFO:teuthology.orchestra.run.smithi124.stdout: 6 Oct 02:55:45 ntpd[22928]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-06T02:55:45.970 INFO:teuthology.orchestra.run.smithi124.stdout: 6 Oct 02:55:45 ntpd[22928]: Command line: ntpd -gq 2023-10-06T02:55:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: 6 Oct 02:55:45 ntpd[22911]: proto: precision = 0.100 usec (-23) 2023-10-06T02:55:45.971 INFO:teuthology.orchestra.run.smithi123.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:55:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: 6 Oct 02:55:45 ntpd[22911]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:55:45.971 INFO:teuthology.orchestra.run.smithi123.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:55:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: 6 Oct 02:55:45 ntpd[22911]: restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:55:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: 6 Oct 02:55:45 ntpd[22911]: Listen and drop on 0 v6wildcard [::]:123 2023-10-06T02:55:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: 6 Oct 02:55:45 ntpd[22911]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-06T02:55:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: 6 Oct 02:55:45 ntpd[22911]: Listen normally on 2 lo 127.0.0.1:123 2023-10-06T02:55:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: 6 Oct 02:55:45 ntpd[22911]: Listen normally on 3 enp3s0f1 172.21.15.123:123 2023-10-06T02:55:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: 6 Oct 02:55:45 ntpd[22911]: Listen normally on 4 lo [::1]:123 2023-10-06T02:55:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: 6 Oct 02:55:45 ntpd[22911]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3f1%5]:123 2023-10-06T02:55:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: 6 Oct 02:55:45 ntpd[22911]: Listening on routing socket on fd #22 for interface updates 2023-10-06T02:55:45.974 INFO:teuthology.orchestra.run.smithi124.stdout: 6 Oct 02:55:45 ntpd[22928]: proto: precision = 0.103 usec (-23) 2023-10-06T02:55:45.974 INFO:teuthology.orchestra.run.smithi124.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:55:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: 6 Oct 02:55:45 ntpd[22739]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-06T02:55:45.974 INFO:teuthology.orchestra.run.smithi027.stdout: 6 Oct 02:55:45 ntpd[22739]: Command line: ntpd -gq 2023-10-06T02:55:45.975 INFO:teuthology.orchestra.run.smithi027.stdout: 6 Oct 02:55:45 ntpd[22739]: proto: precision = 0.120 usec (-23) 2023-10-06T02:55:45.975 INFO:teuthology.orchestra.run.smithi027.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:55:45.975 INFO:teuthology.orchestra.run.smithi124.stdout: 6 Oct 02:55:45 ntpd[22928]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:55:45.976 INFO:teuthology.orchestra.run.smithi124.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:55:45.976 INFO:teuthology.orchestra.run.smithi027.stdout: 6 Oct 02:55:45 ntpd[22739]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:55:45.976 INFO:teuthology.orchestra.run.smithi027.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:55:45.978 INFO:teuthology.orchestra.run.smithi124.stdout: 6 Oct 02:55:45 ntpd[22928]: restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:55:45.978 INFO:teuthology.orchestra.run.smithi124.stdout: 6 Oct 02:55:45 ntpd[22928]: Listen and drop on 0 v6wildcard [::]:123 2023-10-06T02:55:45.978 INFO:teuthology.orchestra.run.smithi124.stdout: 6 Oct 02:55:45 ntpd[22928]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-06T02:55:45.979 INFO:teuthology.orchestra.run.smithi124.stdout: 6 Oct 02:55:45 ntpd[22928]: Listen normally on 2 lo 127.0.0.1:123 2023-10-06T02:55:45.979 INFO:teuthology.orchestra.run.smithi124.stdout: 6 Oct 02:55:45 ntpd[22928]: Listen normally on 3 enp3s0f1 172.21.15.124:123 2023-10-06T02:55:45.979 INFO:teuthology.orchestra.run.smithi124.stdout: 6 Oct 02:55:45 ntpd[22928]: Listen normally on 4 lo [::1]:123 2023-10-06T02:55:45.979 INFO:teuthology.orchestra.run.smithi124.stdout: 6 Oct 02:55:45 ntpd[22928]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5c5%5]:123 2023-10-06T02:55:45.979 INFO:teuthology.orchestra.run.smithi124.stdout: 6 Oct 02:55:45 ntpd[22928]: Listening on routing socket on fd #22 for interface updates 2023-10-06T02:55:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: 6 Oct 02:55:45 ntpd[22739]: restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:55:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: 6 Oct 02:55:45 ntpd[22739]: Listen and drop on 0 v6wildcard [::]:123 2023-10-06T02:55:45.979 INFO:teuthology.orchestra.run.smithi027.stdout: 6 Oct 02:55:45 ntpd[22739]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-06T02:55:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: 6 Oct 02:55:45 ntpd[22739]: Listen normally on 2 lo 127.0.0.1:123 2023-10-06T02:55:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: 6 Oct 02:55:45 ntpd[22739]: Listen normally on 3 ens1f0 172.21.15.27:123 2023-10-06T02:55:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: 6 Oct 02:55:45 ntpd[22739]: Listen normally on 4 lo [::1]:123 2023-10-06T02:55:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: 6 Oct 02:55:45 ntpd[22739]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:395a%4]:123 2023-10-06T02:55:45.980 INFO:teuthology.orchestra.run.smithi027.stdout: 6 Oct 02:55:45 ntpd[22739]: Listening on routing socket on fd #22 for interface updates 2023-10-06T02:55:45.981 INFO:teuthology.orchestra.run.smithi174.stdout: 6 Oct 02:55:45 ntpd[22885]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-06T02:55:45.981 INFO:teuthology.orchestra.run.smithi174.stdout: 6 Oct 02:55:45 ntpd[22885]: Command line: ntpd -gq 2023-10-06T02:55:45.981 INFO:teuthology.orchestra.run.smithi174.stdout: 6 Oct 02:55:45 ntpd[22885]: proto: precision = 0.092 usec (-23) 2023-10-06T02:55:45.981 INFO:teuthology.orchestra.run.smithi158.stdout: 6 Oct 02:55:45 ntpd[22840]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-06T02:55:45.981 INFO:teuthology.orchestra.run.smithi158.stdout: 6 Oct 02:55:45 ntpd[22840]: Command line: ntpd -gq 2023-10-06T02:55:45.982 INFO:teuthology.orchestra.run.smithi158.stdout: 6 Oct 02:55:45 ntpd[22840]: proto: precision = 0.088 usec (-23) 2023-10-06T02:55:45.982 INFO:teuthology.orchestra.run.smithi174.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:55:45.982 INFO:teuthology.orchestra.run.smithi158.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:55:45.983 INFO:teuthology.orchestra.run.smithi174.stdout: 6 Oct 02:55:45 ntpd[22885]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:55:45.983 INFO:teuthology.orchestra.run.smithi158.stdout: 6 Oct 02:55:45 ntpd[22840]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:55:45.983 INFO:teuthology.orchestra.run.smithi174.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:55:45.983 INFO:teuthology.orchestra.run.smithi158.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:55:45.985 INFO:teuthology.orchestra.run.smithi174.stdout: 6 Oct 02:55:45 ntpd[22885]: restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:55:45.985 INFO:teuthology.orchestra.run.smithi174.stdout: 6 Oct 02:55:45 ntpd[22885]: Listen and drop on 0 v6wildcard [::]:123 2023-10-06T02:55:45.985 INFO:teuthology.orchestra.run.smithi174.stdout: 6 Oct 02:55:45 ntpd[22885]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-06T02:55:45.985 INFO:teuthology.orchestra.run.smithi174.stdout: 6 Oct 02:55:45 ntpd[22885]: Listen normally on 2 lo 127.0.0.1:123 2023-10-06T02:55:45.985 INFO:teuthology.orchestra.run.smithi174.stdout: 6 Oct 02:55:45 ntpd[22885]: Listen normally on 3 enp3s0f1 172.21.15.174:123 2023-10-06T02:55:45.985 INFO:teuthology.orchestra.run.smithi174.stdout: 6 Oct 02:55:45 ntpd[22885]: Listen normally on 4 lo [::1]:123 2023-10-06T02:55:45.986 INFO:teuthology.orchestra.run.smithi174.stdout: 6 Oct 02:55:45 ntpd[22885]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:771b%5]:123 2023-10-06T02:55:45.986 INFO:teuthology.orchestra.run.smithi174.stdout: 6 Oct 02:55:45 ntpd[22885]: Listening on routing socket on fd #22 for interface updates 2023-10-06T02:55:45.986 INFO:teuthology.orchestra.run.smithi158.stdout: 6 Oct 02:55:45 ntpd[22840]: restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:55:45.986 INFO:teuthology.orchestra.run.smithi158.stdout: 6 Oct 02:55:45 ntpd[22840]: Listen and drop on 0 v6wildcard [::]:123 2023-10-06T02:55:45.986 INFO:teuthology.orchestra.run.smithi158.stdout: 6 Oct 02:55:45 ntpd[22840]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-06T02:55:45.986 INFO:teuthology.orchestra.run.smithi158.stdout: 6 Oct 02:55:45 ntpd[22840]: Listen normally on 2 lo 127.0.0.1:123 2023-10-06T02:55:45.986 INFO:teuthology.orchestra.run.smithi158.stdout: 6 Oct 02:55:45 ntpd[22840]: Listen normally on 3 enp3s0f1 172.21.15.158:123 2023-10-06T02:55:45.986 INFO:teuthology.orchestra.run.smithi158.stdout: 6 Oct 02:55:45 ntpd[22840]: Listen normally on 4 lo [::1]:123 2023-10-06T02:55:45.986 INFO:teuthology.orchestra.run.smithi158.stdout: 6 Oct 02:55:45 ntpd[22840]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:726f%5]:123 2023-10-06T02:55:45.986 INFO:teuthology.orchestra.run.smithi158.stdout: 6 Oct 02:55:45 ntpd[22840]: Listening on routing socket on fd #22 for interface updates 2023-10-06T02:55:46.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:46 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:46.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:46 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:46.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:46 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:46.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:46 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:46.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:46 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:46.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:46 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:46.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:46 ntpd[22911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:46.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:46 ntpd[22911]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:46.972 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:46 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:46.972 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:46 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:46.972 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:46 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:46.972 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:46 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:46.972 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:46 ntpd[22928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:46.972 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:46 ntpd[22928]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:46.973 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:46 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:46.973 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:46 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:46.973 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:46 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:46.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:46 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:46.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:46 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:46.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:46 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:46.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:46 ntpd[22739]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:46.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:46 ntpd[22739]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:46.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:46 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:46.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:46 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:46.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:46 ntpd[22739]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:46.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:46 ntpd[22739]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:46.977 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:46 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:46.977 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:46 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:47.971 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:47 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:47.971 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:47 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:47.971 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:47 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:47.971 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:47 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:47.971 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:47 ntpd[22928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:47.971 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:47 ntpd[22928]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:47.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:47 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:47.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:47 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:47.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:47 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:47.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:47 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:47.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:47 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:47.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:47 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:47.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:47 ntpd[22840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:47.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:47 ntpd[22840]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:47.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:47 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:47.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:47 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:47.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:47 ntpd[22840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:47.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:47 ntpd[22840]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:48.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:48 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:48.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:48 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:48.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:48 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:48.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:48 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:48.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:48 ntpd[22911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:48.972 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:48 ntpd[22911]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:48.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:48 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:48.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:48 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:48.975 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:48 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:48.975 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:48 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:48.975 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:48 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:48.975 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:48 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:48.975 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:48 ntpd[22928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:48.976 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:48 ntpd[22928]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:48.976 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:48 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:48.976 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:48 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:48.977 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:48 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:48.977 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:48 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:48.977 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:48 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:48.977 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:48 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:48.977 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:48 ntpd[22739]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:48.978 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:48 ntpd[22739]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:48.978 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:48 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:48.978 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:48 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:48.978 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:48 ntpd[22739]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:48.978 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:48 ntpd[22739]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:48.980 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:48 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:48.980 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:48 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:48.980 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:48 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:48.981 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:48 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:48.981 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:48 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:48.981 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:48 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:48.981 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:48 ntpd[22885]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:48.981 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:48 ntpd[22885]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:48.981 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:48 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:48.982 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:48 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:48.982 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:48 ntpd[22885]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:48.982 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:48 ntpd[22885]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:49.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:49 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:49 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:49 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:49 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:49 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:49 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:49 ntpd[22911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:49.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:49 ntpd[22911]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:49.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:49 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:49 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:49 ntpd[22911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:49.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:49 ntpd[22911]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:49.972 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:49 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.972 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:49 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.973 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:49 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:49 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:49 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:49 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:49 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:49 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:49 ntpd[22928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:49.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:49 ntpd[22928]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:49.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:49 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:49 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.975 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:49 ntpd[22928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:49.975 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:49 ntpd[22928]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:49.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:49 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:49 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:49 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:49 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:49 ntpd[22885]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:49.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:49 ntpd[22885]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:49.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:49.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:49.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.982 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.982 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:49.982 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:49.982 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:49.982 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:49.982 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:49.982 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:49 ntpd[22840]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:50.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:50 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:50 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:50 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:50 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:50 ntpd[22911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:50.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:50 ntpd[22911]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:50.971 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:50 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.971 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:50 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.971 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:50 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.971 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:50 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.972 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:50 ntpd[22928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:50.972 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:50 ntpd[22928]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:50.973 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.973 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.973 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.973 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:50.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:50.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:50.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:50.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.975 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:50.975 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:50 ntpd[22739]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:50.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:50 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:50 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:50 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:50 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:50 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:50 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:50 ntpd[22885]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:50.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:50 ntpd[22885]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:50.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:50 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:50 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:50.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:50 ntpd[22885]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:50.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:50 ntpd[22885]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:50.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:50 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:50.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:50 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:51 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:51 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:51 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:51 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:51 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:51 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:51 ntpd[22911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:51.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:51 ntpd[22911]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:51.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:51 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:51 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:51 ntpd[22911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:51.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:51 ntpd[22911]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:51.973 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:51 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.973 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:51 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.973 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:51 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.973 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:51 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.973 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:51 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.973 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:51 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.973 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:51 ntpd[22928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:51.973 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:51 ntpd[22928]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:51.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:51 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:51 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:51 ntpd[22928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:51.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:51 ntpd[22928]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:51.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:51 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:51 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:51 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:51 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:51 ntpd[22885]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:51.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:51 ntpd[22885]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:51.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.980 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:51.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:51.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:51.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:51.981 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:51.982 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:51.982 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:51.982 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:51 ntpd[22840]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:52.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:52 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:52.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:52 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:52.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:52 ntpd[22911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:52.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:52 ntpd[22911]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:52.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:52 ntpd[22911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:52.970 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:52 ntpd[22911]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:52.971 INFO:teuthology.orchestra.run.smithi123.stdout: 6 Oct 02:55:52 ntpd[22911]: ntpd: time slew -0.001266 s 2023-10-06T02:55:52.971 INFO:teuthology.orchestra.run.smithi123.stdout:ntpd: time slew -0.001266s 2023-10-06T02:55:52.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:52 ntpd[22911]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-06T02:55:52.971 INFO:teuthology.orchestra.run.smithi123.stderr: 6 Oct 02:55:52 ntpd[22911]: can't open /var/log/ntpstats/loopstats.20231006: Permission denied 2023-10-06T02:55:52.973 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:52 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:52.973 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:52 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:52.973 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:52 ntpd[22928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:52.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:52 ntpd[22928]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:52.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:52 ntpd[22928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:52.974 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:52 ntpd[22928]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:52.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:52 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:52.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:52 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:52.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:52 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:52.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:52 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:52.974 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:52 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:52.975 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:52 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:52.975 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:52 ntpd[22739]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:52.975 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:52 ntpd[22739]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:52.975 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:52 ntpd[22739]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:52.975 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:52 ntpd[22739]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:52.975 INFO:teuthology.orchestra.run.smithi124.stdout: 6 Oct 02:55:52 ntpd[22928]: ntpd: time slew +0.004430 s 2023-10-06T02:55:52.975 INFO:teuthology.orchestra.run.smithi124.stdout:ntpd: time slew +0.004430s 2023-10-06T02:55:52.975 INFO:teuthology.orchestra.run.smithi027.stdout: 6 Oct 02:55:52 ntpd[22739]: ntpd: time slew -0.001589 s 2023-10-06T02:55:52.976 INFO:teuthology.orchestra.run.smithi027.stdout:ntpd: time slew -0.001589s 2023-10-06T02:55:52.976 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:52 ntpd[22928]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-06T02:55:52.976 INFO:teuthology.orchestra.run.smithi124.stderr: 6 Oct 02:55:52 ntpd[22928]: can't open /var/log/ntpstats/loopstats.20231006: Permission denied 2023-10-06T02:55:52.976 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:52 ntpd[22739]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-06T02:55:52.976 INFO:teuthology.orchestra.run.smithi027.stderr: 6 Oct 02:55:52 ntpd[22739]: can't open /var/log/ntpstats/loopstats.20231006: Permission denied 2023-10-06T02:55:52.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:52 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:52.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:52 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:52.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:52 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:52.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:52 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:52.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:52 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:52.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:52 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:52.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:52 ntpd[22885]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:52.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:52 ntpd[22885]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:52.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:52 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:52.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:52 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:52.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:52 ntpd[22885]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:52.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:52 ntpd[22885]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:53.042 INFO:teuthology.orchestra.run.smithi123.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T02:55:53.043 INFO:teuthology.orchestra.run.smithi123.stdout:============================================================================== 2023-10-06T02:55:53.043 INFO:teuthology.orchestra.run.smithi123.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:53.043 INFO:teuthology.orchestra.run.smithi123.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:53.043 INFO:teuthology.orchestra.run.smithi123.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:53.043 INFO:teuthology.orchestra.run.smithi123.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:53.046 INFO:teuthology.orchestra.run.smithi027.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T02:55:53.046 INFO:teuthology.orchestra.run.smithi027.stdout:============================================================================== 2023-10-06T02:55:53.046 INFO:teuthology.orchestra.run.smithi027.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:53.047 INFO:teuthology.orchestra.run.smithi027.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:53.047 INFO:teuthology.orchestra.run.smithi027.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:53.047 INFO:teuthology.orchestra.run.smithi027.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:53.062 INFO:teuthology.orchestra.run.smithi124.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T02:55:53.063 INFO:teuthology.orchestra.run.smithi124.stdout:============================================================================== 2023-10-06T02:55:53.063 INFO:teuthology.orchestra.run.smithi124.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:53.063 INFO:teuthology.orchestra.run.smithi124.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:53.063 INFO:teuthology.orchestra.run.smithi124.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:53.063 INFO:teuthology.orchestra.run.smithi124.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:53.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:53 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:53.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:53 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:53.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:53 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:53.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:53 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:53.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:53 ntpd[22885]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:53.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:53 ntpd[22885]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:53.983 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:53.983 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:53.984 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:53.984 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:53.984 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:53.984 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:53.984 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:53.985 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:53.985 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:53.985 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:53.985 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:53.985 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:53.985 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:53.986 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:53.986 INFO:teuthology.orchestra.run.smithi158.stdout: 6 Oct 02:55:53 ntpd[22840]: ntpd: time slew +0.003628 s 2023-10-06T02:55:53.986 INFO:teuthology.orchestra.run.smithi158.stdout:ntpd: time slew +0.003628s 2023-10-06T02:55:53.987 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-06T02:55:53.987 INFO:teuthology.orchestra.run.smithi158.stderr: 6 Oct 02:55:53 ntpd[22840]: can't open /var/log/ntpstats/loopstats.20231006: Permission denied 2023-10-06T02:55:54.063 INFO:teuthology.orchestra.run.smithi158.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T02:55:54.065 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================== 2023-10-06T02:55:54.065 INFO:teuthology.orchestra.run.smithi158.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:54.065 INFO:teuthology.orchestra.run.smithi158.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:54.065 INFO:teuthology.orchestra.run.smithi158.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:54.066 INFO:teuthology.orchestra.run.smithi158.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:54.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:54 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:54.978 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:54 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:54.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:54 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:54.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:54 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:54.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:54 ntpd[22885]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:55:54.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:54 ntpd[22885]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:55:54.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:54 ntpd[22885]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:55:54.979 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:54 ntpd[22885]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:55:54.980 INFO:teuthology.orchestra.run.smithi174.stdout: 6 Oct 02:55:54 ntpd[22885]: ntpd: time slew +0.001083 s 2023-10-06T02:55:54.980 INFO:teuthology.orchestra.run.smithi174.stdout:ntpd: time slew +0.001083s 2023-10-06T02:55:54.980 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:54 ntpd[22885]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-06T02:55:54.981 INFO:teuthology.orchestra.run.smithi174.stderr: 6 Oct 02:55:54 ntpd[22885]: can't open /var/log/ntpstats/loopstats.20231006: Permission denied 2023-10-06T02:55:55.046 INFO:teuthology.orchestra.run.smithi174.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T02:55:55.046 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================== 2023-10-06T02:55:55.046 INFO:teuthology.orchestra.run.smithi174.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:55.046 INFO:teuthology.orchestra.run.smithi174.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:55.046 INFO:teuthology.orchestra.run.smithi174.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:55.046 INFO:teuthology.orchestra.run.smithi174.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:55:55.046 INFO:teuthology.run_tasks:Running task install... 2023-10-06T02:55:55.058 DEBUG:teuthology.task.install:project ceph 2023-10-06T02:55:55.059 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T02:55:55.059 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T02:55:55.059 INFO:teuthology.task.install:Using flavor: default 2023-10-06T02:55:55.065 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T02:55:55.065 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T02:55:55.065 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-key list | grep Ceph 2023-10-06T02:55:55.066 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-key list | grep Ceph 2023-10-06T02:55:55.066 DEBUG:teuthology.orchestra.run.smithi124:> sudo apt-key list | grep Ceph 2023-10-06T02:55:55.067 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-key list | grep Ceph 2023-10-06T02:55:55.067 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-key list | grep Ceph 2023-10-06T02:55:55.166 INFO:teuthology.orchestra.run.smithi174.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-06T02:55:55.166 INFO:teuthology.orchestra.run.smithi124.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-06T02:55:55.169 INFO:teuthology.orchestra.run.smithi027.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-06T02:55:55.170 INFO:teuthology.orchestra.run.smithi123.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-06T02:55:55.173 INFO:teuthology.orchestra.run.smithi158.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-06T02:55:55.223 INFO:teuthology.orchestra.run.smithi174.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-06T02:55:55.223 INFO:teuthology.orchestra.run.smithi174.stdout:uid [ unknown] Ceph.com (release key) 2023-10-06T02:55:55.225 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-06T02:55:55.225 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-06T02:55:55.225 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:55:55.229 INFO:teuthology.orchestra.run.smithi124.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-06T02:55:55.229 INFO:teuthology.orchestra.run.smithi124.stdout:uid [ unknown] Ceph.com (release key) 2023-10-06T02:55:55.230 INFO:teuthology.orchestra.run.smithi158.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-06T02:55:55.230 INFO:teuthology.orchestra.run.smithi158.stdout:uid [ unknown] Ceph.com (release key) 2023-10-06T02:55:55.231 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-06T02:55:55.231 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-06T02:55:55.231 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:55:55.235 INFO:teuthology.orchestra.run.smithi123.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-06T02:55:55.235 INFO:teuthology.orchestra.run.smithi123.stdout:uid [ unknown] Ceph.com (release key) 2023-10-06T02:55:55.236 INFO:teuthology.orchestra.run.smithi027.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-06T02:55:55.236 INFO:teuthology.orchestra.run.smithi027.stdout:uid [ unknown] Ceph.com (release key) 2023-10-06T02:55:55.236 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-06T02:55:55.236 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-06T02:55:55.236 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:55:55.237 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-06T02:55:55.238 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-06T02:55:55.238 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:55:55.239 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-06T02:55:55.239 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-06T02:55:55.239 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:55:55.383 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default/ 2023-10-06T02:55:55.384 INFO:teuthology.task.install.deb:Package version is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:55:55.398 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default/ 2023-10-06T02:55:55.399 INFO:teuthology.task.install.deb:Package version is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:55:55.454 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default/ 2023-10-06T02:55:55.454 INFO:teuthology.task.install.deb:Package version is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:55:55.459 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default/ 2023-10-06T02:55:55.459 INFO:teuthology.task.install.deb:Package version is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:55:55.468 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default/ 2023-10-06T02:55:55.469 INFO:teuthology.task.install.deb:Package version is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:55:55.567 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T02:55:55.567 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-06T02:55:55.569 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T02:55:55.569 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-06T02:55:55.572 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:55:55.572 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-06T02:55:55.585 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:55:55.585 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-06T02:55:55.586 DEBUG:teuthology.orchestra.run.smithi124:> sudo apt-get update 2023-10-06T02:55:55.588 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-get update 2023-10-06T02:55:55.590 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2023-10-06T02:55:55.602 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get update 2023-10-06T02:55:55.623 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T02:55:55.623 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-06T02:55:55.640 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get update 2023-10-06T02:55:55.725 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:55:55.735 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T02:55:55.755 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T02:55:55.780 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:55:55.782 INFO:teuthology.orchestra.run.smithi124.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal InRelease 2023-10-06T02:55:55.788 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T02:55:55.795 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:55:55.795 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T02:55:55.803 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T02:55:55.805 INFO:teuthology.orchestra.run.smithi124.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-06T02:55:55.808 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T02:55:55.823 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T02:55:55.827 INFO:teuthology.orchestra.run.smithi174.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal InRelease 2023-10-06T02:55:55.827 INFO:teuthology.orchestra.run.smithi124.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release.gpg 2023-10-06T02:55:55.835 INFO:teuthology.orchestra.run.smithi027.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal InRelease 2023-10-06T02:55:55.844 INFO:teuthology.orchestra.run.smithi158.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal InRelease 2023-10-06T02:55:55.848 INFO:teuthology.orchestra.run.smithi123.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal InRelease 2023-10-06T02:55:55.848 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-06T02:55:55.849 INFO:teuthology.orchestra.run.smithi124.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-06T02:55:55.857 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:55:55.857 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-06T02:55:55.859 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T02:55:55.870 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-06T02:55:55.871 INFO:teuthology.orchestra.run.smithi174.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release.gpg 2023-10-06T02:55:55.876 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:8 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T02:55:55.880 INFO:teuthology.orchestra.run.smithi027.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release.gpg 2023-10-06T02:55:55.881 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-06T02:55:55.893 INFO:teuthology.orchestra.run.smithi123.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release.gpg 2023-10-06T02:55:55.893 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T02:55:55.893 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-06T02:55:55.897 INFO:teuthology.orchestra.run.smithi124.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main i386 Packages [3,380 B] 2023-10-06T02:55:55.910 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T02:55:55.910 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:55:55.911 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main i386 Packages [3,380 B] 2023-10-06T02:55:55.914 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-06T02:55:55.918 INFO:teuthology.orchestra.run.smithi158.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release.gpg 2023-10-06T02:55:55.927 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T02:55:55.929 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main i386 Packages [3,380 B] 2023-10-06T02:55:55.950 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main i386 Packages [3,380 B] 2023-10-06T02:55:55.954 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-06T02:55:55.955 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-06T02:55:55.980 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T02:55:56.009 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T02:55:56.020 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main i386 Packages [3,380 B] 2023-10-06T02:55:56.061 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T02:55:56.378 INFO:teuthology.orchestra.run.smithi124.stdout:Fetched 28.4 kB in 1s (45.2 kB/s) 2023-10-06T02:55:56.419 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 28.4 kB in 1s (45.5 kB/s) 2023-10-06T02:55:56.434 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 28.4 kB in 1s (45.6 kB/s) 2023-10-06T02:55:56.510 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 28.4 kB in 1s (37.4 kB/s) 2023-10-06T02:55:56.569 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 28.4 kB in 1s (36.7 kB/s) 2023-10-06T02:55:57.409 INFO:teuthology.orchestra.run.smithi124.stdout:Reading package lists... 2023-10-06T02:55:57.434 DEBUG:teuthology.orchestra.run.smithi124:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1296-g736ac5ba-1focal cephadm=17.2.6-1296-g736ac5ba-1focal ceph-mds=17.2.6-1296-g736ac5ba-1focal ceph-mgr=17.2.6-1296-g736ac5ba-1focal ceph-common=17.2.6-1296-g736ac5ba-1focal ceph-fuse=17.2.6-1296-g736ac5ba-1focal ceph-test=17.2.6-1296-g736ac5ba-1focal ceph-volume=17.2.6-1296-g736ac5ba-1focal radosgw=17.2.6-1296-g736ac5ba-1focal python3-rados=17.2.6-1296-g736ac5ba-1focal python3-rgw=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal python3-rbd=17.2.6-1296-g736ac5ba-1focal libcephfs2=17.2.6-1296-g736ac5ba-1focal libcephfs-dev=17.2.6-1296-g736ac5ba-1focal librados2=17.2.6-1296-g736ac5ba-1focal librbd1=17.2.6-1296-g736ac5ba-1focal rbd-fuse=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal cephfs-shell=17.2.6-1296-g736ac5ba-1focal cephfs-top=17.2.6-1296-g736ac5ba-1focal cephfs-mirror=17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:55:57.451 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2023-10-06T02:55:57.460 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2023-10-06T02:55:57.475 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1296-g736ac5ba-1focal cephadm=17.2.6-1296-g736ac5ba-1focal ceph-mds=17.2.6-1296-g736ac5ba-1focal ceph-mgr=17.2.6-1296-g736ac5ba-1focal ceph-common=17.2.6-1296-g736ac5ba-1focal ceph-fuse=17.2.6-1296-g736ac5ba-1focal ceph-test=17.2.6-1296-g736ac5ba-1focal ceph-volume=17.2.6-1296-g736ac5ba-1focal radosgw=17.2.6-1296-g736ac5ba-1focal python3-rados=17.2.6-1296-g736ac5ba-1focal python3-rgw=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal python3-rbd=17.2.6-1296-g736ac5ba-1focal libcephfs2=17.2.6-1296-g736ac5ba-1focal libcephfs-dev=17.2.6-1296-g736ac5ba-1focal librados2=17.2.6-1296-g736ac5ba-1focal librbd1=17.2.6-1296-g736ac5ba-1focal rbd-fuse=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal cephfs-shell=17.2.6-1296-g736ac5ba-1focal cephfs-top=17.2.6-1296-g736ac5ba-1focal cephfs-mirror=17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:55:57.486 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1296-g736ac5ba-1focal cephadm=17.2.6-1296-g736ac5ba-1focal ceph-mds=17.2.6-1296-g736ac5ba-1focal ceph-mgr=17.2.6-1296-g736ac5ba-1focal ceph-common=17.2.6-1296-g736ac5ba-1focal ceph-fuse=17.2.6-1296-g736ac5ba-1focal ceph-test=17.2.6-1296-g736ac5ba-1focal ceph-volume=17.2.6-1296-g736ac5ba-1focal radosgw=17.2.6-1296-g736ac5ba-1focal python3-rados=17.2.6-1296-g736ac5ba-1focal python3-rgw=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal python3-rbd=17.2.6-1296-g736ac5ba-1focal libcephfs2=17.2.6-1296-g736ac5ba-1focal libcephfs-dev=17.2.6-1296-g736ac5ba-1focal librados2=17.2.6-1296-g736ac5ba-1focal librbd1=17.2.6-1296-g736ac5ba-1focal rbd-fuse=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal cephfs-shell=17.2.6-1296-g736ac5ba-1focal cephfs-top=17.2.6-1296-g736ac5ba-1focal cephfs-mirror=17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:55:57.502 INFO:teuthology.orchestra.run.smithi124.stdout:Reading package lists... 2023-10-06T02:55:57.542 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2023-10-06T02:55:57.546 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2023-10-06T02:55:57.558 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2023-10-06T02:55:57.572 DEBUG:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1296-g736ac5ba-1focal cephadm=17.2.6-1296-g736ac5ba-1focal ceph-mds=17.2.6-1296-g736ac5ba-1focal ceph-mgr=17.2.6-1296-g736ac5ba-1focal ceph-common=17.2.6-1296-g736ac5ba-1focal ceph-fuse=17.2.6-1296-g736ac5ba-1focal ceph-test=17.2.6-1296-g736ac5ba-1focal ceph-volume=17.2.6-1296-g736ac5ba-1focal radosgw=17.2.6-1296-g736ac5ba-1focal python3-rados=17.2.6-1296-g736ac5ba-1focal python3-rgw=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal python3-rbd=17.2.6-1296-g736ac5ba-1focal libcephfs2=17.2.6-1296-g736ac5ba-1focal libcephfs-dev=17.2.6-1296-g736ac5ba-1focal librados2=17.2.6-1296-g736ac5ba-1focal librbd1=17.2.6-1296-g736ac5ba-1focal rbd-fuse=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal cephfs-shell=17.2.6-1296-g736ac5ba-1focal cephfs-top=17.2.6-1296-g736ac5ba-1focal cephfs-mirror=17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:55:57.640 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2023-10-06T02:55:57.641 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-06T02:55:57.667 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1296-g736ac5ba-1focal cephadm=17.2.6-1296-g736ac5ba-1focal ceph-mds=17.2.6-1296-g736ac5ba-1focal ceph-mgr=17.2.6-1296-g736ac5ba-1focal ceph-common=17.2.6-1296-g736ac5ba-1focal ceph-fuse=17.2.6-1296-g736ac5ba-1focal ceph-test=17.2.6-1296-g736ac5ba-1focal ceph-volume=17.2.6-1296-g736ac5ba-1focal radosgw=17.2.6-1296-g736ac5ba-1focal python3-rados=17.2.6-1296-g736ac5ba-1focal python3-rgw=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal python3-rbd=17.2.6-1296-g736ac5ba-1focal libcephfs2=17.2.6-1296-g736ac5ba-1focal libcephfs-dev=17.2.6-1296-g736ac5ba-1focal librados2=17.2.6-1296-g736ac5ba-1focal librbd1=17.2.6-1296-g736ac5ba-1focal rbd-fuse=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal cephfs-shell=17.2.6-1296-g736ac5ba-1focal cephfs-top=17.2.6-1296-g736ac5ba-1focal cephfs-mirror=17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:55:57.704 INFO:teuthology.orchestra.run.smithi124.stdout:Building dependency tree... 2023-10-06T02:55:57.705 INFO:teuthology.orchestra.run.smithi124.stdout:Reading state information... 2023-10-06T02:55:57.736 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-06T02:55:57.747 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2023-10-06T02:55:57.748 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2023-10-06T02:55:57.749 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2023-10-06T02:55:57.750 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2023-10-06T02:55:57.840 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2023-10-06T02:55:57.840 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2023-10-06T02:55:57.883 INFO:teuthology.orchestra.run.smithi124.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:55:57.888 INFO:teuthology.orchestra.run.smithi124.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:55:57.888 INFO:teuthology.orchestra.run.smithi124.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:55:57.889 INFO:teuthology.orchestra.run.smithi124.stdout:The following additional packages will be installed: 2023-10-06T02:55:57.889 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-06T02:55:57.889 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-06T02:55:57.889 INFO:teuthology.orchestra.run.smithi124.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-06T02:55:57.889 INFO:teuthology.orchestra.run.smithi124.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-06T02:55:57.889 INFO:teuthology.orchestra.run.smithi124.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-06T02:55:57.890 INFO:teuthology.orchestra.run.smithi124.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-06T02:55:57.890 INFO:teuthology.orchestra.run.smithi124.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-06T02:55:57.890 INFO:teuthology.orchestra.run.smithi124.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:55:57.890 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-06T02:55:57.890 INFO:teuthology.orchestra.run.smithi124.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-06T02:55:57.891 INFO:teuthology.orchestra.run.smithi124.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-06T02:55:57.891 INFO:teuthology.orchestra.run.smithi124.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:55:57.891 INFO:teuthology.orchestra.run.smithi124.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:55:57.891 INFO:teuthology.orchestra.run.smithi124.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:55:57.891 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:55:57.891 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:55:57.892 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-06T02:55:57.892 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:55:57.892 INFO:teuthology.orchestra.run.smithi124.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:55:57.892 INFO:teuthology.orchestra.run.smithi124.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:55:57.892 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:55:57.892 INFO:teuthology.orchestra.run.smithi124.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-06T02:55:57.893 INFO:teuthology.orchestra.run.smithi124.stdout:Suggested packages: 2023-10-06T02:55:57.893 INFO:teuthology.orchestra.run.smithi124.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-06T02:55:57.893 INFO:teuthology.orchestra.run.smithi124.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-06T02:55:57.893 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-06T02:55:57.893 INFO:teuthology.orchestra.run.smithi124.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-06T02:55:57.893 INFO:teuthology.orchestra.run.smithi124.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-06T02:55:57.894 INFO:teuthology.orchestra.run.smithi124.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-06T02:55:57.894 INFO:teuthology.orchestra.run.smithi124.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-06T02:55:57.894 INFO:teuthology.orchestra.run.smithi124.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-06T02:55:57.894 INFO:teuthology.orchestra.run.smithi124.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-06T02:55:57.894 INFO:teuthology.orchestra.run.smithi124.stdout:Recommended packages: 2023-10-06T02:55:57.894 INFO:teuthology.orchestra.run.smithi124.stdout: btrfs-tools 2023-10-06T02:55:57.916 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:55:57.917 INFO:teuthology.orchestra.run.smithi123.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:55:57.917 INFO:teuthology.orchestra.run.smithi123.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:55:57.917 INFO:teuthology.orchestra.run.smithi123.stdout:The following additional packages will be installed: 2023-10-06T02:55:57.918 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-06T02:55:57.918 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-06T02:55:57.918 INFO:teuthology.orchestra.run.smithi123.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-06T02:55:57.919 INFO:teuthology.orchestra.run.smithi123.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-06T02:55:57.919 INFO:teuthology.orchestra.run.smithi123.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-06T02:55:57.919 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-06T02:55:57.920 INFO:teuthology.orchestra.run.smithi123.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-06T02:55:57.920 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:55:57.920 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-06T02:55:57.920 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-06T02:55:57.920 INFO:teuthology.orchestra.run.smithi123.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-06T02:55:57.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:55:57.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:55:57.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:55:57.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:55:57.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:55:57.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-06T02:55:57.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:55:57.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:55:57.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:55:57.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:55:57.922 INFO:teuthology.orchestra.run.smithi123.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-06T02:55:57.923 INFO:teuthology.orchestra.run.smithi123.stdout:Suggested packages: 2023-10-06T02:55:57.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-06T02:55:57.923 INFO:teuthology.orchestra.run.smithi123.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-06T02:55:57.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-06T02:55:57.924 INFO:teuthology.orchestra.run.smithi123.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-06T02:55:57.924 INFO:teuthology.orchestra.run.smithi123.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-06T02:55:57.924 INFO:teuthology.orchestra.run.smithi123.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-06T02:55:57.924 INFO:teuthology.orchestra.run.smithi123.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-06T02:55:57.924 INFO:teuthology.orchestra.run.smithi123.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-06T02:55:57.925 INFO:teuthology.orchestra.run.smithi123.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-06T02:55:57.925 INFO:teuthology.orchestra.run.smithi123.stdout:Recommended packages: 2023-10-06T02:55:57.925 INFO:teuthology.orchestra.run.smithi123.stdout: btrfs-tools 2023-10-06T02:55:57.936 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:55:57.937 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:55:57.937 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:55:57.938 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2023-10-06T02:55:57.938 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-06T02:55:57.938 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-06T02:55:57.938 INFO:teuthology.orchestra.run.smithi174.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-06T02:55:57.938 INFO:teuthology.orchestra.run.smithi174.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-06T02:55:57.938 INFO:teuthology.orchestra.run.smithi174.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-06T02:55:57.940 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-06T02:55:57.940 INFO:teuthology.orchestra.run.smithi174.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-06T02:55:57.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:55:57.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-06T02:55:57.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-06T02:55:57.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-06T02:55:57.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:55:57.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:55:57.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:55:57.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:55:57.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:55:57.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-06T02:55:57.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:55:57.942 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:55:57.942 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:55:57.942 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:55:57.942 INFO:teuthology.orchestra.run.smithi174.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-06T02:55:57.942 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2023-10-06T02:55:57.942 INFO:teuthology.orchestra.run.smithi174.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-06T02:55:57.942 INFO:teuthology.orchestra.run.smithi174.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-06T02:55:57.942 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-06T02:55:57.942 INFO:teuthology.orchestra.run.smithi174.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-06T02:55:57.943 INFO:teuthology.orchestra.run.smithi174.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-06T02:55:57.943 INFO:teuthology.orchestra.run.smithi174.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-06T02:55:57.943 INFO:teuthology.orchestra.run.smithi174.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-06T02:55:57.943 INFO:teuthology.orchestra.run.smithi174.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-06T02:55:57.943 INFO:teuthology.orchestra.run.smithi174.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-06T02:55:57.943 INFO:teuthology.orchestra.run.smithi174.stdout:Recommended packages: 2023-10-06T02:55:57.943 INFO:teuthology.orchestra.run.smithi174.stdout: btrfs-tools 2023-10-06T02:55:57.944 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2023-10-06T02:55:57.944 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2023-10-06T02:55:58.006 INFO:teuthology.orchestra.run.smithi124.stdout:The following NEW packages will be installed: 2023-10-06T02:55:58.006 INFO:teuthology.orchestra.run.smithi124.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-06T02:55:58.006 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-06T02:55:58.006 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-06T02:55:58.006 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-06T02:55:58.007 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-06T02:55:58.007 INFO:teuthology.orchestra.run.smithi124.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-06T02:55:58.007 INFO:teuthology.orchestra.run.smithi124.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-06T02:55:58.008 INFO:teuthology.orchestra.run.smithi124.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-06T02:55:58.009 INFO:teuthology.orchestra.run.smithi124.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-06T02:55:58.009 INFO:teuthology.orchestra.run.smithi124.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:55:58.009 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-06T02:55:58.009 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-06T02:55:58.009 INFO:teuthology.orchestra.run.smithi124.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-06T02:55:58.009 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:55:58.009 INFO:teuthology.orchestra.run.smithi124.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:55:58.009 INFO:teuthology.orchestra.run.smithi124.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:55:58.009 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:55:58.009 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:55:58.009 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-06T02:55:58.010 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-06T02:55:58.010 INFO:teuthology.orchestra.run.smithi124.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:55:58.010 INFO:teuthology.orchestra.run.smithi124.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:55:58.010 INFO:teuthology.orchestra.run.smithi124.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:55:58.010 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:55:58.010 INFO:teuthology.orchestra.run.smithi124.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-06T02:55:58.010 INFO:teuthology.orchestra.run.smithi124.stdout:The following packages will be upgraded: 2023-10-06T02:55:58.010 INFO:teuthology.orchestra.run.smithi124.stdout: librados2 librbd1 2023-10-06T02:55:58.021 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:55:58.022 INFO:teuthology.orchestra.run.smithi158.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:55:58.022 INFO:teuthology.orchestra.run.smithi158.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:55:58.022 INFO:teuthology.orchestra.run.smithi158.stdout:The following additional packages will be installed: 2023-10-06T02:55:58.022 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-06T02:55:58.022 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-06T02:55:58.022 INFO:teuthology.orchestra.run.smithi158.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-06T02:55:58.022 INFO:teuthology.orchestra.run.smithi158.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-06T02:55:58.022 INFO:teuthology.orchestra.run.smithi158.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-06T02:55:58.023 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-06T02:55:58.023 INFO:teuthology.orchestra.run.smithi158.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-06T02:55:58.024 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:55:58.024 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-06T02:55:58.024 INFO:teuthology.orchestra.run.smithi158.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-06T02:55:58.024 INFO:teuthology.orchestra.run.smithi158.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-06T02:55:58.024 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:55:58.024 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:55:58.024 INFO:teuthology.orchestra.run.smithi158.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:55:58.024 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:55:58.025 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:55:58.025 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-06T02:55:58.025 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:55:58.025 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:55:58.025 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:55:58.025 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:55:58.025 INFO:teuthology.orchestra.run.smithi158.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-06T02:55:58.025 INFO:teuthology.orchestra.run.smithi158.stdout:Suggested packages: 2023-10-06T02:55:58.026 INFO:teuthology.orchestra.run.smithi158.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-06T02:55:58.026 INFO:teuthology.orchestra.run.smithi158.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-06T02:55:58.026 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-06T02:55:58.026 INFO:teuthology.orchestra.run.smithi158.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-06T02:55:58.026 INFO:teuthology.orchestra.run.smithi158.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-06T02:55:58.026 INFO:teuthology.orchestra.run.smithi158.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-06T02:55:58.026 INFO:teuthology.orchestra.run.smithi158.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-06T02:55:58.026 INFO:teuthology.orchestra.run.smithi158.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-06T02:55:58.026 INFO:teuthology.orchestra.run.smithi158.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-06T02:55:58.026 INFO:teuthology.orchestra.run.smithi158.stdout:Recommended packages: 2023-10-06T02:55:58.027 INFO:teuthology.orchestra.run.smithi158.stdout: btrfs-tools 2023-10-06T02:55:58.041 INFO:teuthology.orchestra.run.smithi123.stdout:The following NEW packages will be installed: 2023-10-06T02:55:58.041 INFO:teuthology.orchestra.run.smithi123.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-06T02:55:58.041 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-06T02:55:58.042 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-06T02:55:58.042 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-06T02:55:58.042 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-06T02:55:58.042 INFO:teuthology.orchestra.run.smithi123.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-06T02:55:58.042 INFO:teuthology.orchestra.run.smithi123.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-06T02:55:58.042 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-06T02:55:58.042 INFO:teuthology.orchestra.run.smithi123.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-06T02:55:58.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:55:58.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-06T02:55:58.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-06T02:55:58.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-06T02:55:58.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:55:58.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:55:58.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:55:58.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:55:58.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:55:58.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-06T02:55:58.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-06T02:55:58.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:55:58.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:55:58.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:55:58.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:55:58.044 INFO:teuthology.orchestra.run.smithi123.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-06T02:55:58.044 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages will be upgraded: 2023-10-06T02:55:58.045 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 librbd1 2023-10-06T02:55:58.065 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2023-10-06T02:55:58.065 INFO:teuthology.orchestra.run.smithi174.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-06T02:55:58.065 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-06T02:55:58.065 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-06T02:55:58.065 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-06T02:55:58.066 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-06T02:55:58.066 INFO:teuthology.orchestra.run.smithi174.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-06T02:55:58.066 INFO:teuthology.orchestra.run.smithi174.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-06T02:55:58.067 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-06T02:55:58.067 INFO:teuthology.orchestra.run.smithi174.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-06T02:55:58.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:55:58.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-06T02:55:58.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-06T02:55:58.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-06T02:55:58.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:55:58.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:55:58.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:55:58.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:55:58.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:55:58.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-06T02:55:58.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-06T02:55:58.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:55:58.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:55:58.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:55:58.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:55:58.069 INFO:teuthology.orchestra.run.smithi174.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-06T02:55:58.069 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages will be upgraded: 2023-10-06T02:55:58.069 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 librbd1 2023-10-06T02:55:58.078 INFO:teuthology.orchestra.run.smithi124.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-06T02:55:58.078 INFO:teuthology.orchestra.run.smithi124.stdout:Need to get 210 MB of archives. 2023-10-06T02:55:58.078 INFO:teuthology.orchestra.run.smithi124.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-06T02:55:58.078 INFO:teuthology.orchestra.run.smithi124.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-06T02:55:58.100 INFO:teuthology.orchestra.run.smithi124.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-06T02:55:58.108 INFO:teuthology.orchestra.run.smithi124.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-06T02:55:58.111 INFO:teuthology.orchestra.run.smithi123.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-06T02:55:58.111 INFO:teuthology.orchestra.run.smithi123.stdout:Need to get 210 MB of archives. 2023-10-06T02:55:58.112 INFO:teuthology.orchestra.run.smithi123.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-06T02:55:58.112 INFO:teuthology.orchestra.run.smithi123.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-06T02:55:58.133 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-06T02:55:58.138 INFO:teuthology.orchestra.run.smithi124.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-06T02:55:58.138 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:55:58.140 INFO:teuthology.orchestra.run.smithi027.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:55:58.140 INFO:teuthology.orchestra.run.smithi027.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:55:58.140 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2023-10-06T02:55:58.140 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-06T02:55:58.140 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-06T02:55:58.140 INFO:teuthology.orchestra.run.smithi027.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-06T02:55:58.140 INFO:teuthology.orchestra.run.smithi027.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-06T02:55:58.140 INFO:teuthology.orchestra.run.smithi027.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-06T02:55:58.141 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-06T02:55:58.141 INFO:teuthology.orchestra.run.smithi027.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-06T02:55:58.141 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:55:58.141 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-06T02:55:58.141 INFO:teuthology.orchestra.run.smithi027.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-06T02:55:58.142 INFO:teuthology.orchestra.run.smithi027.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-06T02:55:58.142 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:55:58.142 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:55:58.142 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:55:58.142 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:55:58.142 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:55:58.142 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-06T02:55:58.142 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:55:58.142 INFO:teuthology.orchestra.run.smithi027.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:55:58.142 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:55:58.143 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:55:58.143 INFO:teuthology.orchestra.run.smithi027.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-06T02:55:58.143 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-06T02:55:58.143 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2023-10-06T02:55:58.143 INFO:teuthology.orchestra.run.smithi027.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-06T02:55:58.144 INFO:teuthology.orchestra.run.smithi027.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-06T02:55:58.144 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-06T02:55:58.144 INFO:teuthology.orchestra.run.smithi027.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-06T02:55:58.144 INFO:teuthology.orchestra.run.smithi027.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-06T02:55:58.144 INFO:teuthology.orchestra.run.smithi027.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-06T02:55:58.144 INFO:teuthology.orchestra.run.smithi027.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-06T02:55:58.144 INFO:teuthology.orchestra.run.smithi027.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-06T02:55:58.144 INFO:teuthology.orchestra.run.smithi027.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-06T02:55:58.144 INFO:teuthology.orchestra.run.smithi027.stdout:Recommended packages: 2023-10-06T02:55:58.144 INFO:teuthology.orchestra.run.smithi027.stdout: btrfs-tools 2023-10-06T02:55:58.146 INFO:teuthology.orchestra.run.smithi158.stdout:The following NEW packages will be installed: 2023-10-06T02:55:58.146 INFO:teuthology.orchestra.run.smithi158.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-06T02:55:58.146 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-06T02:55:58.146 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-06T02:55:58.146 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-06T02:55:58.146 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-06T02:55:58.146 INFO:teuthology.orchestra.run.smithi158.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-06T02:55:58.146 INFO:teuthology.orchestra.run.smithi158.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-06T02:55:58.147 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-06T02:55:58.147 INFO:teuthology.orchestra.run.smithi158.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-06T02:55:58.147 INFO:teuthology.orchestra.run.smithi158.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:55:58.147 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-06T02:55:58.147 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-06T02:55:58.147 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-06T02:55:58.147 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:55:58.147 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:55:58.147 INFO:teuthology.orchestra.run.smithi158.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:55:58.147 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:55:58.147 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:55:58.148 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-06T02:55:58.148 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-06T02:55:58.148 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:55:58.148 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:55:58.148 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:55:58.148 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:55:58.148 INFO:teuthology.orchestra.run.smithi158.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-06T02:55:58.149 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages will be upgraded: 2023-10-06T02:55:58.149 INFO:teuthology.orchestra.run.smithi158.stdout: librados2 librbd1 2023-10-06T02:55:58.172 INFO:teuthology.orchestra.run.smithi124.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-06T02:55:58.172 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-06T02:55:58.174 INFO:teuthology.orchestra.run.smithi124.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-06T02:55:58.185 INFO:teuthology.orchestra.run.smithi124.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-06T02:55:58.188 INFO:teuthology.orchestra.run.smithi124.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-06T02:55:58.205 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-06T02:55:58.208 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-06T02:55:58.208 INFO:teuthology.orchestra.run.smithi124.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-06T02:55:58.209 INFO:teuthology.orchestra.run.smithi124.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-06T02:55:58.213 INFO:teuthology.orchestra.run.smithi158.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-06T02:55:58.214 INFO:teuthology.orchestra.run.smithi158.stdout:Need to get 210 MB of archives. 2023-10-06T02:55:58.214 INFO:teuthology.orchestra.run.smithi158.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-06T02:55:58.214 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-06T02:55:58.215 INFO:teuthology.orchestra.run.smithi124.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-06T02:55:58.216 INFO:teuthology.orchestra.run.smithi174.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-06T02:55:58.216 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 210 MB of archives. 2023-10-06T02:55:58.216 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-06T02:55:58.216 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1296-g736ac5ba-1focal [3,501 kB] 2023-10-06T02:55:58.232 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-06T02:55:58.235 INFO:teuthology.orchestra.run.smithi124.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1296-g736ac5ba-1focal [3,501 kB] 2023-10-06T02:55:58.238 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-06T02:55:58.239 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-06T02:55:58.241 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-06T02:55:58.246 INFO:teuthology.orchestra.run.smithi124.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-06T02:55:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-06T02:55:58.248 INFO:teuthology.orchestra.run.smithi124.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-06T02:55:58.249 INFO:teuthology.orchestra.run.smithi123.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-06T02:55:58.255 INFO:teuthology.orchestra.run.smithi124.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-06T02:55:58.257 INFO:teuthology.orchestra.run.smithi124.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-06T02:55:58.258 INFO:teuthology.orchestra.run.smithi124.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-06T02:55:58.259 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-06T02:55:58.260 INFO:teuthology.orchestra.run.smithi124.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-06T02:55:58.260 INFO:teuthology.orchestra.run.smithi124.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-06T02:55:58.260 INFO:teuthology.orchestra.run.smithi124.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-06T02:55:58.262 INFO:teuthology.orchestra.run.smithi124.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-06T02:55:58.263 INFO:teuthology.orchestra.run.smithi123.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-06T02:55:58.266 INFO:teuthology.orchestra.run.smithi123.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1296-g736ac5ba-1focal [3,501 kB] 2023-10-06T02:55:58.267 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-06T02:55:58.268 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2023-10-06T02:55:58.269 INFO:teuthology.orchestra.run.smithi027.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-06T02:55:58.269 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-06T02:55:58.269 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-06T02:55:58.270 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-06T02:55:58.270 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-06T02:55:58.270 INFO:teuthology.orchestra.run.smithi027.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-06T02:55:58.270 INFO:teuthology.orchestra.run.smithi027.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-06T02:55:58.270 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi027.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi027.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi027.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi027.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages will be upgraded: 2023-10-06T02:55:58.273 INFO:teuthology.orchestra.run.smithi027.stdout: librados2 librbd1 2023-10-06T02:55:58.274 INFO:teuthology.orchestra.run.smithi124.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-06T02:55:58.274 INFO:teuthology.orchestra.run.smithi124.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-06T02:55:58.294 INFO:teuthology.orchestra.run.smithi124.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-06T02:55:58.294 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1296-g736ac5ba-1focal [3,501 kB] 2023-10-06T02:55:58.295 INFO:teuthology.orchestra.run.smithi124.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-06T02:55:58.295 INFO:teuthology.orchestra.run.smithi124.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-06T02:55:58.296 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-06T02:55:58.296 INFO:teuthology.orchestra.run.smithi124.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-06T02:55:58.296 INFO:teuthology.orchestra.run.smithi124.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-06T02:55:58.297 INFO:teuthology.orchestra.run.smithi124.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-06T02:55:58.298 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-06T02:55:58.298 INFO:teuthology.orchestra.run.smithi124.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-06T02:55:58.299 INFO:teuthology.orchestra.run.smithi124.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-06T02:55:58.307 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-06T02:55:58.310 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-06T02:55:58.314 INFO:teuthology.orchestra.run.smithi124.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-06T02:55:58.314 INFO:teuthology.orchestra.run.smithi124.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-06T02:55:58.327 INFO:teuthology.orchestra.run.smithi158.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-06T02:55:58.328 INFO:teuthology.orchestra.run.smithi158.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-06T02:55:58.333 INFO:teuthology.orchestra.run.smithi124.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-06T02:55:58.333 INFO:teuthology.orchestra.run.smithi158.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-06T02:55:58.334 INFO:teuthology.orchestra.run.smithi124.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-06T02:55:58.334 INFO:teuthology.orchestra.run.smithi124.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-06T02:55:58.334 INFO:teuthology.orchestra.run.smithi027.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-06T02:55:58.334 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 210 MB of archives. 2023-10-06T02:55:58.335 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-06T02:55:58.335 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-06T02:55:58.335 INFO:teuthology.orchestra.run.smithi124.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-06T02:55:58.335 INFO:teuthology.orchestra.run.smithi123.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-06T02:55:58.336 INFO:teuthology.orchestra.run.smithi124.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-06T02:55:58.337 INFO:teuthology.orchestra.run.smithi123.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-06T02:55:58.338 INFO:teuthology.orchestra.run.smithi124.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-06T02:55:58.339 INFO:teuthology.orchestra.run.smithi124.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-06T02:55:58.339 INFO:teuthology.orchestra.run.smithi124.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-06T02:55:58.343 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-06T02:55:58.343 INFO:teuthology.orchestra.run.smithi123.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-06T02:55:58.345 INFO:teuthology.orchestra.run.smithi123.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-06T02:55:58.345 INFO:teuthology.orchestra.run.smithi123.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-06T02:55:58.347 INFO:teuthology.orchestra.run.smithi123.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-06T02:55:58.348 INFO:teuthology.orchestra.run.smithi123.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-06T02:55:58.348 INFO:teuthology.orchestra.run.smithi123.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-06T02:55:58.350 INFO:teuthology.orchestra.run.smithi123.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-06T02:55:58.352 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-06T02:55:58.353 INFO:teuthology.orchestra.run.smithi124.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-06T02:55:58.354 INFO:teuthology.orchestra.run.smithi124.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-06T02:55:58.355 INFO:teuthology.orchestra.run.smithi123.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-06T02:55:58.361 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-06T02:55:58.361 INFO:teuthology.orchestra.run.smithi158.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-06T02:55:58.362 INFO:teuthology.orchestra.run.smithi158.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-06T02:55:58.368 INFO:teuthology.orchestra.run.smithi158.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-06T02:55:58.370 INFO:teuthology.orchestra.run.smithi158.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-06T02:55:58.370 INFO:teuthology.orchestra.run.smithi123.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-06T02:55:58.370 INFO:teuthology.orchestra.run.smithi158.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-06T02:55:58.372 INFO:teuthology.orchestra.run.smithi123.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-06T02:55:58.372 INFO:teuthology.orchestra.run.smithi158.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-06T02:55:58.373 INFO:teuthology.orchestra.run.smithi123.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-06T02:55:58.373 INFO:teuthology.orchestra.run.smithi158.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-06T02:55:58.374 INFO:teuthology.orchestra.run.smithi158.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-06T02:55:58.374 INFO:teuthology.orchestra.run.smithi124.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-06T02:55:58.374 INFO:teuthology.orchestra.run.smithi124.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-06T02:55:58.375 INFO:teuthology.orchestra.run.smithi124.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-06T02:55:58.375 INFO:teuthology.orchestra.run.smithi158.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-06T02:55:58.376 INFO:teuthology.orchestra.run.smithi123.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-06T02:55:58.376 INFO:teuthology.orchestra.run.smithi123.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-06T02:55:58.376 INFO:teuthology.orchestra.run.smithi123.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-06T02:55:58.376 INFO:teuthology.orchestra.run.smithi123.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-06T02:55:58.377 INFO:teuthology.orchestra.run.smithi123.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-06T02:55:58.377 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-06T02:55:58.380 INFO:teuthology.orchestra.run.smithi123.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-06T02:55:58.383 INFO:teuthology.orchestra.run.smithi158.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-06T02:55:58.384 INFO:teuthology.orchestra.run.smithi158.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-06T02:55:58.385 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-06T02:55:58.400 INFO:teuthology.orchestra.run.smithi158.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-06T02:55:58.401 INFO:teuthology.orchestra.run.smithi158.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-06T02:55:58.401 INFO:teuthology.orchestra.run.smithi158.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-06T02:55:58.402 INFO:teuthology.orchestra.run.smithi158.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-06T02:55:58.402 INFO:teuthology.orchestra.run.smithi158.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-06T02:55:58.403 INFO:teuthology.orchestra.run.smithi158.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-06T02:55:58.404 INFO:teuthology.orchestra.run.smithi123.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-06T02:55:58.404 INFO:teuthology.orchestra.run.smithi158.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-06T02:55:58.405 INFO:teuthology.orchestra.run.smithi123.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-06T02:55:58.405 INFO:teuthology.orchestra.run.smithi158.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-06T02:55:58.412 INFO:teuthology.orchestra.run.smithi123.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-06T02:55:58.413 INFO:teuthology.orchestra.run.smithi123.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-06T02:55:58.414 INFO:teuthology.orchestra.run.smithi123.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-06T02:55:58.414 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-06T02:55:58.414 INFO:teuthology.orchestra.run.smithi123.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-06T02:55:58.416 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-06T02:55:58.416 INFO:teuthology.orchestra.run.smithi123.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-06T02:55:58.417 INFO:teuthology.orchestra.run.smithi158.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-06T02:55:58.417 INFO:teuthology.orchestra.run.smithi158.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-06T02:55:58.420 INFO:teuthology.orchestra.run.smithi123.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-06T02:55:58.421 INFO:teuthology.orchestra.run.smithi123.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-06T02:55:58.425 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-06T02:55:58.428 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-06T02:55:58.434 INFO:teuthology.orchestra.run.smithi158.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-06T02:55:58.434 INFO:teuthology.orchestra.run.smithi158.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-06T02:55:58.435 INFO:teuthology.orchestra.run.smithi158.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-06T02:55:58.436 INFO:teuthology.orchestra.run.smithi158.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-06T02:55:58.438 INFO:teuthology.orchestra.run.smithi158.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-06T02:55:58.441 INFO:teuthology.orchestra.run.smithi158.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-06T02:55:58.442 INFO:teuthology.orchestra.run.smithi123.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-06T02:55:58.443 INFO:teuthology.orchestra.run.smithi158.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-06T02:55:58.444 INFO:teuthology.orchestra.run.smithi158.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-06T02:55:58.445 INFO:teuthology.orchestra.run.smithi123.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-06T02:55:58.445 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-06T02:55:58.447 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-06T02:55:58.451 INFO:teuthology.orchestra.run.smithi158.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-06T02:55:58.451 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-06T02:55:58.452 INFO:teuthology.orchestra.run.smithi158.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-06T02:55:58.461 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1296-g736ac5ba-1focal [3,554 kB] 2023-10-06T02:55:58.468 INFO:teuthology.orchestra.run.smithi158.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-06T02:55:58.468 INFO:teuthology.orchestra.run.smithi158.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-06T02:55:58.469 INFO:teuthology.orchestra.run.smithi158.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-06T02:55:58.470 INFO:teuthology.orchestra.run.smithi123.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-06T02:55:58.473 INFO:teuthology.orchestra.run.smithi123.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-06T02:55:58.474 INFO:teuthology.orchestra.run.smithi123.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-06T02:55:58.475 INFO:teuthology.orchestra.run.smithi123.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-06T02:55:58.484 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-06T02:55:58.487 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-06T02:55:58.493 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-06T02:55:58.494 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-06T02:55:58.495 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-06T02:55:58.497 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-06T02:55:58.497 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-06T02:55:58.498 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-06T02:55:58.499 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-06T02:55:58.500 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-06T02:55:58.502 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-06T02:55:58.513 INFO:teuthology.orchestra.run.smithi124.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-06T02:55:58.516 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-06T02:55:58.517 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-06T02:55:58.517 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-06T02:55:58.518 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-06T02:55:58.519 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-06T02:55:58.519 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-06T02:55:58.521 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-06T02:55:58.521 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-06T02:55:58.522 INFO:teuthology.orchestra.run.smithi027.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-06T02:55:58.536 INFO:teuthology.orchestra.run.smithi027.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-06T02:55:58.536 INFO:teuthology.orchestra.run.smithi027.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-06T02:55:58.542 INFO:teuthology.orchestra.run.smithi027.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-06T02:55:58.547 INFO:teuthology.orchestra.run.smithi124.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-06T02:55:58.548 INFO:teuthology.orchestra.run.smithi158.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-06T02:55:58.552 INFO:teuthology.orchestra.run.smithi124.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-06T02:55:58.553 INFO:teuthology.orchestra.run.smithi027.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-06T02:55:58.554 INFO:teuthology.orchestra.run.smithi027.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-06T02:55:58.554 INFO:teuthology.orchestra.run.smithi027.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-06T02:55:58.556 INFO:teuthology.orchestra.run.smithi027.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-06T02:55:58.558 INFO:teuthology.orchestra.run.smithi027.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-06T02:55:58.559 INFO:teuthology.orchestra.run.smithi027.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-06T02:55:58.559 INFO:teuthology.orchestra.run.smithi027.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-06T02:55:58.566 INFO:teuthology.orchestra.run.smithi158.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-06T02:55:58.568 INFO:teuthology.orchestra.run.smithi158.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-06T02:55:58.570 INFO:teuthology.orchestra.run.smithi027.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-06T02:55:58.571 INFO:teuthology.orchestra.run.smithi027.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-06T02:55:58.573 INFO:teuthology.orchestra.run.smithi027.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-06T02:55:58.577 INFO:teuthology.orchestra.run.smithi124.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-06T02:55:58.578 INFO:teuthology.orchestra.run.smithi158.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-06T02:55:58.578 INFO:teuthology.orchestra.run.smithi158.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-06T02:55:58.578 INFO:teuthology.orchestra.run.smithi124.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-06T02:55:58.579 INFO:teuthology.orchestra.run.smithi124.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-06T02:55:58.583 INFO:teuthology.orchestra.run.smithi124.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-06T02:55:58.584 INFO:teuthology.orchestra.run.smithi124.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-06T02:55:58.584 INFO:teuthology.orchestra.run.smithi124.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-06T02:55:58.585 INFO:teuthology.orchestra.run.smithi124.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-06T02:55:58.587 INFO:teuthology.orchestra.run.smithi027.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-06T02:55:58.588 INFO:teuthology.orchestra.run.smithi027.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-06T02:55:58.606 INFO:teuthology.orchestra.run.smithi027.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1296-g736ac5ba-1focal [3,501 kB] 2023-10-06T02:55:58.607 INFO:teuthology.orchestra.run.smithi124.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-06T02:55:58.608 INFO:teuthology.orchestra.run.smithi124.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-06T02:55:58.627 INFO:teuthology.orchestra.run.smithi123.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-06T02:55:58.636 INFO:teuthology.orchestra.run.smithi124.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-06T02:55:58.639 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-06T02:55:58.641 INFO:teuthology.orchestra.run.smithi124.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-06T02:55:58.644 INFO:teuthology.orchestra.run.smithi124.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-06T02:55:58.647 INFO:teuthology.orchestra.run.smithi124.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-06T02:55:58.648 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-06T02:55:58.649 INFO:teuthology.orchestra.run.smithi158.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-06T02:55:58.649 INFO:teuthology.orchestra.run.smithi124.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-06T02:55:58.650 INFO:teuthology.orchestra.run.smithi158.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-06T02:55:58.651 INFO:teuthology.orchestra.run.smithi158.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-06T02:55:58.652 INFO:teuthology.orchestra.run.smithi158.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-06T02:55:58.652 INFO:teuthology.orchestra.run.smithi158.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-06T02:55:58.653 INFO:teuthology.orchestra.run.smithi124.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-06T02:55:58.654 INFO:teuthology.orchestra.run.smithi158.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-06T02:55:58.655 INFO:teuthology.orchestra.run.smithi124.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-06T02:55:58.655 INFO:teuthology.orchestra.run.smithi124.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-06T02:55:58.655 INFO:teuthology.orchestra.run.smithi158.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-06T02:55:58.656 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1296-g736ac5ba-1focal [760 kB] 2023-10-06T02:55:58.666 INFO:teuthology.orchestra.run.smithi174.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1296-g736ac5ba-1focal [413 kB] 2023-10-06T02:55:58.666 INFO:teuthology.orchestra.run.smithi158.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-06T02:55:58.669 INFO:teuthology.orchestra.run.smithi027.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-06T02:55:58.669 INFO:teuthology.orchestra.run.smithi158.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-06T02:55:58.670 INFO:teuthology.orchestra.run.smithi174.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1296-g736ac5ba-1focal [22.5 kB] 2023-10-06T02:55:58.670 INFO:teuthology.orchestra.run.smithi174.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1296-g736ac5ba-1focal [200 kB] 2023-10-06T02:55:58.671 INFO:teuthology.orchestra.run.smithi158.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-06T02:55:58.675 INFO:teuthology.orchestra.run.smithi174.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1296-g736ac5ba-1focal [47.1 kB] 2023-10-06T02:55:58.677 INFO:teuthology.orchestra.run.smithi174.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1296-g736ac5ba-1focal [386 kB] 2023-10-06T02:55:58.683 INFO:teuthology.orchestra.run.smithi158.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-06T02:55:58.683 INFO:teuthology.orchestra.run.smithi158.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-06T02:55:58.685 INFO:teuthology.orchestra.run.smithi027.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-06T02:55:58.685 INFO:teuthology.orchestra.run.smithi124.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-06T02:55:58.686 INFO:teuthology.orchestra.run.smithi158.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-06T02:55:58.687 INFO:teuthology.orchestra.run.smithi027.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-06T02:55:58.688 INFO:teuthology.orchestra.run.smithi124.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-06T02:55:58.689 INFO:teuthology.orchestra.run.smithi158.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-06T02:55:58.689 INFO:teuthology.orchestra.run.smithi158.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-06T02:55:58.693 INFO:teuthology.orchestra.run.smithi174.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1296-g736ac5ba-1focal [5,570 kB] 2023-10-06T02:55:58.693 INFO:teuthology.orchestra.run.smithi174.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-06T02:55:58.698 INFO:teuthology.orchestra.run.smithi027.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-06T02:55:58.698 INFO:teuthology.orchestra.run.smithi027.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-06T02:55:58.704 INFO:teuthology.orchestra.run.smithi123.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-06T02:55:58.705 INFO:teuthology.orchestra.run.smithi174.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-06T02:55:58.707 INFO:teuthology.orchestra.run.smithi158.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-06T02:55:58.709 INFO:teuthology.orchestra.run.smithi158.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-06T02:55:58.713 INFO:teuthology.orchestra.run.smithi123.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-06T02:55:58.742 INFO:teuthology.orchestra.run.smithi123.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-06T02:55:58.742 INFO:teuthology.orchestra.run.smithi123.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-06T02:55:58.743 INFO:teuthology.orchestra.run.smithi123.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-06T02:55:58.743 INFO:teuthology.orchestra.run.smithi123.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-06T02:55:58.743 INFO:teuthology.orchestra.run.smithi123.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-06T02:55:58.744 INFO:teuthology.orchestra.run.smithi123.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-06T02:55:58.744 INFO:teuthology.orchestra.run.smithi123.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-06T02:55:58.744 INFO:teuthology.orchestra.run.smithi158.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-06T02:55:58.745 INFO:teuthology.orchestra.run.smithi123.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-06T02:55:58.745 INFO:teuthology.orchestra.run.smithi158.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-06T02:55:58.746 INFO:teuthology.orchestra.run.smithi158.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-06T02:55:58.746 INFO:teuthology.orchestra.run.smithi158.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-06T02:55:58.746 INFO:teuthology.orchestra.run.smithi158.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-06T02:55:58.747 INFO:teuthology.orchestra.run.smithi158.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-06T02:55:58.751 INFO:teuthology.orchestra.run.smithi124.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-06T02:55:58.752 INFO:teuthology.orchestra.run.smithi124.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-06T02:55:58.752 INFO:teuthology.orchestra.run.smithi124.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-06T02:55:58.757 INFO:teuthology.orchestra.run.smithi027.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-06T02:55:58.758 INFO:teuthology.orchestra.run.smithi158.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-06T02:55:58.758 INFO:teuthology.orchestra.run.smithi158.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-06T02:55:58.759 INFO:teuthology.orchestra.run.smithi027.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-06T02:55:58.759 INFO:teuthology.orchestra.run.smithi158.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-06T02:55:58.759 INFO:teuthology.orchestra.run.smithi027.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-06T02:55:58.760 INFO:teuthology.orchestra.run.smithi027.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-06T02:55:58.761 INFO:teuthology.orchestra.run.smithi027.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-06T02:55:58.762 INFO:teuthology.orchestra.run.smithi158.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-06T02:55:58.763 INFO:teuthology.orchestra.run.smithi027.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-06T02:55:58.764 INFO:teuthology.orchestra.run.smithi027.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-06T02:55:58.766 INFO:teuthology.orchestra.run.smithi123.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-06T02:55:58.768 INFO:teuthology.orchestra.run.smithi123.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-06T02:55:58.773 INFO:teuthology.orchestra.run.smithi123.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-06T02:55:58.774 INFO:teuthology.orchestra.run.smithi027.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-06T02:55:58.775 INFO:teuthology.orchestra.run.smithi123.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-06T02:55:58.777 INFO:teuthology.orchestra.run.smithi123.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-06T02:55:58.777 INFO:teuthology.orchestra.run.smithi123.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-06T02:55:58.778 INFO:teuthology.orchestra.run.smithi027.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-06T02:55:58.779 INFO:teuthology.orchestra.run.smithi158.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-06T02:55:58.779 INFO:teuthology.orchestra.run.smithi027.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-06T02:55:58.780 INFO:teuthology.orchestra.run.smithi123.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-06T02:55:58.781 INFO:teuthology.orchestra.run.smithi158.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-06T02:55:58.781 INFO:teuthology.orchestra.run.smithi158.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-06T02:55:58.782 INFO:teuthology.orchestra.run.smithi123.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-06T02:55:58.782 INFO:teuthology.orchestra.run.smithi158.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-06T02:55:58.783 INFO:teuthology.orchestra.run.smithi123.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-06T02:55:58.783 INFO:teuthology.orchestra.run.smithi158.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-06T02:55:58.787 INFO:teuthology.orchestra.run.smithi174.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-06T02:55:58.792 INFO:teuthology.orchestra.run.smithi027.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-06T02:55:58.793 INFO:teuthology.orchestra.run.smithi027.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-06T02:55:58.793 INFO:teuthology.orchestra.run.smithi174.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-06T02:55:58.794 INFO:teuthology.orchestra.run.smithi124.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-06T02:55:58.794 INFO:teuthology.orchestra.run.smithi124.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-06T02:55:58.795 INFO:teuthology.orchestra.run.smithi027.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-06T02:55:58.796 INFO:teuthology.orchestra.run.smithi124.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-06T02:55:58.798 INFO:teuthology.orchestra.run.smithi027.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-06T02:55:58.798 INFO:teuthology.orchestra.run.smithi027.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-06T02:55:58.799 INFO:teuthology.orchestra.run.smithi123.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-06T02:55:58.813 INFO:teuthology.orchestra.run.smithi124.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-06T02:55:58.813 INFO:teuthology.orchestra.run.smithi124.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-06T02:55:58.814 INFO:teuthology.orchestra.run.smithi124.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-06T02:55:58.814 INFO:teuthology.orchestra.run.smithi124.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-06T02:55:58.814 INFO:teuthology.orchestra.run.smithi174.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-06T02:55:58.815 INFO:teuthology.orchestra.run.smithi124.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-06T02:55:58.815 INFO:teuthology.orchestra.run.smithi124.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-06T02:55:58.817 INFO:teuthology.orchestra.run.smithi123.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-06T02:55:58.817 INFO:teuthology.orchestra.run.smithi027.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-06T02:55:58.819 INFO:teuthology.orchestra.run.smithi027.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-06T02:55:58.844 INFO:teuthology.orchestra.run.smithi124.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-06T02:55:58.847 INFO:teuthology.orchestra.run.smithi124.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-06T02:55:58.849 INFO:teuthology.orchestra.run.smithi124.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-06T02:55:58.855 INFO:teuthology.orchestra.run.smithi027.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-06T02:55:58.856 INFO:teuthology.orchestra.run.smithi027.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-06T02:55:58.857 INFO:teuthology.orchestra.run.smithi027.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-06T02:55:58.857 INFO:teuthology.orchestra.run.smithi027.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-06T02:55:58.857 INFO:teuthology.orchestra.run.smithi027.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-06T02:55:58.858 INFO:teuthology.orchestra.run.smithi027.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-06T02:55:58.870 INFO:teuthology.orchestra.run.smithi027.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-06T02:55:58.870 INFO:teuthology.orchestra.run.smithi027.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-06T02:55:58.870 INFO:teuthology.orchestra.run.smithi027.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-06T02:55:58.873 INFO:teuthology.orchestra.run.smithi027.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-06T02:55:58.890 INFO:teuthology.orchestra.run.smithi027.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-06T02:55:58.891 INFO:teuthology.orchestra.run.smithi027.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-06T02:55:58.891 INFO:teuthology.orchestra.run.smithi027.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-06T02:55:58.893 INFO:teuthology.orchestra.run.smithi027.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-06T02:55:58.895 INFO:teuthology.orchestra.run.smithi027.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-06T02:55:58.939 INFO:teuthology.orchestra.run.smithi123.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-06T02:55:58.941 INFO:teuthology.orchestra.run.smithi123.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-06T02:55:58.941 INFO:teuthology.orchestra.run.smithi123.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-06T02:55:58.942 INFO:teuthology.orchestra.run.smithi123.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-06T02:55:58.942 INFO:teuthology.orchestra.run.smithi123.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-06T02:55:58.944 INFO:teuthology.orchestra.run.smithi123.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-06T02:55:58.953 INFO:teuthology.orchestra.run.smithi174.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1296-g736ac5ba-1focal [116 kB] 2023-10-06T02:55:58.957 INFO:teuthology.orchestra.run.smithi174.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1296-g736ac5ba-1focal [479 kB] 2023-10-06T02:55:58.957 INFO:teuthology.orchestra.run.smithi123.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-06T02:55:58.957 INFO:teuthology.orchestra.run.smithi123.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-06T02:55:58.979 INFO:teuthology.orchestra.run.smithi174.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1296-g736ac5ba-1focal [27.8 MB] 2023-10-06T02:55:58.983 INFO:teuthology.orchestra.run.smithi123.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-06T02:55:58.984 INFO:teuthology.orchestra.run.smithi123.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-06T02:55:58.986 INFO:teuthology.orchestra.run.smithi123.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-06T02:55:58.989 INFO:teuthology.orchestra.run.smithi123.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-06T02:55:58.989 INFO:teuthology.orchestra.run.smithi123.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-06T02:55:58.992 INFO:teuthology.orchestra.run.smithi123.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-06T02:55:58.993 INFO:teuthology.orchestra.run.smithi123.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-06T02:55:59.104 INFO:teuthology.orchestra.run.smithi174.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-06T02:55:59.290 INFO:teuthology.orchestra.run.smithi158.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1296-g736ac5ba-1focal [3,554 kB] 2023-10-06T02:55:59.518 INFO:teuthology.orchestra.run.smithi123.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1296-g736ac5ba-1focal [3,554 kB] 2023-10-06T02:55:59.539 INFO:teuthology.orchestra.run.smithi174.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-06T02:55:59.721 INFO:teuthology.orchestra.run.smithi174.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-06T02:55:59.752 INFO:teuthology.orchestra.run.smithi174.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-06T02:55:59.758 INFO:teuthology.orchestra.run.smithi174.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-06T02:55:59.783 INFO:teuthology.orchestra.run.smithi174.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-06T02:55:59.787 INFO:teuthology.orchestra.run.smithi174.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-06T02:55:59.790 INFO:teuthology.orchestra.run.smithi174.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-06T02:55:59.804 INFO:teuthology.orchestra.run.smithi174.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-06T02:55:59.805 INFO:teuthology.orchestra.run.smithi174.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-06T02:55:59.807 INFO:teuthology.orchestra.run.smithi174.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-06T02:55:59.807 INFO:teuthology.orchestra.run.smithi124.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1296-g736ac5ba-1focal [3,554 kB] 2023-10-06T02:55:59.972 INFO:teuthology.orchestra.run.smithi174.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-06T02:56:00.136 INFO:teuthology.orchestra.run.smithi174.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-06T02:56:00.213 INFO:teuthology.orchestra.run.smithi123.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1296-g736ac5ba-1focal [760 kB] 2023-10-06T02:56:00.239 INFO:teuthology.orchestra.run.smithi158.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1296-g736ac5ba-1focal [760 kB] 2023-10-06T02:56:00.277 INFO:teuthology.orchestra.run.smithi174.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-06T02:56:00.296 INFO:teuthology.orchestra.run.smithi174.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-06T02:56:00.307 INFO:teuthology.orchestra.run.smithi174.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-06T02:56:00.314 INFO:teuthology.orchestra.run.smithi123.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1296-g736ac5ba-1focal [413 kB] 2023-10-06T02:56:00.379 INFO:teuthology.orchestra.run.smithi123.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1296-g736ac5ba-1focal [22.5 kB] 2023-10-06T02:56:00.382 INFO:teuthology.orchestra.run.smithi123.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1296-g736ac5ba-1focal [200 kB] 2023-10-06T02:56:00.383 INFO:teuthology.orchestra.run.smithi174.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-06T02:56:00.390 INFO:teuthology.orchestra.run.smithi158.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1296-g736ac5ba-1focal [413 kB] 2023-10-06T02:56:00.403 INFO:teuthology.orchestra.run.smithi123.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1296-g736ac5ba-1focal [47.1 kB] 2023-10-06T02:56:00.405 INFO:teuthology.orchestra.run.smithi174.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-06T02:56:00.409 INFO:teuthology.orchestra.run.smithi123.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1296-g736ac5ba-1focal [386 kB] 2023-10-06T02:56:00.468 INFO:teuthology.orchestra.run.smithi123.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1296-g736ac5ba-1focal [5,570 kB] 2023-10-06T02:56:00.484 INFO:teuthology.orchestra.run.smithi174.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-06T02:56:00.502 INFO:teuthology.orchestra.run.smithi158.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1296-g736ac5ba-1focal [22.5 kB] 2023-10-06T02:56:00.503 INFO:teuthology.orchestra.run.smithi158.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1296-g736ac5ba-1focal [200 kB] 2023-10-06T02:56:00.543 INFO:teuthology.orchestra.run.smithi158.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1296-g736ac5ba-1focal [47.1 kB] 2023-10-06T02:56:00.546 INFO:teuthology.orchestra.run.smithi158.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1296-g736ac5ba-1focal [386 kB] 2023-10-06T02:56:00.549 INFO:teuthology.orchestra.run.smithi174.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-06T02:56:00.549 INFO:teuthology.orchestra.run.smithi174.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1296-g736ac5ba-1focal [6,453 kB] 2023-10-06T02:56:00.550 INFO:teuthology.orchestra.run.smithi174.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-06T02:56:00.590 INFO:teuthology.orchestra.run.smithi174.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-06T02:56:00.646 INFO:teuthology.orchestra.run.smithi158.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1296-g736ac5ba-1focal [5,570 kB] 2023-10-06T02:56:00.755 INFO:teuthology.orchestra.run.smithi174.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-06T02:56:00.853 INFO:teuthology.orchestra.run.smithi174.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1296-g736ac5ba-1focal [221 kB] 2023-10-06T02:56:00.861 INFO:teuthology.orchestra.run.smithi174.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1296-g736ac5ba-1focal [152 kB] 2023-10-06T02:56:00.883 INFO:teuthology.orchestra.run.smithi174.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1296-g736ac5ba-1focal [1,591 kB] 2023-10-06T02:56:00.940 INFO:teuthology.orchestra.run.smithi174.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-06T02:56:00.984 INFO:teuthology.orchestra.run.smithi174.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1296-g736ac5ba-1focal [7,846 kB] 2023-10-06T02:56:00.989 INFO:teuthology.orchestra.run.smithi174.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-06T02:56:01.114 INFO:teuthology.orchestra.run.smithi123.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1296-g736ac5ba-1focal [116 kB] 2023-10-06T02:56:01.121 INFO:teuthology.orchestra.run.smithi174.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-06T02:56:01.124 INFO:teuthology.orchestra.run.smithi123.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1296-g736ac5ba-1focal [479 kB] 2023-10-06T02:56:01.169 INFO:teuthology.orchestra.run.smithi123.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1296-g736ac5ba-1focal [27.8 MB] 2023-10-06T02:56:01.225 INFO:teuthology.orchestra.run.smithi174.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-06T02:56:01.255 INFO:teuthology.orchestra.run.smithi174.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-06T02:56:01.258 INFO:teuthology.orchestra.run.smithi174.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-06T02:56:01.283 INFO:teuthology.orchestra.run.smithi174.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-06T02:56:01.304 INFO:teuthology.orchestra.run.smithi174.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-06T02:56:01.320 INFO:teuthology.orchestra.run.smithi174.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-06T02:56:01.322 INFO:teuthology.orchestra.run.smithi174.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-06T02:56:01.460 INFO:teuthology.orchestra.run.smithi124.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1296-g736ac5ba-1focal [760 kB] 2023-10-06T02:56:01.491 INFO:teuthology.orchestra.run.smithi174.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-06T02:56:01.496 INFO:teuthology.orchestra.run.smithi174.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1296-g736ac5ba-1focal [28.7 MB] 2023-10-06T02:56:01.822 INFO:teuthology.orchestra.run.smithi124.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1296-g736ac5ba-1focal [413 kB] 2023-10-06T02:56:02.046 INFO:teuthology.orchestra.run.smithi124.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1296-g736ac5ba-1focal [22.5 kB] 2023-10-06T02:56:02.051 INFO:teuthology.orchestra.run.smithi124.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1296-g736ac5ba-1focal [200 kB] 2023-10-06T02:56:02.140 INFO:teuthology.orchestra.run.smithi124.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1296-g736ac5ba-1focal [47.1 kB] 2023-10-06T02:56:02.145 INFO:teuthology.orchestra.run.smithi124.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1296-g736ac5ba-1focal [386 kB] 2023-10-06T02:56:02.303 INFO:teuthology.orchestra.run.smithi158.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1296-g736ac5ba-1focal [116 kB] 2023-10-06T02:56:02.324 INFO:teuthology.orchestra.run.smithi124.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1296-g736ac5ba-1focal [5,570 kB] 2023-10-06T02:56:02.342 INFO:teuthology.orchestra.run.smithi158.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1296-g736ac5ba-1focal [479 kB] 2023-10-06T02:56:02.472 INFO:teuthology.orchestra.run.smithi174.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-06T02:56:02.492 INFO:teuthology.orchestra.run.smithi158.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1296-g736ac5ba-1focal [27.8 MB] 2023-10-06T02:56:02.496 INFO:teuthology.orchestra.run.smithi174.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-06T02:56:02.497 INFO:teuthology.orchestra.run.smithi174.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-06T02:56:02.570 INFO:teuthology.orchestra.run.smithi174.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-06T02:56:02.570 INFO:teuthology.orchestra.run.smithi174.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-06T02:56:02.570 INFO:teuthology.orchestra.run.smithi174.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-06T02:56:02.571 INFO:teuthology.orchestra.run.smithi174.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-06T02:56:02.571 INFO:teuthology.orchestra.run.smithi174.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-06T02:56:02.572 INFO:teuthology.orchestra.run.smithi174.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-06T02:56:02.572 INFO:teuthology.orchestra.run.smithi174.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-06T02:56:02.737 INFO:teuthology.orchestra.run.smithi174.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-06T02:56:02.904 INFO:teuthology.orchestra.run.smithi174.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-06T02:56:02.986 INFO:teuthology.orchestra.run.smithi174.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-06T02:56:03.216 INFO:teuthology.orchestra.run.smithi174.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-06T02:56:03.320 INFO:teuthology.orchestra.run.smithi174.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-06T02:56:03.389 INFO:teuthology.orchestra.run.smithi174.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1296-g736ac5ba-1focal [3,920 B] 2023-10-06T02:56:03.389 INFO:teuthology.orchestra.run.smithi174.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-06T02:56:03.389 INFO:teuthology.orchestra.run.smithi174.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1296-g736ac5ba-1focal [869 kB] 2023-10-06T02:56:03.390 INFO:teuthology.orchestra.run.smithi174.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-06T02:56:03.397 INFO:teuthology.orchestra.run.smithi174.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-06T02:56:03.402 INFO:teuthology.orchestra.run.smithi174.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-06T02:56:03.402 INFO:teuthology.orchestra.run.smithi174.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-06T02:56:03.403 INFO:teuthology.orchestra.run.smithi174.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1296-g736ac5ba-1focal [2,408 kB] 2023-10-06T02:56:03.550 INFO:teuthology.orchestra.run.smithi174.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-06T02:56:03.562 INFO:teuthology.orchestra.run.smithi174.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1296-g736ac5ba-1focal [79.1 kB] 2023-10-06T02:56:03.565 INFO:teuthology.orchestra.run.smithi174.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1296-g736ac5ba-1focal [117 kB] 2023-10-06T02:56:03.568 INFO:teuthology.orchestra.run.smithi174.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1296-g736ac5ba-1focal [1,760 kB] 2023-10-06T02:56:03.611 INFO:teuthology.orchestra.run.smithi174.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1296-g736ac5ba-1focal [7,888 kB] 2023-10-06T02:56:03.723 INFO:teuthology.orchestra.run.smithi174.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-06T02:56:03.925 INFO:teuthology.orchestra.run.smithi027.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1296-g736ac5ba-1focal [3,554 kB] 2023-10-06T02:56:04.146 INFO:teuthology.orchestra.run.smithi174.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1296-g736ac5ba-1focal [4,032 B] 2023-10-06T02:56:04.147 INFO:teuthology.orchestra.run.smithi174.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1296-g736ac5ba-1focal [56.2 MB] 2023-10-06T02:56:04.547 INFO:teuthology.orchestra.run.smithi174.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-06T02:56:04.549 INFO:teuthology.orchestra.run.smithi174.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-06T02:56:04.550 INFO:teuthology.orchestra.run.smithi174.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-06T02:56:04.551 INFO:teuthology.orchestra.run.smithi174.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-06T02:56:04.552 INFO:teuthology.orchestra.run.smithi174.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-06T02:56:04.554 INFO:teuthology.orchestra.run.smithi174.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-06T02:56:04.567 INFO:teuthology.orchestra.run.smithi123.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1296-g736ac5ba-1focal [6,453 kB] 2023-10-06T02:56:04.571 INFO:teuthology.orchestra.run.smithi174.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-06T02:56:04.571 INFO:teuthology.orchestra.run.smithi174.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-06T02:56:04.571 INFO:teuthology.orchestra.run.smithi174.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-06T02:56:04.628 INFO:teuthology.orchestra.run.smithi174.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-06T02:56:04.734 INFO:teuthology.orchestra.run.smithi124.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1296-g736ac5ba-1focal [116 kB] 2023-10-06T02:56:04.744 INFO:teuthology.orchestra.run.smithi124.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1296-g736ac5ba-1focal [479 kB] 2023-10-06T02:56:04.795 INFO:teuthology.orchestra.run.smithi174.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-06T02:56:04.934 INFO:teuthology.orchestra.run.smithi124.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1296-g736ac5ba-1focal [27.8 MB] 2023-10-06T02:56:05.080 INFO:teuthology.orchestra.run.smithi174.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-06T02:56:05.101 INFO:teuthology.orchestra.run.smithi174.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-06T02:56:05.252 INFO:teuthology.orchestra.run.smithi174.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-06T02:56:05.265 INFO:teuthology.orchestra.run.smithi123.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1296-g736ac5ba-1focal [221 kB] 2023-10-06T02:56:05.269 INFO:teuthology.orchestra.run.smithi174.stdout:Get:109 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-06T02:56:05.285 INFO:teuthology.orchestra.run.smithi123.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1296-g736ac5ba-1focal [152 kB] 2023-10-06T02:56:05.313 INFO:teuthology.orchestra.run.smithi123.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1296-g736ac5ba-1focal [1,591 kB] 2023-10-06T02:56:05.507 INFO:teuthology.orchestra.run.smithi123.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1296-g736ac5ba-1focal [7,846 kB] 2023-10-06T02:56:06.455 INFO:teuthology.orchestra.run.smithi123.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1296-g736ac5ba-1focal [28.7 MB] 2023-10-06T02:56:06.901 INFO:teuthology.orchestra.run.smithi027.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1296-g736ac5ba-1focal [760 kB] 2023-10-06T02:56:07.468 INFO:teuthology.orchestra.run.smithi027.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1296-g736ac5ba-1focal [413 kB] 2023-10-06T02:56:07.757 INFO:teuthology.orchestra.run.smithi027.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1296-g736ac5ba-1focal [22.5 kB] 2023-10-06T02:56:07.759 INFO:teuthology.orchestra.run.smithi027.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1296-g736ac5ba-1focal [200 kB] 2023-10-06T02:56:07.903 INFO:teuthology.orchestra.run.smithi027.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1296-g736ac5ba-1focal [47.1 kB] 2023-10-06T02:56:07.948 INFO:teuthology.orchestra.run.smithi027.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1296-g736ac5ba-1focal [386 kB] 2023-10-06T02:56:08.163 INFO:teuthology.orchestra.run.smithi027.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1296-g736ac5ba-1focal [5,570 kB] 2023-10-06T02:56:08.205 INFO:teuthology.orchestra.run.smithi174.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1296-g736ac5ba-1focal [229 kB] 2023-10-06T02:56:08.209 INFO:teuthology.orchestra.run.smithi174.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1296-g736ac5ba-1focal [240 kB] 2023-10-06T02:56:08.214 INFO:teuthology.orchestra.run.smithi174.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1296-g736ac5ba-1focal [22.0 kB] 2023-10-06T02:56:08.215 INFO:teuthology.orchestra.run.smithi174.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1296-g736ac5ba-1focal [13.1 kB] 2023-10-06T02:56:08.216 INFO:teuthology.orchestra.run.smithi174.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1296-g736ac5ba-1focal [21.9 kB] 2023-10-06T02:56:08.216 INFO:teuthology.orchestra.run.smithi174.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1296-g736ac5ba-1focal [17.0 MB] 2023-10-06T02:56:09.276 INFO:teuthology.orchestra.run.smithi174.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1296-g736ac5ba-1focal [79.5 kB] 2023-10-06T02:56:09.684 INFO:teuthology.orchestra.run.smithi158.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1296-g736ac5ba-1focal [6,453 kB] 2023-10-06T02:56:09.807 INFO:teuthology.orchestra.run.smithi123.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1296-g736ac5ba-1focal [3,920 B] 2023-10-06T02:56:09.807 INFO:teuthology.orchestra.run.smithi123.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1296-g736ac5ba-1focal [869 kB] 2023-10-06T02:56:09.821 INFO:teuthology.orchestra.run.smithi123.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1296-g736ac5ba-1focal [2,408 kB] 2023-10-06T02:56:09.905 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 210 MB in 11s (18.7 MB/s) 2023-10-06T02:56:09.928 INFO:teuthology.orchestra.run.smithi123.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1296-g736ac5ba-1focal [79.1 kB] 2023-10-06T02:56:09.932 INFO:teuthology.orchestra.run.smithi123.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1296-g736ac5ba-1focal [117 kB] 2023-10-06T02:56:09.954 INFO:teuthology.orchestra.run.smithi123.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1296-g736ac5ba-1focal [1,760 kB] 2023-10-06T02:56:10.048 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-06T02:56:10.079 INFO:teuthology.orchestra.run.smithi123.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1296-g736ac5ba-1focal [7,888 kB] 2023-10-06T02:56:10.104 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-06T02:56:10.108 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-06T02:56:10.155 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-06T02:56:10.281 INFO:teuthology.orchestra.run.smithi027.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1296-g736ac5ba-1focal [116 kB] 2023-10-06T02:56:10.317 INFO:teuthology.orchestra.run.smithi027.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1296-g736ac5ba-1focal [479 kB] 2023-10-06T02:56:10.390 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-06T02:56:10.410 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-06T02:56:10.412 INFO:teuthology.orchestra.run.smithi158.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1296-g736ac5ba-1focal [221 kB] 2023-10-06T02:56:10.436 INFO:teuthology.orchestra.run.smithi027.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1296-g736ac5ba-1focal [27.8 MB] 2023-10-06T02:56:10.440 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:56:10.443 INFO:teuthology.orchestra.run.smithi158.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1296-g736ac5ba-1focal [152 kB] 2023-10-06T02:56:10.457 INFO:teuthology.orchestra.run.smithi158.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1296-g736ac5ba-1focal [1,591 kB] 2023-10-06T02:56:10.665 INFO:teuthology.orchestra.run.smithi158.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1296-g736ac5ba-1focal [7,846 kB] 2023-10-06T02:56:10.693 INFO:teuthology.orchestra.run.smithi123.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1296-g736ac5ba-1focal [4,032 B] 2023-10-06T02:56:10.693 INFO:teuthology.orchestra.run.smithi123.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1296-g736ac5ba-1focal [56.2 MB] 2023-10-06T02:56:10.751 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cmd2. 2023-10-06T02:56:10.768 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-06T02:56:10.809 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:56:11.388 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-06T02:56:11.404 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-06T02:56:11.488 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:56:11.780 INFO:teuthology.orchestra.run.smithi158.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1296-g736ac5ba-1focal [28.7 MB] 2023-10-06T02:56:11.794 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../004-librbd1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:11.900 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librbd1 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:11.960 INFO:teuthology.orchestra.run.smithi124.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1296-g736ac5ba-1focal [6,453 kB] 2023-10-06T02:56:12.586 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../005-librados2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:12.712 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librados2 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:12.798 INFO:teuthology.orchestra.run.smithi124.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1296-g736ac5ba-1focal [221 kB] 2023-10-06T02:56:12.828 INFO:teuthology.orchestra.run.smithi124.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1296-g736ac5ba-1focal [152 kB] 2023-10-06T02:56:12.863 INFO:teuthology.orchestra.run.smithi124.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1296-g736ac5ba-1focal [1,591 kB] 2023-10-06T02:56:13.085 INFO:teuthology.orchestra.run.smithi124.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1296-g736ac5ba-1focal [7,846 kB] 2023-10-06T02:56:13.408 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libcephfs2. 2023-10-06T02:56:13.425 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:13.466 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:13.793 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rados. 2023-10-06T02:56:13.811 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:13.843 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:14.064 INFO:teuthology.orchestra.run.smithi124.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1296-g736ac5ba-1focal [28.7 MB] 2023-10-06T02:56:14.171 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-06T02:56:14.191 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:14.230 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:14.506 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cephfs. 2023-10-06T02:56:14.523 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:14.565 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:14.860 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-06T02:56:14.876 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:14.918 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:15.048 INFO:teuthology.orchestra.run.smithi027.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1296-g736ac5ba-1focal [6,453 kB] 2023-10-06T02:56:15.245 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-prettytable. 2023-10-06T02:56:15.261 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-06T02:56:15.303 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-06T02:56:15.578 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rbd. 2023-10-06T02:56:15.598 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:15.614 INFO:teuthology.orchestra.run.smithi027.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1296-g736ac5ba-1focal [221 kB] 2023-10-06T02:56:15.639 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:15.653 INFO:teuthology.orchestra.run.smithi027.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1296-g736ac5ba-1focal [152 kB] 2023-10-06T02:56:15.666 INFO:teuthology.orchestra.run.smithi027.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1296-g736ac5ba-1focal [1,591 kB] 2023-10-06T02:56:15.821 INFO:teuthology.orchestra.run.smithi027.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1296-g736ac5ba-1focal [7,846 kB] 2023-10-06T02:56:15.875 INFO:teuthology.orchestra.run.smithi158.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1296-g736ac5ba-1focal [3,920 B] 2023-10-06T02:56:15.962 INFO:teuthology.orchestra.run.smithi158.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1296-g736ac5ba-1focal [869 kB] 2023-10-06T02:56:15.976 INFO:teuthology.orchestra.run.smithi158.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1296-g736ac5ba-1focal [2,408 kB] 2023-10-06T02:56:15.983 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-06T02:56:16.003 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-06T02:56:16.042 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:56:16.303 INFO:teuthology.orchestra.run.smithi158.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1296-g736ac5ba-1focal [79.1 kB] 2023-10-06T02:56:16.320 INFO:teuthology.orchestra.run.smithi158.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1296-g736ac5ba-1focal [117 kB] 2023-10-06T02:56:16.327 INFO:teuthology.orchestra.run.smithi158.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1296-g736ac5ba-1focal [1,760 kB] 2023-10-06T02:56:16.386 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-06T02:56:16.402 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-06T02:56:16.436 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:56:16.597 INFO:teuthology.orchestra.run.smithi158.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1296-g736ac5ba-1focal [7,888 kB] 2023-10-06T02:56:16.720 INFO:teuthology.orchestra.run.smithi027.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1296-g736ac5ba-1focal [28.7 MB] 2023-10-06T02:56:16.764 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-06T02:56:16.781 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-06T02:56:16.830 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:56:17.208 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-06T02:56:17.225 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-06T02:56:17.267 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:56:17.317 INFO:teuthology.orchestra.run.smithi123.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1296-g736ac5ba-1focal [229 kB] 2023-10-06T02:56:17.322 INFO:teuthology.orchestra.run.smithi123.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1296-g736ac5ba-1focal [240 kB] 2023-10-06T02:56:17.326 INFO:teuthology.orchestra.run.smithi123.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1296-g736ac5ba-1focal [22.0 kB] 2023-10-06T02:56:17.327 INFO:teuthology.orchestra.run.smithi123.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1296-g736ac5ba-1focal [13.1 kB] 2023-10-06T02:56:17.328 INFO:teuthology.orchestra.run.smithi123.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1296-g736ac5ba-1focal [21.9 kB] 2023-10-06T02:56:17.329 INFO:teuthology.orchestra.run.smithi123.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1296-g736ac5ba-1focal [17.0 MB] 2023-10-06T02:56:17.586 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-06T02:56:17.606 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-06T02:56:17.636 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:56:17.787 INFO:teuthology.orchestra.run.smithi158.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1296-g736ac5ba-1focal [4,032 B] 2023-10-06T02:56:17.788 INFO:teuthology.orchestra.run.smithi158.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1296-g736ac5ba-1focal [56.2 MB] 2023-10-06T02:56:18.114 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-06T02:56:18.117 INFO:teuthology.orchestra.run.smithi124.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1296-g736ac5ba-1focal [3,920 B] 2023-10-06T02:56:18.118 INFO:teuthology.orchestra.run.smithi124.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1296-g736ac5ba-1focal [869 kB] 2023-10-06T02:56:18.130 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:18.149 INFO:teuthology.orchestra.run.smithi124.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1296-g736ac5ba-1focal [2,408 kB] 2023-10-06T02:56:18.183 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:18.516 INFO:teuthology.orchestra.run.smithi124.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1296-g736ac5ba-1focal [79.1 kB] 2023-10-06T02:56:18.558 INFO:teuthology.orchestra.run.smithi124.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1296-g736ac5ba-1focal [117 kB] 2023-10-06T02:56:18.566 INFO:teuthology.orchestra.run.smithi124.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1296-g736ac5ba-1focal [1,760 kB] 2023-10-06T02:56:18.623 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-06T02:56:18.642 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:18.684 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:18.842 INFO:teuthology.orchestra.run.smithi124.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1296-g736ac5ba-1focal [7,888 kB] 2023-10-06T02:56:19.045 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-06T02:56:19.061 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:19.103 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:19.273 INFO:teuthology.orchestra.run.smithi123.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1296-g736ac5ba-1focal [79.5 kB] 2023-10-06T02:56:19.523 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-06T02:56:19.538 INFO:teuthology.orchestra.run.smithi027.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1296-g736ac5ba-1focal [3,920 B] 2023-10-06T02:56:19.540 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-06T02:56:19.581 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:56:19.610 INFO:teuthology.orchestra.run.smithi027.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1296-g736ac5ba-1focal [869 kB] 2023-10-06T02:56:19.625 INFO:teuthology.orchestra.run.smithi027.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1296-g736ac5ba-1focal [2,408 kB] 2023-10-06T02:56:19.734 INFO:teuthology.orchestra.run.smithi027.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1296-g736ac5ba-1focal [79.1 kB] 2023-10-06T02:56:19.737 INFO:teuthology.orchestra.run.smithi027.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1296-g736ac5ba-1focal [117 kB] 2023-10-06T02:56:19.744 INFO:teuthology.orchestra.run.smithi027.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1296-g736ac5ba-1focal [1,760 kB] 2023-10-06T02:56:19.865 INFO:teuthology.orchestra.run.smithi027.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1296-g736ac5ba-1focal [7,888 kB] 2023-10-06T02:56:19.897 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 210 MB in 21s (9,888 kB/s) 2023-10-06T02:56:19.911 INFO:teuthology.orchestra.run.smithi124.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1296-g736ac5ba-1focal [4,032 B] 2023-10-06T02:56:19.911 INFO:teuthology.orchestra.run.smithi124.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1296-g736ac5ba-1focal [56.2 MB] 2023-10-06T02:56:19.950 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librgw2. 2023-10-06T02:56:19.966 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../022-librgw2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:20.008 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:20.034 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-06T02:56:20.090 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-06T02:56:20.095 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-06T02:56:20.132 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-06T02:56:20.417 INFO:teuthology.orchestra.run.smithi027.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1296-g736ac5ba-1focal [4,032 B] 2023-10-06T02:56:20.656 INFO:teuthology.orchestra.run.smithi027.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1296-g736ac5ba-1focal [56.2 MB] 2023-10-06T02:56:20.656 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-06T02:56:20.656 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-06T02:56:20.656 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:56:20.761 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rgw. 2023-10-06T02:56:20.777 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:20.812 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:20.871 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cmd2. 2023-10-06T02:56:20.889 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-06T02:56:20.929 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:56:21.189 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liboath0. 2023-10-06T02:56:21.205 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-06T02:56:21.248 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-06T02:56:21.340 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-06T02:56:21.357 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-06T02:56:21.432 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:56:21.567 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libradosstriper1. 2023-10-06T02:56:21.584 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:21.625 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:21.788 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../004-librbd1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:21.928 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librbd1 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:22.045 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-common. 2023-10-06T02:56:22.063 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:22.095 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:22.624 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../005-librados2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:22.748 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librados2 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:23.552 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libcephfs2. 2023-10-06T02:56:23.571 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:23.619 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:23.946 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rados. 2023-10-06T02:56:23.964 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:24.005 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:24.390 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-06T02:56:24.406 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:24.482 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:24.578 INFO:teuthology.orchestra.run.smithi027.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1296-g736ac5ba-1focal [229 kB] 2023-10-06T02:56:24.582 INFO:teuthology.orchestra.run.smithi027.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1296-g736ac5ba-1focal [240 kB] 2023-10-06T02:56:24.587 INFO:teuthology.orchestra.run.smithi027.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1296-g736ac5ba-1focal [22.0 kB] 2023-10-06T02:56:24.649 INFO:teuthology.orchestra.run.smithi027.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1296-g736ac5ba-1focal [13.1 kB] 2023-10-06T02:56:24.649 INFO:teuthology.orchestra.run.smithi027.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1296-g736ac5ba-1focal [21.9 kB] 2023-10-06T02:56:24.650 INFO:teuthology.orchestra.run.smithi027.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1296-g736ac5ba-1focal [17.0 MB] 2023-10-06T02:56:24.776 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cephfs. 2023-10-06T02:56:24.792 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:24.834 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:24.841 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-base. 2023-10-06T02:56:24.857 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:24.910 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:25.201 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-06T02:56:25.218 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:25.271 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:25.309 INFO:teuthology.orchestra.run.smithi158.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1296-g736ac5ba-1focal [229 kB] 2023-10-06T02:56:25.314 INFO:teuthology.orchestra.run.smithi158.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1296-g736ac5ba-1focal [240 kB] 2023-10-06T02:56:25.319 INFO:teuthology.orchestra.run.smithi158.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1296-g736ac5ba-1focal [22.0 kB] 2023-10-06T02:56:25.377 INFO:teuthology.orchestra.run.smithi158.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1296-g736ac5ba-1focal [13.1 kB] 2023-10-06T02:56:25.378 INFO:teuthology.orchestra.run.smithi158.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1296-g736ac5ba-1focal [21.9 kB] 2023-10-06T02:56:25.379 INFO:teuthology.orchestra.run.smithi158.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1296-g736ac5ba-1focal [17.0 MB] 2023-10-06T02:56:25.583 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-prettytable. 2023-10-06T02:56:25.603 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-06T02:56:25.641 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-06T02:56:25.707 INFO:teuthology.orchestra.run.smithi027.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1296-g736ac5ba-1focal [79.5 kB] 2023-10-06T02:56:25.899 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rbd. 2023-10-06T02:56:25.918 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:25.949 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:25.962 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cryptography. 2023-10-06T02:56:25.983 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-06T02:56:26.045 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:56:26.357 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 210 MB in 27s (7,651 kB/s) 2023-10-06T02:56:26.368 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-06T02:56:26.386 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-06T02:56:26.407 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-openssl. 2023-10-06T02:56:26.427 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:56:26.427 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-06T02:56:26.465 INFO:teuthology.orchestra.run.smithi124.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1296-g736ac5ba-1focal [229 kB] 2023-10-06T02:56:26.466 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-06T02:56:26.470 INFO:teuthology.orchestra.run.smithi124.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1296-g736ac5ba-1focal [240 kB] 2023-10-06T02:56:26.476 INFO:teuthology.orchestra.run.smithi158.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1296-g736ac5ba-1focal [79.5 kB] 2023-10-06T02:56:26.501 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-06T02:56:26.540 INFO:teuthology.orchestra.run.smithi124.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1296-g736ac5ba-1focal [22.0 kB] 2023-10-06T02:56:26.541 INFO:teuthology.orchestra.run.smithi124.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1296-g736ac5ba-1focal [13.1 kB] 2023-10-06T02:56:26.541 INFO:teuthology.orchestra.run.smithi124.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1296-g736ac5ba-1focal [21.9 kB] 2023-10-06T02:56:26.542 INFO:teuthology.orchestra.run.smithi124.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1296-g736ac5ba-1focal [17.0 MB] 2023-10-06T02:56:26.558 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-06T02:56:26.563 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-06T02:56:26.599 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-06T02:56:26.777 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-06T02:56:26.793 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:26.805 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-06T02:56:26.822 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-06T02:56:26.835 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:26.880 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:56:26.952 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-06T02:56:26.968 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-06T02:56:27.002 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:56:27.110 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 210 MB in 28s (7,410 kB/s) 2023-10-06T02:56:27.191 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-06T02:56:27.206 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-06T02:56:27.209 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-06T02:56:27.224 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-06T02:56:27.241 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:56:27.251 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-06T02:56:27.289 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:56:27.297 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cmd2. 2023-10-06T02:56:27.307 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-06T02:56:27.312 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-06T02:56:27.314 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-06T02:56:27.350 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-06T02:56:27.355 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:56:27.378 INFO:teuthology.orchestra.run.smithi124.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1296-g736ac5ba-1focal [79.5 kB] 2023-10-06T02:56:27.575 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-06T02:56:27.595 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-06T02:56:27.633 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:56:27.694 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-06T02:56:27.710 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-06T02:56:27.716 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-06T02:56:27.736 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-06T02:56:27.752 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:56:27.850 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:56:27.953 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-natsort. 2023-10-06T02:56:27.971 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-06T02:56:28.003 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-06T02:56:28.105 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-06T02:56:28.122 INFO:teuthology.orchestra.run.smithi124.stdout:Fetched 210 MB in 29s (7,147 kB/s) 2023-10-06T02:56:28.124 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-06T02:56:28.138 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../004-librbd1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:28.188 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:56:28.245 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librbd1 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:28.273 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jwt. 2023-10-06T02:56:28.291 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-06T02:56:28.323 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:56:28.428 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-06T02:56:28.444 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-06T02:56:28.511 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:56:28.609 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-06T02:56:28.625 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:28.650 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-logutils. 2023-10-06T02:56:28.666 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-06T02:56:28.669 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:28.697 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-06T02:56:28.709 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-06T02:56:28.754 INFO:teuthology.orchestra.run.smithi124.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-06T02:56:28.758 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-06T02:56:28.804 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-06T02:56:28.814 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cmd2. 2023-10-06T02:56:28.830 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-06T02:56:28.872 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:56:28.958 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../005-librados2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:29.003 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-06T02:56:29.022 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-06T02:56:29.081 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:56:29.083 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librados2 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:29.107 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-06T02:56:29.122 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-06T02:56:29.165 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:56:29.166 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-06T02:56:29.184 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-06T02:56:29.250 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:56:29.397 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-mako. 2023-10-06T02:56:29.413 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-06T02:56:29.443 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cmd2. 2023-10-06T02:56:29.455 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:56:29.462 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-06T02:56:29.501 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:56:29.621 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../004-librbd1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:29.720 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libcephfs2. 2023-10-06T02:56:29.739 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:29.746 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librbd1 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:29.778 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:29.783 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-06T02:56:29.799 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-06T02:56:29.842 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:56:29.896 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-06T02:56:29.913 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-06T02:56:29.996 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:56:30.021 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-06T02:56:30.036 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:30.104 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:30.114 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rados. 2023-10-06T02:56:30.131 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:30.144 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-06T02:56:30.161 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-06T02:56:30.172 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:30.202 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:56:30.358 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../004-librbd1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:30.466 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../005-librados2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:30.473 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-06T02:56:30.492 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:30.508 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking librbd1 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:30.525 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-06T02:56:30.531 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:30.539 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-webob. 2023-10-06T02:56:30.544 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:30.554 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-06T02:56:30.583 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:30.584 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librados2 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:30.596 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-06T02:56:30.861 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cephfs. 2023-10-06T02:56:30.877 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:30.893 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-06T02:56:30.909 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-06T02:56:30.910 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:30.932 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-06T02:56:30.951 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-06T02:56:30.959 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:56:30.990 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:56:31.170 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../005-librados2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:31.230 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-06T02:56:31.247 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:31.256 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libcephfs2. 2023-10-06T02:56:31.275 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:31.288 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:31.293 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-bs4. 2023-10-06T02:56:31.296 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking librados2 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:31.304 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librgw2. 2023-10-06T02:56:31.310 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-06T02:56:31.320 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:31.324 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../022-librgw2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:31.352 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-06T02:56:31.404 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:31.581 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-prettytable. 2023-10-06T02:56:31.601 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-06T02:56:31.631 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rados. 2023-10-06T02:56:31.641 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-06T02:56:31.649 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:31.681 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:31.942 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libcephfs2. 2023-10-06T02:56:31.958 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:32.000 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:32.001 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-06T02:56:32.018 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:32.058 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:32.223 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rgw. 2023-10-06T02:56:32.241 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:32.281 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:32.319 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-rados. 2023-10-06T02:56:32.339 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:32.353 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cephfs. 2023-10-06T02:56:32.355 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-waitress. 2023-10-06T02:56:32.369 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:32.370 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:32.372 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-06T02:56:32.411 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:32.417 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:56:32.571 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rbd. 2023-10-06T02:56:32.589 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:32.626 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liboath0. 2023-10-06T02:56:32.645 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-06T02:56:32.646 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:32.676 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-06T02:56:32.705 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-06T02:56:32.721 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:32.723 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-06T02:56:32.739 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:32.761 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-tempita. 2023-10-06T02:56:32.763 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:32.780 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-06T02:56:32.781 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:32.824 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-06T02:56:32.987 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-06T02:56:33.003 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-06T02:56:33.017 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cephfs. 2023-10-06T02:56:33.029 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libradosstriper1. 2023-10-06T02:56:33.036 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:33.045 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:56:33.048 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:33.076 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:33.077 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-prettytable. 2023-10-06T02:56:33.087 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:33.096 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-06T02:56:33.118 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-paste. 2023-10-06T02:56:33.137 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-06T02:56:33.160 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-06T02:56:33.176 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:56:33.357 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-06T02:56:33.374 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-06T02:56:33.406 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:56:33.413 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rbd. 2023-10-06T02:56:33.429 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-06T02:56:33.430 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:33.445 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:33.463 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:33.479 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:33.546 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-06T02:56:33.564 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-06T02:56:33.604 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:56:33.624 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-common. 2023-10-06T02:56:33.640 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:33.682 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:33.758 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-prettytable. 2023-10-06T02:56:33.776 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-06T02:56:33.776 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-06T02:56:33.796 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-06T02:56:33.804 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-06T02:56:33.816 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-06T02:56:33.824 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-06T02:56:33.835 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:56:33.862 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:56:33.907 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-06T02:56:33.923 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-06T02:56:33.990 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:56:34.040 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-rbd. 2023-10-06T02:56:34.057 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:34.099 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:34.200 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-06T02:56:34.204 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-06T02:56:34.215 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-06T02:56:34.220 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-06T02:56:34.249 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:56:34.262 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:56:34.293 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-webtest. 2023-10-06T02:56:34.309 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-06T02:56:34.351 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-06T02:56:34.468 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-06T02:56:34.486 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-06T02:56:34.526 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:56:34.569 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-06T02:56:34.574 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-06T02:56:34.586 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-06T02:56:34.590 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-06T02:56:34.624 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:56:34.628 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:56:34.696 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pecan. 2023-10-06T02:56:34.713 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-06T02:56:34.754 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:56:34.880 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-06T02:56:34.897 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-06T02:56:34.938 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:56:35.022 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-06T02:56:35.038 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-06T02:56:35.069 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-06T02:56:35.080 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:56:35.083 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-06T02:56:35.086 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:35.103 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-06T02:56:35.137 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:35.141 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:56:35.227 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-06T02:56:35.247 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-06T02:56:35.310 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:56:35.358 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-06T02:56:35.374 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-06T02:56:35.408 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:56:35.503 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-06T02:56:35.520 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:35.561 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:35.664 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-06T02:56:35.679 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-06T02:56:35.684 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:35.695 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-06T02:56:35.722 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:35.738 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:56:35.837 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-06T02:56:35.853 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:35.922 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr. 2023-10-06T02:56:35.930 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:35.940 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:35.980 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:36.023 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-06T02:56:36.041 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-06T02:56:36.042 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-06T02:56:36.061 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:36.081 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:56:36.094 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:36.437 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-base. 2023-10-06T02:56:36.456 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:36.456 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-06T02:56:36.472 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:36.495 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-06T02:56:36.500 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mon. 2023-10-06T02:56:36.506 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:36.511 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-06T02:56:36.514 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:36.516 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:36.554 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:56:36.554 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-06T02:56:36.558 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:36.569 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:36.620 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:36.851 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-06T02:56:36.868 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:36.889 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librgw2. 2023-10-06T02:56:36.901 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:36.909 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../022-librgw2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:36.949 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:37.096 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-06T02:56:37.115 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:37.154 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:37.246 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-06T02:56:37.262 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-06T02:56:37.304 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:56:37.516 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-06T02:56:37.533 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:56:37.574 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:56:37.574 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cryptography. 2023-10-06T02:56:37.590 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-06T02:56:37.633 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:56:37.657 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librgw2. 2023-10-06T02:56:37.674 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../022-librgw2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:37.715 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:37.750 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rgw. 2023-10-06T02:56:37.753 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-osd. 2023-10-06T02:56:37.766 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:37.769 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:37.808 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:37.811 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:37.927 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-06T02:56:37.942 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-06T02:56:37.985 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:56:38.095 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-openssl. 2023-10-06T02:56:38.113 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-06T02:56:38.119 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liboath0. 2023-10-06T02:56:38.135 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-06T02:56:38.153 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-06T02:56:38.177 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-06T02:56:38.371 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package librgw2. 2023-10-06T02:56:38.391 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../022-librgw2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:38.541 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:38.541 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libradosstriper1. 2023-10-06T02:56:38.541 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:38.541 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rgw. 2023-10-06T02:56:38.541 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:38.541 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-06T02:56:38.542 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:38.542 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:38.575 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:38.579 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:38.920 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liboath0. 2023-10-06T02:56:38.935 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-06T02:56:38.940 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-06T02:56:38.951 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-06T02:56:38.970 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-06T02:56:38.993 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-common. 2023-10-06T02:56:38.993 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:56:39.009 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:39.042 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:39.223 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-rgw. 2023-10-06T02:56:39.241 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:39.265 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libradosstriper1. 2023-10-06T02:56:39.281 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:39.282 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:39.324 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:39.354 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-06T02:56:39.372 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-06T02:56:39.421 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:56:39.577 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package liboath0. 2023-10-06T02:56:39.593 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-06T02:56:39.627 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-06T02:56:39.791 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-natsort. 2023-10-06T02:56:39.823 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-06T02:56:39.823 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-common. 2023-10-06T02:56:39.823 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:39.852 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:39.878 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-06T02:56:39.937 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libradosstriper1. 2023-10-06T02:56:39.957 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:39.996 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:40.219 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jwt. 2023-10-06T02:56:40.239 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-06T02:56:40.277 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:56:40.474 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-common. 2023-10-06T02:56:40.490 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:40.532 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:40.589 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph. 2023-10-06T02:56:40.600 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-logutils. 2023-10-06T02:56:40.607 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../055-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:40.616 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-06T02:56:40.647 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:40.697 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-06T02:56:40.932 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-fuse. 2023-10-06T02:56:40.949 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:40.982 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-06T02:56:41.153 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-06T02:56:41.153 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:56:41.436 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mds. 2023-10-06T02:56:41.450 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-mako. 2023-10-06T02:56:41.452 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:41.468 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-06T02:56:41.493 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:41.519 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:56:41.781 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-base. 2023-10-06T02:56:41.798 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:41.842 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:41.897 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-06T02:56:41.914 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-06T02:56:41.989 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:56:42.055 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephadm. 2023-10-06T02:56:42.071 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../058-cephadm_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:42.113 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-06T02:56:42.333 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-06T02:56:42.366 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:56:42.540 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-base. 2023-10-06T02:56:42.556 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:42.601 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:42.686 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-webob. 2023-10-06T02:56:42.702 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-06T02:56:42.757 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jinja2. 2023-10-06T02:56:42.777 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-06T02:56:42.777 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-06T02:56:42.807 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-06T02:56:43.111 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cryptography. 2023-10-06T02:56:43.128 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-06T02:56:43.129 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-06T02:56:43.129 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-06T02:56:43.132 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-06T02:56:43.146 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:43.169 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:56:43.172 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:56:43.176 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:43.187 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-base. 2023-10-06T02:56:43.205 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:43.247 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:43.513 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-06T02:56:43.525 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-bs4. 2023-10-06T02:56:43.531 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-06T02:56:43.544 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-06T02:56:43.556 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-openssl. 2023-10-06T02:56:43.562 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-06T02:56:43.572 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-06T02:56:43.591 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-06T02:56:43.614 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-06T02:56:43.637 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cryptography. 2023-10-06T02:56:43.676 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-06T02:56:43.695 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:56:43.815 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjs-underscore. 2023-10-06T02:56:43.832 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-06T02:56:43.867 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-06T02:56:43.873 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:56:43.883 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:43.925 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:43.977 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-waitress. 2023-10-06T02:56:43.994 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-06T02:56:44.072 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:56:44.175 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-06T02:56:44.191 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-06T02:56:44.233 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:56:44.330 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-06T02:56:44.347 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-06T02:56:44.357 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-openssl. 2023-10-06T02:56:44.374 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-06T02:56:44.388 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:56:44.405 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-tempita. 2023-10-06T02:56:44.415 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-06T02:56:44.424 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-06T02:56:44.463 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-06T02:56:44.574 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cryptography. 2023-10-06T02:56:44.578 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-routes. 2023-10-06T02:56:44.592 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-06T02:56:44.594 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-06T02:56:44.624 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:56:44.636 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-06T02:56:44.676 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-06T02:56:44.694 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:44.700 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-06T02:56:44.718 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-06T02:56:44.734 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:44.755 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:56:44.850 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-paste. 2023-10-06T02:56:44.869 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-06T02:56:44.908 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:56:44.922 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-06T02:56:44.940 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:44.972 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:45.020 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-openssl. 2023-10-06T02:56:45.039 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-06T02:56:45.064 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-natsort. 2023-10-06T02:56:45.069 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-06T02:56:45.072 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-06T02:56:45.111 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-06T02:56:45.131 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-06T02:56:45.147 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-06T02:56:45.206 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:56:45.322 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-06T02:56:45.338 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:45.380 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:45.458 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jwt. 2023-10-06T02:56:45.467 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-decorator. 2023-10-06T02:56:45.475 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-06T02:56:45.487 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-06T02:56:45.509 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-06T02:56:45.524 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:56:45.525 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:56:45.526 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-06T02:56:45.561 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-06T02:56:45.567 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:56:45.580 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-06T02:56:45.611 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:56:45.769 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-06T02:56:45.883 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-06T02:56:45.883 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-06T02:56:45.883 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-logutils. 2023-10-06T02:56:45.883 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-06T02:56:45.883 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-06T02:56:45.883 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:56:45.894 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-06T02:56:45.928 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:56:45.929 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-natsort. 2023-10-06T02:56:45.929 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-06T02:56:45.962 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-06T02:56:45.989 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-06T02:56:46.006 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-06T02:56:46.047 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:56:46.154 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-06T02:56:46.170 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-06T02:56:46.212 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:56:46.222 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-06T02:56:46.230 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-scipy. 2023-10-06T02:56:46.239 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-06T02:56:46.349 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:56:46.349 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-06T02:56:46.349 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-06T02:56:46.349 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-jwt. 2023-10-06T02:56:46.349 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-06T02:56:46.349 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:56:46.358 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-webtest. 2023-10-06T02:56:46.380 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-06T02:56:46.408 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-06T02:56:46.524 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-natsort. 2023-10-06T02:56:46.543 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-06T02:56:46.575 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-mako. 2023-10-06T02:56:46.582 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-06T02:56:46.593 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-06T02:56:46.633 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:56:46.660 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-logutils. 2023-10-06T02:56:46.678 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-06T02:56:46.695 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pecan. 2023-10-06T02:56:46.712 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-06T02:56:46.718 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-06T02:56:46.777 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:56:46.910 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-jwt. 2023-10-06T02:56:46.928 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-06T02:56:46.953 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-06T02:56:46.970 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-06T02:56:46.976 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:56:47.011 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:56:47.046 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-06T02:56:47.065 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-06T02:56:47.104 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:56:47.140 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-06T02:56:47.160 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-06T02:56:47.190 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:56:47.246 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-logutils. 2023-10-06T02:56:47.264 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-06T02:56:47.304 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-06T02:56:47.322 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-06T02:56:47.339 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-06T02:56:47.380 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:56:47.407 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-mako. 2023-10-06T02:56:47.425 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-06T02:56:47.465 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:56:47.523 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-06T02:56:47.539 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-06T02:56:47.573 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:56:47.576 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-06T02:56:47.588 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-06T02:56:47.594 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:47.605 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-06T02:56:47.633 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webob. 2023-10-06T02:56:47.634 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:47.646 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:56:47.650 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-06T02:56:47.691 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-06T02:56:47.785 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-06T02:56:47.837 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-06T02:56:47.845 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:56:47.901 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-mako. 2023-10-06T02:56:47.920 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-06T02:56:47.959 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:56:47.990 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr. 2023-10-06T02:56:48.003 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-06T02:56:48.008 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:48.019 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-06T02:56:48.061 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:56:48.081 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:48.180 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-06T02:56:48.196 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-06T02:56:48.264 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:56:48.264 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-joblib. 2023-10-06T02:56:48.264 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-06T02:56:48.265 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-06T02:56:48.279 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-06T02:56:48.295 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-06T02:56:48.337 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:56:48.389 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-bs4. 2023-10-06T02:56:48.407 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-06T02:56:48.447 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-06T02:56:48.541 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-webob. 2023-10-06T02:56:48.558 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-06T02:56:48.599 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-06T02:56:48.636 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-sklearn. 2023-10-06T02:56:48.643 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mon. 2023-10-06T02:56:48.653 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-06T02:56:48.656 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-06T02:56:48.658 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:48.673 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-06T02:56:48.701 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:48.706 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:56:48.710 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:56:48.808 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-waitress. 2023-10-06T02:56:48.824 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-06T02:56:48.870 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:56:48.952 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-06T02:56:48.972 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-06T02:56:48.983 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-webob. 2023-10-06T02:56:49.001 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-06T02:56:49.010 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:56:49.033 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-06T02:56:49.220 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-tempita. 2023-10-06T02:56:49.236 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-06T02:56:49.278 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-06T02:56:49.321 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-bs4. 2023-10-06T02:56:49.336 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-06T02:56:49.338 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-06T02:56:49.354 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-06T02:56:49.379 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-06T02:56:49.386 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:56:49.451 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-06T02:56:49.469 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:49.509 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:49.597 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-paste. 2023-10-06T02:56:49.617 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-06T02:56:49.655 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:56:49.672 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-bs4. 2023-10-06T02:56:49.689 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-06T02:56:49.730 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-06T02:56:49.732 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-waitress. 2023-10-06T02:56:49.750 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-06T02:56:49.794 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:56:49.829 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-osd. 2023-10-06T02:56:49.846 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:49.879 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:49.959 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-06T02:56:49.977 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-06T02:56:50.041 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:56:50.091 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-waitress. 2023-10-06T02:56:50.107 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-06T02:56:50.152 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-tempita. 2023-10-06T02:56:50.153 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:56:50.168 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-06T02:56:50.210 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-06T02:56:50.444 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-tempita. 2023-10-06T02:56:50.461 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-06T02:56:50.464 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-06T02:56:50.479 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-06T02:56:50.502 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-06T02:56:50.505 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-paste. 2023-10-06T02:56:50.520 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:56:50.524 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-06T02:56:50.563 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:56:50.646 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cachetools. 2023-10-06T02:56:50.662 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-06T02:56:50.706 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-06T02:56:50.805 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-paste. 2023-10-06T02:56:50.822 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webtest. 2023-10-06T02:56:50.824 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-06T02:56:50.839 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-06T02:56:50.863 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:56:50.874 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-06T02:56:50.880 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-06T02:56:50.893 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-06T02:56:50.933 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:56:51.006 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-06T02:56:51.027 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-06T02:56:51.065 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:56:51.133 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-06T02:56:51.150 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-06T02:56:51.182 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:56:51.225 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pecan. 2023-10-06T02:56:51.235 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-06T02:56:51.243 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-06T02:56:51.251 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-06T02:56:51.283 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:56:51.293 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:56:51.426 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-06T02:56:51.444 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-06T02:56:51.468 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-06T02:56:51.484 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:56:51.487 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-06T02:56:51.526 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:56:51.605 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-webtest. 2023-10-06T02:56:51.613 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-06T02:56:51.624 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-06T02:56:51.633 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-06T02:56:51.671 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:56:51.688 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-06T02:56:51.828 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rsa. 2023-10-06T02:56:51.848 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-06T02:56:51.854 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-webtest. 2023-10-06T02:56:51.871 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-06T02:56:51.886 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-06T02:56:51.912 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-06T02:56:51.958 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pecan. 2023-10-06T02:56:51.974 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-06T02:56:52.007 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:56:52.058 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-06T02:56:52.075 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:52.125 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:52.173 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-google-auth. 2023-10-06T02:56:52.189 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-06T02:56:52.223 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pecan. 2023-10-06T02:56:52.230 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-06T02:56:52.239 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-06T02:56:52.281 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:56:52.287 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-06T02:56:52.305 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-06T02:56:52.337 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:56:52.478 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr. 2023-10-06T02:56:52.495 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:52.536 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:52.575 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-blinker. 2023-10-06T02:56:52.593 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-06T02:56:52.633 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:56:52.678 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-06T02:56:52.682 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-06T02:56:52.694 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-06T02:56:52.698 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:52.732 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:52.735 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:56:52.749 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph. 2023-10-06T02:56:52.766 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../055-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:52.807 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:52.928 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-06T02:56:52.944 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-06T02:56:52.986 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:56:53.035 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr. 2023-10-06T02:56:53.039 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mon. 2023-10-06T02:56:53.051 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:53.058 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:53.072 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-06T02:56:53.089 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:53.089 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:53.093 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:53.130 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:53.201 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-fuse. 2023-10-06T02:56:53.218 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:53.259 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:53.339 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-06T02:56:53.357 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-06T02:56:53.397 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:56:53.483 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr. 2023-10-06T02:56:53.501 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:53.541 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:53.621 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mon. 2023-10-06T02:56:53.638 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:53.679 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:53.737 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mds. 2023-10-06T02:56:53.754 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:53.795 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:53.802 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-websocket. 2023-10-06T02:56:53.820 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-06T02:56:53.860 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:56:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mon. 2023-10-06T02:56:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:54.102 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:54.172 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-06T02:56:54.188 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-06T02:56:54.255 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:56:54.323 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephadm. 2023-10-06T02:56:54.325 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-osd. 2023-10-06T02:56:54.342 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:54.343 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../058-cephadm_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:54.382 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:54.383 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:54.759 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jinja2. 2023-10-06T02:56:54.777 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-06T02:56:54.779 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-06T02:56:54.793 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:54.817 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-06T02:56:54.841 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-osd. 2023-10-06T02:56:54.860 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:54.868 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:54.899 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:55.162 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-06T02:56:55.179 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:55.187 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-06T02:56:55.205 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-06T02:56:55.239 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-osd. 2023-10-06T02:56:55.246 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:56:55.253 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:55.255 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:55.297 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:55.615 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-06T02:56:55.623 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-06T02:56:55.633 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:56:55.641 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-06T02:56:55.673 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:56:55.681 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-06T02:56:55.948 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package jq. 2023-10-06T02:56:55.950 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjs-underscore. 2023-10-06T02:56:55.966 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-06T02:56:55.967 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:56:56.006 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:56:56.033 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:56:56.293 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package socat. 2023-10-06T02:56:56.310 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-06T02:56:56.327 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-06T02:56:56.347 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-06T02:56:56.350 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-06T02:56:56.385 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:56:56.670 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package xmlstarlet. 2023-10-06T02:56:56.690 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-06T02:56:56.728 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:56:56.730 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-routes. 2023-10-06T02:56:56.746 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-06T02:56:56.821 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-06T02:56:57.041 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-test. 2023-10-06T02:56:57.060 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:57.099 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:57.199 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-06T02:56:57.220 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:57.228 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph. 2023-10-06T02:56:57.245 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../055-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:57.257 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:57.286 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:57.605 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-fuse. 2023-10-06T02:56:57.611 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph. 2023-10-06T02:56:57.623 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:57.627 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../055-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:57.663 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:57.668 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:57.777 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-decorator. 2023-10-06T02:56:57.794 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-06T02:56:57.861 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:56:57.988 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-fuse. 2023-10-06T02:56:58.004 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:58.046 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:58.100 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mds. 2023-10-06T02:56:58.108 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph. 2023-10-06T02:56:58.116 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:58.128 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../055-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:58.158 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:58.158 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:58.205 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-06T02:56:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-06T02:56:58.273 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:56:58.450 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mds. 2023-10-06T02:56:58.466 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:58.494 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-fuse. 2023-10-06T02:56:58.499 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:58.512 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:58.552 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:58.649 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-scipy. 2023-10-06T02:56:58.666 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-06T02:56:58.707 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-06T02:56:58.753 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephadm. 2023-10-06T02:56:58.770 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../058-cephadm_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:58.811 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:58.988 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mds. 2023-10-06T02:56:59.004 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:59.019 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package cephadm. 2023-10-06T02:56:59.035 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../058-cephadm_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:59.046 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:59.122 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jinja2. 2023-10-06T02:56:59.138 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:59.139 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-06T02:56:59.180 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-06T02:56:59.464 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-jinja2. 2023-10-06T02:56:59.479 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-06T02:56:59.517 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-06T02:56:59.522 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-06T02:56:59.533 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:59.575 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:59.641 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package cephadm. 2023-10-06T02:56:59.657 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../058-cephadm_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:59.716 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:59.841 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-06T02:56:59.861 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:59.899 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:59.945 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-06T02:56:59.962 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-06T02:56:59.993 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-jinja2. 2023-10-06T02:57:00.003 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-06T02:57:00.009 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-06T02:57:00.016 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-06T02:57:00.036 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-06T02:57:00.060 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-06T02:57:00.074 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:00.239 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjs-underscore. 2023-10-06T02:57:00.258 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-06T02:57:00.261 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-06T02:57:00.278 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-06T02:57:00.297 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:57:00.319 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-06T02:57:00.356 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-06T02:57:00.376 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:00.412 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:00.563 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjs-underscore. 2023-10-06T02:57:00.574 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-06T02:57:00.579 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-06T02:57:00.591 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-06T02:57:00.621 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:57:00.657 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:57:00.686 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-joblib. 2023-10-06T02:57:00.704 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-06T02:57:00.707 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-06T02:57:00.725 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-06T02:57:00.743 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-06T02:57:00.757 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-06T02:57:00.890 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-06T02:57:00.907 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-06T02:57:00.977 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-routes. 2023-10-06T02:57:00.982 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:57:00.995 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-06T02:57:01.009 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libjs-underscore. 2023-10-06T02:57:01.026 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-06T02:57:01.035 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-06T02:57:01.067 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:57:01.197 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-sklearn. 2023-10-06T02:57:01.214 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-06T02:57:01.255 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:01.301 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-routes. 2023-10-06T02:57:01.317 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-06T02:57:01.359 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-06T02:57:01.370 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-06T02:57:01.380 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-06T02:57:01.386 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-06T02:57:01.400 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:01.428 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:57:01.438 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:01.687 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-06T02:57:01.703 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:01.746 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:01.747 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-routes. 2023-10-06T02:57:01.765 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-06T02:57:02.036 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-volume. 2023-10-06T02:57:02.053 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:02.071 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-06T02:57:02.092 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:02.092 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-decorator. 2023-10-06T02:57:02.094 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:02.112 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-06T02:57:02.125 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-06T02:57:02.129 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:02.142 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:02.150 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:57:02.183 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:02.241 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-decorator. 2023-10-06T02:57:02.258 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-06T02:57:02.299 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:57:02.453 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-06T02:57:02.473 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-06T02:57:02.511 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:57:02.524 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-06T02:57:02.544 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:02.591 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:02.602 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-06T02:57:02.621 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-06T02:57:02.659 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:57:02.686 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-decorator. 2023-10-06T02:57:02.702 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-06T02:57:02.744 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:57:02.830 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-scipy. 2023-10-06T02:57:02.849 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-06T02:57:02.888 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-06T02:57:02.952 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-colorama. 2023-10-06T02:57:02.968 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-06T02:57:03.004 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-scipy. 2023-10-06T02:57:03.010 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-06T02:57:03.022 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-06T02:57:03.047 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-06T02:57:03.062 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-06T02:57:03.063 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-06T02:57:03.105 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:57:03.233 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephfs-shell. 2023-10-06T02:57:03.250 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:03.283 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:03.324 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cachetools. 2023-10-06T02:57:03.341 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-06T02:57:03.382 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-06T02:57:03.458 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-scipy. 2023-10-06T02:57:03.474 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-06T02:57:03.515 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-06T02:57:03.543 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephfs-top. 2023-10-06T02:57:03.561 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:03.601 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:03.702 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-06T02:57:03.718 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-06T02:57:03.760 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:57:03.837 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-06T02:57:03.855 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:03.902 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:04.138 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-06T02:57:04.157 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-06T02:57:04.172 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-06T02:57:04.190 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-06T02:57:04.196 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:57:04.230 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:04.334 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-06T02:57:04.351 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-06T02:57:04.392 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:04.439 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-06T02:57:04.457 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:04.497 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:04.533 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rsa. 2023-10-06T02:57:04.549 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-06T02:57:04.590 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-06T02:57:04.776 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-joblib. 2023-10-06T02:57:04.792 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-06T02:57:04.825 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-06T02:57:04.833 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-06T02:57:04.842 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-06T02:57:04.882 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:04.908 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package nvme-cli. 2023-10-06T02:57:04.921 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-joblib. 2023-10-06T02:57:04.926 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-06T02:57:04.937 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-06T02:57:04.952 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-google-auth. 2023-10-06T02:57:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-06T02:57:04.970 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-06T02:57:04.984 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:57:05.010 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-06T02:57:05.195 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-sklearn. 2023-10-06T02:57:05.211 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-06T02:57:05.253 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:05.339 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-06T02:57:05.341 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-sklearn. 2023-10-06T02:57:05.357 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:05.361 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-06T02:57:05.363 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-blinker. 2023-10-06T02:57:05.379 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-06T02:57:05.397 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:05.399 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:05.446 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:57:05.452 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-joblib. 2023-10-06T02:57:05.472 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-06T02:57:05.510 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-06T02:57:05.774 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-06T02:57:05.790 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-06T02:57:05.831 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:57:05.864 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-sklearn. 2023-10-06T02:57:05.882 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-06T02:57:05.912 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-06T02:57:05.921 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:05.928 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:05.970 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:06.125 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-06T02:57:06.143 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:06.183 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:06.210 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-06T02:57:06.228 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-06T02:57:06.268 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:57:06.654 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-06T02:57:06.671 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:06.712 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:06.731 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-websocket. 2023-10-06T02:57:06.747 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-06T02:57:06.790 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:57:07.064 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cachetools. 2023-10-06T02:57:07.082 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-06T02:57:07.084 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-06T02:57:07.099 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-06T02:57:07.122 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-06T02:57:07.126 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-06T02:57:07.136 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-06T02:57:07.144 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-06T02:57:07.184 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:57:07.344 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cachetools. 2023-10-06T02:57:07.364 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-06T02:57:07.402 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-06T02:57:07.433 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-06T02:57:07.451 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-06T02:57:07.456 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-06T02:57:07.474 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-06T02:57:07.492 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:57:07.514 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:57:07.739 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-06T02:57:07.757 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-06T02:57:07.782 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-06T02:57:07.790 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cachetools. 2023-10-06T02:57:07.796 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:57:07.798 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:07.807 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-06T02:57:07.811 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-06T02:57:07.828 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-06T02:57:07.840 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:07.842 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-attr. 2023-10-06T02:57:07.848 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-06T02:57:07.859 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-06T02:57:07.870 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:57:07.901 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-06T02:57:08.125 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-06T02:57:08.141 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-06T02:57:08.175 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-06T02:57:08.181 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rsa. 2023-10-06T02:57:08.183 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:57:08.192 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-06T02:57:08.196 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-06T02:57:08.198 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-06T02:57:08.210 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-06T02:57:08.220 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-webencodings. 2023-10-06T02:57:08.233 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:57:08.238 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-06T02:57:08.239 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-06T02:57:08.284 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:57:08.286 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:57:08.528 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rsa. 2023-10-06T02:57:08.544 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-06T02:57:08.570 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-06T02:57:08.584 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-google-auth. 2023-10-06T02:57:08.586 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-06T02:57:08.587 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-06T02:57:08.589 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-html5lib. 2023-10-06T02:57:08.600 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-06T02:57:08.606 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-06T02:57:08.628 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:57:08.642 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-06T02:57:08.647 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-06T02:57:08.670 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-06T02:57:08.687 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:57:08.728 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:08.881 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-google-auth. 2023-10-06T02:57:08.901 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-06T02:57:08.939 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-06T02:57:08.945 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-blinker. 2023-10-06T02:57:08.947 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-rsa. 2023-10-06T02:57:08.965 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-06T02:57:08.966 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-06T02:57:09.003 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:57:09.017 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-06T02:57:09.029 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-06T02:57:09.035 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-06T02:57:09.065 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package jq. 2023-10-06T02:57:09.066 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:57:09.081 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:57:09.123 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:09.268 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-blinker. 2023-10-06T02:57:09.284 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-06T02:57:09.297 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-06T02:57:09.317 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-06T02:57:09.325 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-google-auth. 2023-10-06T02:57:09.342 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-06T02:57:09.351 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:57:09.355 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:57:09.383 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-06T02:57:09.405 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package socat. 2023-10-06T02:57:09.422 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-06T02:57:09.462 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-06T02:57:09.520 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-packaging. 2023-10-06T02:57:09.538 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-06T02:57:09.578 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-06T02:57:09.637 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-06T02:57:09.657 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-06T02:57:09.676 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-06T02:57:09.695 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:57:09.695 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-06T02:57:09.711 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-blinker. 2023-10-06T02:57:09.727 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-06T02:57:09.734 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:57:09.769 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:57:09.792 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package xmlstarlet. 2023-10-06T02:57:09.808 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-06T02:57:09.866 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:57:09.906 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pastescript. 2023-10-06T02:57:09.922 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-06T02:57:09.964 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-06T02:57:10.024 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-06T02:57:10.040 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-06T02:57:10.082 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:57:10.097 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-06T02:57:10.117 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-06T02:57:10.131 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-websocket. 2023-10-06T02:57:10.147 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-06T02:57:10.155 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:57:10.189 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:57:10.238 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-test. 2023-10-06T02:57:10.254 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:10.295 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:10.317 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pluggy. 2023-10-06T02:57:10.334 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-06T02:57:10.375 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-06T02:57:10.483 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-06T02:57:10.499 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-06T02:57:10.504 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-websocket. 2023-10-06T02:57:10.523 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-06T02:57:10.534 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-06T02:57:10.541 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:57:10.551 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-06T02:57:10.562 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:57:10.601 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:57:10.703 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-psutil. 2023-10-06T02:57:10.721 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-06T02:57:10.761 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:57:10.874 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-06T02:57:10.891 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-06T02:57:10.941 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:57:10.963 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-websocket. 2023-10-06T02:57:10.979 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-06T02:57:11.021 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:57:11.076 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-py. 2023-10-06T02:57:11.096 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-06T02:57:11.133 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:57:11.156 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-06T02:57:11.174 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:11.222 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:11.341 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-06T02:57:11.358 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-06T02:57:11.399 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:57:11.487 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-06T02:57:11.503 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-06T02:57:11.542 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-06T02:57:11.544 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:57:11.547 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-06T02:57:11.559 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-06T02:57:11.566 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:11.605 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:11.609 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:57:11.830 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pytest. 2023-10-06T02:57:11.847 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-06T02:57:11.922 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-06T02:57:11.950 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-06T02:57:11.962 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-06T02:57:11.962 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-06T02:57:11.967 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-06T02:57:11.979 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:57:11.981 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:12.008 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:57:12.020 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:12.020 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:12.259 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-simplejson. 2023-10-06T02:57:12.278 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-06T02:57:12.317 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:57:12.323 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package jq. 2023-10-06T02:57:12.340 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-06T02:57:12.341 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:57:12.356 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-06T02:57:12.372 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:12.378 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-06T02:57:12.395 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:57:12.398 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:57:12.436 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:12.602 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-06T02:57:12.622 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-06T02:57:12.642 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package socat. 2023-10-06T02:57:12.652 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:57:12.659 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-06T02:57:12.700 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-06T02:57:12.714 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package jq. 2023-10-06T02:57:12.733 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:57:12.734 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-06T02:57:12.753 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:57:12.772 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:12.792 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:13.013 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package xmlstarlet. 2023-10-06T02:57:13.025 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package socat. 2023-10-06T02:57:13.030 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-06T02:57:13.042 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-06T02:57:13.061 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:57:13.087 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package jq. 2023-10-06T02:57:13.105 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:57:13.108 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-06T02:57:13.145 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:13.397 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package socat. 2023-10-06T02:57:13.414 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-06T02:57:13.428 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package xmlstarlet. 2023-10-06T02:57:13.439 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-test. 2023-10-06T02:57:13.444 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-06T02:57:13.455 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-06T02:57:13.455 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:13.486 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:57:13.497 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:13.748 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package radosgw. 2023-10-06T02:57:13.754 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package xmlstarlet. 2023-10-06T02:57:13.769 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../114-radosgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:13.770 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-06T02:57:13.783 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-test. 2023-10-06T02:57:13.802 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:13.806 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:13.837 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:57:13.841 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:14.174 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-test. 2023-10-06T02:57:14.191 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:14.232 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:15.399 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-volume. 2023-10-06T02:57:15.417 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:15.466 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:15.493 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package rbd-fuse. 2023-10-06T02:57:15.511 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:15.587 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:15.889 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-06T02:57:15.904 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-06T02:57:15.922 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:15.996 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:16.201 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:57:16.327 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:57:16.454 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:57:16.653 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:16.782 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-colorama. 2023-10-06T02:57:16.799 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-06T02:57:16.849 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-06T02:57:17.145 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephfs-shell. 2023-10-06T02:57:17.162 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:17.203 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:17.241 INFO:teuthology.orchestra.run.smithi174.stdout:Adding system user cephadm....done 2023-10-06T02:57:17.419 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:17.466 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephfs-top. 2023-10-06T02:57:17.482 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:17.524 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:17.545 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:57:17.810 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-06T02:57:17.827 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:17.893 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:17.897 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-06T02:57:18.223 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:18.349 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-06T02:57:18.445 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-06T02:57:18.462 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:18.475 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:57:18.503 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:18.542 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-volume. 2023-10-06T02:57:18.559 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:18.600 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:18.787 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-volume. 2023-10-06T02:57:18.803 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:18.845 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:18.884 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-06T02:57:18.981 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package nvme-cli. 2023-10-06T02:57:18.998 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-06T02:57:19.057 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:57:19.239 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-06T02:57:19.250 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-06T02:57:19.256 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:19.267 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:19.295 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:57:19.297 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:19.308 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:19.370 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-volume. 2023-10-06T02:57:19.389 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:19.419 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-06T02:57:19.427 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:19.440 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:19.502 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:19.579 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-06T02:57:19.617 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-colorama. 2023-10-06T02:57:19.634 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-06T02:57:19.675 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-06T02:57:19.778 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-colorama. 2023-10-06T02:57:19.795 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-06T02:57:19.836 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-06T02:57:19.849 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-06T02:57:19.865 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:19.872 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-06T02:57:19.907 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:19.961 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephfs-shell. 2023-10-06T02:57:19.978 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:20.011 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:20.082 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package cephfs-shell. 2023-10-06T02:57:20.099 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:20.131 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:20.156 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:57:20.260 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-colorama. 2023-10-06T02:57:20.264 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephfs-top. 2023-10-06T02:57:20.280 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:20.281 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-06T02:57:20.318 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-06T02:57:20.322 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:20.351 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package cephfs-top. 2023-10-06T02:57:20.370 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:20.409 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:20.449 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:57:20.575 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-06T02:57:20.592 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:20.614 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package cephfs-shell. 2023-10-06T02:57:20.631 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:20.632 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:20.672 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:20.691 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-06T02:57:20.707 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:20.725 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:20.749 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:20.926 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package cephfs-top. 2023-10-06T02:57:20.944 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:20.986 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:21.043 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:21.156 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-06T02:57:21.165 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-06T02:57:21.168 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-06T02:57:21.174 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-06T02:57:21.185 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:21.203 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-06T02:57:21.214 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-06T02:57:21.215 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-06T02:57:21.222 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:21.223 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:21.231 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:21.261 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:21.280 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:21.453 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:57:21.525 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-06T02:57:21.545 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-06T02:57:21.600 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:57:21.610 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package nvme-cli. 2023-10-06T02:57:21.627 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-06T02:57:21.664 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package nvme-cli. 2023-10-06T02:57:21.682 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-06T02:57:21.693 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:57:21.739 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:57:21.745 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:57:21.767 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-06T02:57:21.783 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:21.825 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:21.928 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-attr. 2023-10-06T02:57:21.946 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-06T02:57:21.986 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-06T02:57:22.039 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:57:22.061 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-06T02:57:22.064 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-06T02:57:22.081 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:22.082 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:22.118 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:22.122 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:22.164 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:57:22.218 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package nvme-cli. 2023-10-06T02:57:22.235 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-06T02:57:22.293 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:57:22.355 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-webencodings. 2023-10-06T02:57:22.374 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-06T02:57:22.430 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:57:22.559 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-06T02:57:22.639 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-06T02:57:22.655 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:22.697 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:22.742 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-html5lib. 2023-10-06T02:57:22.761 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-06T02:57:22.800 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-06T02:57:22.869 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:57:23.137 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:57:23.137 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-06T02:57:23.154 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-06T02:57:23.228 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:57:23.505 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:57:23.753 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-06T02:57:23.773 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-packaging. 2023-10-06T02:57:23.775 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-06T02:57:23.789 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-06T02:57:23.791 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-06T02:57:23.811 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-06T02:57:23.831 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-06T02:57:23.845 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-06T02:57:23.863 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-06T02:57:23.903 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-06T02:57:24.115 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-06T02:57:24.139 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-06T02:57:24.157 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-06T02:57:24.159 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pastescript. 2023-10-06T02:57:24.180 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-06T02:57:24.206 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:57:24.256 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-06T02:57:24.259 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-06T02:57:24.276 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-06T02:57:24.314 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:57:24.388 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-06T02:57:24.401 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-06T02:57:24.407 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-06T02:57:24.462 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-06T02:57:24.508 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-attr. 2023-10-06T02:57:24.526 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-06T02:57:24.566 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-06T02:57:24.604 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pluggy. 2023-10-06T02:57:24.622 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-06T02:57:24.625 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-attr. 2023-10-06T02:57:24.643 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-06T02:57:24.662 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-06T02:57:24.683 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-06T02:57:24.706 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:57:24.765 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-06T02:57:24.785 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-06T02:57:24.823 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:57:24.831 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:57:24.920 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webencodings. 2023-10-06T02:57:24.937 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-06T02:57:24.957 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:57:24.977 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:57:25.012 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-webencodings. 2023-10-06T02:57:25.028 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-06T02:57:25.040 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-psutil. 2023-10-06T02:57:25.060 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-06T02:57:25.070 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:57:25.098 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:57:25.118 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-attr. 2023-10-06T02:57:25.137 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-06T02:57:25.175 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-06T02:57:25.241 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:57:25.280 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-html5lib. 2023-10-06T02:57:25.299 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-06T02:57:25.338 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-06T02:57:25.389 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-html5lib. 2023-10-06T02:57:25.410 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-06T02:57:25.447 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-06T02:57:25.480 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-py. 2023-10-06T02:57:25.496 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-06T02:57:25.520 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-webencodings. 2023-10-06T02:57:25.539 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-06T02:57:25.563 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:57:25.577 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:57:25.676 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:57:25.717 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-06T02:57:25.734 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-06T02:57:25.775 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:57:25.784 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-06T02:57:25.803 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-06T02:57:25.842 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:57:25.880 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-html5lib. 2023-10-06T02:57:25.901 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-06T02:57:25.907 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-06T02:57:25.924 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-06T02:57:25.938 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-06T02:57:25.960 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:57:25.965 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:57:26.221 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-packaging. 2023-10-06T02:57:26.241 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-06T02:57:26.275 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-06T02:57:26.278 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-06T02:57:26.292 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-06T02:57:26.312 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:57:26.313 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-packaging. 2023-10-06T02:57:26.334 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-06T02:57:26.351 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pytest. 2023-10-06T02:57:26.358 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:57:26.368 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-06T02:57:26.371 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-06T02:57:26.418 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-06T02:57:26.606 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pastescript. 2023-10-06T02:57:26.626 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-06T02:57:26.666 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pastescript. 2023-10-06T02:57:26.673 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-06T02:57:26.674 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-06T02:57:26.686 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-06T02:57:26.724 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-06T02:57:26.800 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:26.820 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-packaging. 2023-10-06T02:57:26.830 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-simplejson. 2023-10-06T02:57:26.836 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-06T02:57:26.847 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-06T02:57:26.878 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-06T02:57:26.905 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:57:26.985 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pluggy. 2023-10-06T02:57:27.006 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-06T02:57:27.042 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-06T02:57:27.077 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pluggy. 2023-10-06T02:57:27.095 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-06T02:57:27.135 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-06T02:57:27.143 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:27.189 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pastescript. 2023-10-06T02:57:27.207 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-06T02:57:27.224 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-06T02:57:27.242 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-06T02:57:27.246 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-06T02:57:27.269 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-06T02:57:27.282 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:57:27.337 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-psutil. 2023-10-06T02:57:27.358 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-06T02:57:27.395 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:57:27.456 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-psutil. 2023-10-06T02:57:27.475 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-06T02:57:27.514 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:57:27.592 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pluggy. 2023-10-06T02:57:27.603 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:57:27.609 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-06T02:57:27.650 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-06T02:57:27.741 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-py. 2023-10-06T02:57:27.754 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:57:27.759 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-06T02:57:27.799 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:57:27.851 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-py. 2023-10-06T02:57:27.869 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-06T02:57:27.880 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-06T02:57:27.927 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:57:27.937 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-psutil. 2023-10-06T02:57:27.957 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-06T02:57:27.994 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:57:28.127 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-06T02:57:28.144 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-06T02:57:28.153 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package radosgw. 2023-10-06T02:57:28.164 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:57:28.171 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../114-radosgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:28.176 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:57:28.236 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:28.237 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-06T02:57:28.258 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-06T02:57:28.295 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:57:28.356 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-py. 2023-10-06T02:57:28.374 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-06T02:57:28.413 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:57:28.474 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pytest. 2023-10-06T02:57:28.521 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-06T02:57:28.562 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-06T02:57:28.585 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pytest. 2023-10-06T02:57:28.600 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:57:28.606 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-06T02:57:28.643 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-06T02:57:28.726 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:57:28.727 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-06T02:57:28.746 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-06T02:57:28.786 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:57:28.903 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-simplejson. 2023-10-06T02:57:28.920 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-06T02:57:28.961 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:57:29.016 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-simplejson. 2023-10-06T02:57:29.033 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-06T02:57:29.052 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:57:29.074 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:57:29.080 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pytest. 2023-10-06T02:57:29.101 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-06T02:57:29.138 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-06T02:57:29.231 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-06T02:57:29.250 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-06T02:57:29.288 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:57:29.320 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-06T02:57:29.343 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-06T02:57:29.360 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-06T02:57:29.401 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:57:29.509 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-simplejson. 2023-10-06T02:57:29.529 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-06T02:57:29.567 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:57:29.613 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:57:29.739 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:57:29.844 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-06T02:57:29.863 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-06T02:57:29.902 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:57:29.990 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package rbd-fuse. 2023-10-06T02:57:30.007 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:30.024 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-06T02:57:30.035 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package radosgw. 2023-10-06T02:57:30.052 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../114-radosgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:30.089 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:30.092 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:30.165 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package radosgw. 2023-10-06T02:57:30.181 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../114-radosgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:30.222 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:30.316 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:57:30.422 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-06T02:57:30.608 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:57:30.673 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package radosgw. 2023-10-06T02:57:30.691 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../114-radosgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:30.723 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:57:30.731 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:30.874 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:57:30.950 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-06T02:57:31.001 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:57:31.219 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:57:31.234 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:31.356 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:57:31.688 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:57:31.854 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package rbd-fuse. 2023-10-06T02:57:31.871 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:31.912 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:31.939 INFO:teuthology.orchestra.run.smithi123.stdout:Adding system user cephadm....done 2023-10-06T02:57:31.959 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package rbd-fuse. 2023-10-06T02:57:31.978 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:32.017 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:32.048 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:57:32.100 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:32.173 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:57:32.215 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-06T02:57:32.260 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:57:32.299 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-06T02:57:32.327 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-06T02:57:32.427 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package rbd-fuse. 2023-10-06T02:57:32.444 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:32.484 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:32.526 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:57:32.611 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-06T02:57:32.642 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:57:32.648 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:57:32.652 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:57:32.749 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:57:32.778 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:57:32.787 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-06T02:57:32.872 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:57:32.927 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librados2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:32.937 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:32.967 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:33.047 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-06T02:57:33.052 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-06T02:57:33.065 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:33.067 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:57:33.214 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:57:33.218 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:57:33.344 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:57:33.541 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-06T02:57:33.546 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:33.629 INFO:teuthology.orchestra.run.smithi027.stdout:Adding system user cephadm....done 2023-10-06T02:57:33.677 INFO:teuthology.orchestra.run.smithi158.stdout:Adding system user cephadm....done 2023-10-06T02:57:33.792 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:33.847 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:33.917 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:57:33.959 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:57:33.976 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:57:34.183 INFO:teuthology.orchestra.run.smithi124.stdout:Adding system user cephadm....done 2023-10-06T02:57:34.286 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-06T02:57:34.304 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-06T02:57:34.311 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-06T02:57:34.344 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:34.470 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:57:34.499 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:34.546 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-06T02:57:34.588 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:34.603 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:34.625 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:34.714 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-06T02:57:34.729 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-06T02:57:34.761 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-06T02:57:34.822 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-06T02:57:34.830 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:57:34.849 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:57:34.856 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:57:35.123 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:57:35.136 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-06T02:57:35.140 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:35.183 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-06T02:57:35.183 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-06T02:57:35.265 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-06T02:57:35.391 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:57:35.424 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:35.437 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:57:35.560 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:57:35.636 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:57:35.716 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:35.717 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-06T02:57:35.738 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:35.844 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-06T02:57:35.864 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-06T02:57:35.867 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-06T02:57:35.920 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-06T02:57:36.128 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:57:36.137 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-06T02:57:36.177 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:57:36.230 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-06T02:57:36.257 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:36.383 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:57:36.421 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-06T02:57:36.439 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:57:36.470 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:57:36.531 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:57:36.701 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:36.722 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-06T02:57:36.723 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:57:36.738 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:57:36.832 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:57:36.852 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:57:36.889 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:57:36.991 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:37.039 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:57:37.150 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:37.170 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:37.267 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-06T02:57:37.280 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:37.332 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:57:37.402 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-06T02:57:37.426 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:37.551 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-06T02:57:37.586 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:57:37.633 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:37.686 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:57:37.819 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:57:37.901 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:37.912 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:57:37.971 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:57:38.060 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-06T02:57:38.120 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:57:38.183 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librbd1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:38.229 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:57:38.264 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:57:38.309 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:57:38.336 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:57:38.390 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:57:38.396 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:57:38.435 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-06T02:57:38.505 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-06T02:57:38.522 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:57:38.561 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:38.612 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:57:38.687 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-06T02:57:38.749 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-06T02:57:38.840 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-06T02:57:38.896 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:57:38.898 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-06T02:57:38.988 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:57:39.009 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:57:39.047 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:57:39.114 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-06T02:57:39.149 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-06T02:57:39.191 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:57:39.286 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:57:39.415 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-06T02:57:39.476 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:57:39.495 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:57:39.534 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:39.596 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:57:39.637 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:57:39.668 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:39.716 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:57:39.747 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:57:39.819 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:57:39.894 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:57:39.894 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:57:39.921 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-06T02:57:40.009 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:57:40.103 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-06T02:57:40.249 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-06T02:57:40.345 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:40.377 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:57:40.438 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-06T02:57:40.450 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:57:40.495 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:57:40.510 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-06T02:57:40.663 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-06T02:57:40.722 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-06T02:57:40.772 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-06T02:57:40.809 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:57:40.811 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:57:40.938 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:57:40.998 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-06T02:57:41.034 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:57:41.097 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:57:41.115 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:57:41.160 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:57:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:57:41.274 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-06T02:57:41.286 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:57:41.382 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:57:41.476 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:41.544 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-06T02:57:41.575 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:57:41.579 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:57:41.602 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:41.674 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:41.701 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:57:41.755 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:41.758 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:57:41.852 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:57:41.881 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:41.997 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:57:41.999 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:42.000 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:42.055 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:57:42.100 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-06T02:57:42.136 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:57:42.168 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-06T02:57:42.299 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:57:42.376 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-06T02:57:42.423 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:57:42.528 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:57:42.549 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:57:42.662 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:57:42.667 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:57:42.678 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:42.763 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-06T02:57:42.792 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-06T02:57:42.803 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:42.833 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:57:42.918 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:42.954 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:43.022 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-06T02:57:43.080 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:57:43.116 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:57:43.148 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:43.218 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:57:43.244 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:43.379 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-06T02:57:43.441 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:43.466 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:43.567 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:57:43.586 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-06T02:57:43.600 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-06T02:57:43.712 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:43.726 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:57:43.732 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:57:43.867 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:57:43.943 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:57:43.984 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:43.993 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-06T02:57:44.038 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:44.053 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:57:44.069 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:57:44.173 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-06T02:57:44.195 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-06T02:57:44.278 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:57:44.362 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-06T02:57:44.490 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:57:44.534 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:57:44.571 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:44.660 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:57:44.696 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:57:44.722 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:57:44.802 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-06T02:57:44.806 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:57:44.842 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:44.855 INFO:teuthology.orchestra.run.smithi174.stdout:Adding group ceph....done 2023-10-06T02:57:44.856 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:57:44.951 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:57:45.070 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:57:45.076 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:57:45.082 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-06T02:57:45.183 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:57:45.240 INFO:teuthology.orchestra.run.smithi174.stdout:Adding system user ceph....done 2023-10-06T02:57:45.363 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:45.383 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:57:45.411 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:57:45.433 INFO:teuthology.orchestra.run.smithi174.stdout:Setting system user ceph properties....done 2023-10-06T02:57:45.457 INFO:teuthology.orchestra.run.smithi174.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-06T02:57:45.476 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-06T02:57:45.489 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:57:45.611 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-06T02:57:45.615 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:57:45.687 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-06T02:57:45.751 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:57:45.760 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:57:45.886 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:57:45.926 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-06T02:57:45.958 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:57:46.014 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:57:46.136 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-06T02:57:46.139 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:57:46.170 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-06T02:57:46.242 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-06T02:57:46.387 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:46.395 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:57:46.415 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-06T02:57:46.455 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:57:46.535 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:57:46.554 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:57:46.603 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:57:46.603 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:57:46.686 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:57:46.759 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:57:46.781 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:57:46.880 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:57:46.962 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-06T02:57:47.035 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:57:47.038 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:47.178 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-06T02:57:47.190 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:47.254 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:57:47.410 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-06T02:57:47.415 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:57:47.417 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:57:47.450 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:57:47.450 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:57:47.541 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:57:47.547 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:57:47.568 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:57:47.662 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:57:47.693 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-06T02:57:47.821 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:57:47.903 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:57:48.001 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:57:48.012 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-06T02:57:48.084 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:48.131 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:57:48.241 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:57:48.271 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:57:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librados2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:48.367 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:57:48.431 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:57:48.453 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-06T02:57:48.456 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-06T02:57:48.507 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:57:48.557 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-06T02:57:48.660 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:57:48.676 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:57:48.776 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-06T02:57:48.891 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:57:48.894 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:49.036 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:57:49.110 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:57:49.141 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:57:49.141 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:57:49.145 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:57:49.184 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librados2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:49.271 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-06T02:57:49.310 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-06T02:57:49.395 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librados2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:49.529 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-06T02:57:49.590 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:49.597 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:57:49.881 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up librados2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:49.909 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:49.909 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:57:49.910 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:57:50.007 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-06T02:57:50.076 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:50.203 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-06T02:57:50.331 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:50.612 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-06T02:57:50.814 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:57:50.814 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:57:50.908 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:50.913 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:57:51.034 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:51.160 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-06T02:57:51.176 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:51.223 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:51.266 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:51.302 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:51.382 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-06T02:57:51.420 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:51.428 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-06T02:57:51.471 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:51.568 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:51.570 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-06T02:57:51.597 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:51.708 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:51.722 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-06T02:57:51.792 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:57:51.792 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:57:51.805 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-06T02:57:51.850 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:57:51.871 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:57:52.099 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-06T02:57:52.114 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:57:52.164 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:52.261 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:52.290 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-06T02:57:52.328 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:57:52.390 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:52.404 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:52.408 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:57:52.530 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:52.541 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-06T02:57:52.666 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:52.672 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:52.679 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:52.693 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:52.792 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:57:52.799 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:57:52.819 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-06T02:57:52.876 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:52.951 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:57:53.002 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:57:53.127 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:53.153 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:53.253 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:57:53.254 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:57:53.260 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:57:53.329 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:53.480 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:57:53.588 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:53.597 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:53.709 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librbd1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:53.723 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:57:53.822 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:53.877 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:57:54.003 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-06T02:57:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:54.162 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:54.288 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-06T02:57:54.635 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librbd1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:54.640 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:57:54.761 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:57:54.774 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-06T02:57:54.886 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librbd1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:54.908 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-06T02:57:55.012 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:57:55.047 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:55.073 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up librbd1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:55.138 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-06T02:57:55.173 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-06T02:57:55.199 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:57:55.202 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:55.264 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:55.328 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:55.351 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-06T02:57:55.423 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-06T02:57:55.466 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:57:55.513 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:55.586 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:57:55.649 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:57:55.650 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-06T02:57:55.655 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-06T02:57:55.733 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:57:55.859 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-06T02:57:55.912 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:57:55.979 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:56.038 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-06T02:57:56.046 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:56.105 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:56.130 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-06T02:57:56.172 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:57:56.229 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:56.324 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:57:56.324 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:57:56.380 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:56.449 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:56.507 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-06T02:57:56.575 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:56.628 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:57:56.628 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:57:56.716 INFO:teuthology.orchestra.run.smithi174.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:57:56.719 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-06T02:57:56.740 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:56.793 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2023-10-06T02:57:56.800 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:57:56.800 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:57:56.825 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:57:56.891 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:57:56.997 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2023-10-06T02:57:56.998 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2023-10-06T02:57:57.098 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:57.164 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:57.192 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-06T02:57:57.197 INFO:teuthology.orchestra.run.smithi174.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-06T02:57:57.198 INFO:teuthology.orchestra.run.smithi174.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-06T02:57:57.198 INFO:teuthology.orchestra.run.smithi174.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-06T02:57:57.198 INFO:teuthology.orchestra.run.smithi174.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-06T02:57:57.198 INFO:teuthology.orchestra.run.smithi174.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-06T02:57:57.198 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:57:57.199 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:57:57.200 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:57:57.200 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2023-10-06T02:57:57.200 INFO:teuthology.orchestra.run.smithi174.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-06T02:57:57.200 INFO:teuthology.orchestra.run.smithi174.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-06T02:57:57.200 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-06T02:57:57.200 INFO:teuthology.orchestra.run.smithi174.stdout: usb-modeswitch-data wpasupplicant 2023-10-06T02:57:57.200 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2023-10-06T02:57:57.201 INFO:teuthology.orchestra.run.smithi174.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-06T02:57:57.201 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-06T02:57:57.224 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:57:57.243 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:57.252 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2023-10-06T02:57:57.253 INFO:teuthology.orchestra.run.smithi174.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-06T02:57:57.253 INFO:teuthology.orchestra.run.smithi174.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-06T02:57:57.253 INFO:teuthology.orchestra.run.smithi174.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-06T02:57:57.254 INFO:teuthology.orchestra.run.smithi174.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-06T02:57:57.255 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages will be upgraded: 2023-10-06T02:57:57.256 INFO:teuthology.orchestra.run.smithi174.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-06T02:57:57.331 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:57.378 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:57:57.457 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:57.462 INFO:teuthology.orchestra.run.smithi174.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-06T02:57:57.462 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 10.4 MB of archives. 2023-10-06T02:57:57.463 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-06T02:57:57.463 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-06T02:57:57.511 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:57:57.553 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-06T02:57:57.608 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:57.680 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-06T02:57:57.752 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:57.879 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:57:57.885 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-06T02:57:57.888 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:57.998 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:57:58.015 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.083 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-06T02:57:58.085 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-06T02:57:58.086 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-06T02:57:58.099 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-06T02:57:58.101 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-06T02:57:58.141 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.195 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-06T02:57:58.199 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-06T02:57:58.202 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-06T02:57:58.208 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-06T02:57:58.214 INFO:teuthology.orchestra.run.smithi174.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-06T02:57:58.214 INFO:teuthology.orchestra.run.smithi174.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-06T02:57:58.259 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.267 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.350 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.381 INFO:teuthology.orchestra.run.smithi174.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-06T02:57:58.391 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.392 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.484 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.517 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.518 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-06T02:57:58.571 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.627 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.643 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.650 INFO:teuthology.orchestra.run.smithi174.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-06T02:57:58.697 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.753 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.777 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.778 INFO:teuthology.orchestra.run.smithi174.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-06T02:57:58.784 INFO:teuthology.orchestra.run.smithi174.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-06T02:57:58.837 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-06T02:57:58.856 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.879 INFO:teuthology.orchestra.run.smithi174.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-06T02:57:58.880 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:58.883 INFO:teuthology.orchestra.run.smithi174.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-06T02:57:58.903 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-06T02:57:58.966 INFO:teuthology.orchestra.run.smithi174.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-06T02:57:58.982 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:57:59.006 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-06T02:57:59.040 INFO:teuthology.orchestra.run.smithi174.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-06T02:57:59.040 INFO:teuthology.orchestra.run.smithi174.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-06T02:57:59.129 INFO:teuthology.orchestra.run.smithi174.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-06T02:57:59.129 INFO:teuthology.orchestra.run.smithi174.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-06T02:57:59.141 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:59.268 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:59.323 INFO:teuthology.orchestra.run.smithi174.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-06T02:57:59.334 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-06T02:57:59.354 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-06T02:57:59.394 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:59.519 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:57:59.636 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:59.673 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:59.762 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:59.799 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:59.880 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:59.919 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:59.938 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:59.961 INFO:teuthology.orchestra.run.smithi174.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-06T02:58:00.006 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:58:00.045 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:58:00.074 INFO:teuthology.orchestra.run.smithi174.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-06T02:58:00.090 INFO:teuthology.orchestra.run.smithi174.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-06T02:58:00.091 INFO:teuthology.orchestra.run.smithi174.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-06T02:58:00.093 INFO:teuthology.orchestra.run.smithi174.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-06T02:58:00.094 INFO:teuthology.orchestra.run.smithi174.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-06T02:58:00.419 INFO:teuthology.orchestra.run.smithi174.stdout:Preconfiguring packages ... 2023-10-06T02:58:00.448 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:00.532 INFO:teuthology.orchestra.run.smithi123.stdout:Adding group ceph....done 2023-10-06T02:58:00.551 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 10.4 MB in 3s (3,685 kB/s) 2023-10-06T02:58:00.839 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:00.844 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:00.944 INFO:teuthology.orchestra.run.smithi123.stdout:Adding system user ceph....done 2023-10-06T02:58:00.951 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:01.006 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:01.023 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:01.035 INFO:teuthology.orchestra.run.smithi158.stdout:Adding group ceph....done 2023-10-06T02:58:01.120 INFO:teuthology.orchestra.run.smithi123.stdout:Setting system user ceph properties....done 2023-10-06T02:58:01.171 INFO:teuthology.orchestra.run.smithi123.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-06T02:58:01.316 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-06T02:58:01.430 INFO:teuthology.orchestra.run.smithi158.stdout:Adding system user ceph....done 2023-10-06T02:58:01.546 INFO:teuthology.orchestra.run.smithi124.stdout:Adding group ceph....done 2023-10-06T02:58:01.593 INFO:teuthology.orchestra.run.smithi027.stdout:Adding group ceph....done 2023-10-06T02:58:01.607 INFO:teuthology.orchestra.run.smithi158.stdout:Setting system user ceph properties....done 2023-10-06T02:58:01.624 INFO:teuthology.orchestra.run.smithi158.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-06T02:58:01.627 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-06T02:58:01.769 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-06T02:58:01.950 INFO:teuthology.orchestra.run.smithi124.stdout:Adding system user ceph....done 2023-10-06T02:58:01.969 INFO:teuthology.orchestra.run.smithi027.stdout:Adding system user ceph....done 2023-10-06T02:58:02.066 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-06T02:58:02.101 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:02.143 INFO:teuthology.orchestra.run.smithi124.stdout:Setting system user ceph properties....done 2023-10-06T02:58:02.162 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:02.165 INFO:teuthology.orchestra.run.smithi124.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-06T02:58:02.170 INFO:teuthology.orchestra.run.smithi027.stdout:Setting system user ceph properties....done 2023-10-06T02:58:02.192 INFO:teuthology.orchestra.run.smithi027.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-06T02:58:02.315 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-06T02:58:02.343 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-06T02:58:02.352 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:58:02.353 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:58:02.512 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:02.627 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-06T02:58:02.675 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-06T02:58:02.729 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:58:02.729 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:58:02.819 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:02.967 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:03.080 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:03.142 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:03.163 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:03.235 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:58:03.236 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:58:03.303 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:58:03.303 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:58:03.323 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:03.365 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:58:03.365 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:58:03.578 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:58:03.578 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:58:03.598 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:03.602 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:03.715 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:03.728 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:03.828 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:03.841 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:03.913 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:03.954 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:04.134 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:04.141 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:58:04.141 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:58:04.225 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:04.255 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:58:04.255 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:58:04.317 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:04.323 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-06T02:58:04.607 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-06T02:58:04.645 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:04.785 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:04.798 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:04.923 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:05.040 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:58:05.040 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:58:05.051 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:05.159 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-06T02:58:05.192 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:05.196 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:05.299 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:58:05.299 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:58:05.337 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-06T02:58:05.483 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:05.492 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:58:05.603 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:05.720 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:05.741 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:58:05.741 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:58:05.783 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:05.838 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:58:05.838 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:58:05.922 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:05.937 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:58:05.938 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:58:06.021 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:58:06.021 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:58:06.080 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:58:06.184 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:06.273 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:06.357 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:06.468 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:06.502 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:58:06.502 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:58:06.562 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:58:06.673 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:58:06.674 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:58:06.699 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:58:06.700 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:58:06.718 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-06T02:58:06.858 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:58:06.858 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:58:06.975 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:07.119 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:07.153 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:07.255 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-06T02:58:07.270 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:07.272 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-06T02:58:07.284 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:07.313 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:58:07.410 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:07.438 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:07.461 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:58:07.461 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:58:07.545 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:07.649 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package dump. 2023-10-06T02:58:07.657 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:58:07.657 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:58:07.667 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-06T02:58:07.708 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking dump (0.4b46-6) ... 2023-10-06T02:58:07.756 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:58:07.756 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:58:07.762 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:58:07.762 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:58:07.910 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.045 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package indent. 2023-10-06T02:58:08.045 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.065 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:58:08.103 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:58:08.138 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.188 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.212 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.232 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.265 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.364 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.374 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.399 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.413 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:58:08.413 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:58:08.464 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-06T02:58:08.485 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-06T02:58:08.490 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.522 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:58:08.525 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.613 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:58:08.613 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:58:08.632 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.668 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.760 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:58:08.818 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-06T02:58:08.836 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:58:08.837 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-06T02:58:08.855 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.867 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:58:08.920 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:58:08.998 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:09.021 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:58:09.075 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:09.124 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:09.144 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-06T02:58:09.162 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:09.203 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:09.204 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:58:09.210 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:09.267 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:09.314 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:58:09.336 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:09.394 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:58:09.479 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:09.545 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:58:09.547 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-06T02:58:09.568 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:09.605 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:09.606 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:58:09.778 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:58:09.814 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:58:09.916 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-06T02:58:09.933 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:09.974 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:10.083 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:58:10.327 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-06T02:58:10.344 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:10.385 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:11.165 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-06T02:58:11.183 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-06T02:58:11.222 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:58:11.592 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-06T02:58:11.610 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:58:11.651 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:12.028 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-06T02:58:12.046 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:12.087 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:12.167 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-06T02:58:12.174 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-06T02:58:12.406 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-06T02:58:12.424 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:12.456 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:12.641 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-06T02:58:12.658 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:58:12.699 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:58:12.756 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-06T02:58:12.766 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-06T02:58:12.798 INFO:teuthology.orchestra.run.smithi158.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:58:12.800 DEBUG:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-06T02:58:12.831 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2023-10-06T02:58:12.869 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2023-10-06T02:58:12.954 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-06T02:58:13.037 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2023-10-06T02:58:13.037 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2023-10-06T02:58:13.070 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2023-10-06T02:58:13.071 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2023-10-06T02:58:13.161 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-06T02:58:13.181 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-06T02:58:13.219 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:58:13.235 INFO:teuthology.orchestra.run.smithi123.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-06T02:58:13.235 INFO:teuthology.orchestra.run.smithi123.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-06T02:58:13.236 INFO:teuthology.orchestra.run.smithi123.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-06T02:58:13.236 INFO:teuthology.orchestra.run.smithi123.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-06T02:58:13.236 INFO:teuthology.orchestra.run.smithi123.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-06T02:58:13.236 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:58:13.236 INFO:teuthology.orchestra.run.smithi123.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:58:13.236 INFO:teuthology.orchestra.run.smithi123.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:58:13.237 INFO:teuthology.orchestra.run.smithi123.stdout:The following additional packages will be installed: 2023-10-06T02:58:13.237 INFO:teuthology.orchestra.run.smithi123.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-06T02:58:13.237 INFO:teuthology.orchestra.run.smithi123.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-06T02:58:13.238 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-06T02:58:13.238 INFO:teuthology.orchestra.run.smithi123.stdout: usb-modeswitch-data wpasupplicant 2023-10-06T02:58:13.239 INFO:teuthology.orchestra.run.smithi123.stdout:Suggested packages: 2023-10-06T02:58:13.239 INFO:teuthology.orchestra.run.smithi123.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-06T02:58:13.239 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-06T02:58:13.271 INFO:teuthology.orchestra.run.smithi158.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-06T02:58:13.271 INFO:teuthology.orchestra.run.smithi158.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-06T02:58:13.271 INFO:teuthology.orchestra.run.smithi158.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-06T02:58:13.271 INFO:teuthology.orchestra.run.smithi158.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-06T02:58:13.271 INFO:teuthology.orchestra.run.smithi158.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-06T02:58:13.271 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:58:13.272 INFO:teuthology.orchestra.run.smithi158.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:58:13.272 INFO:teuthology.orchestra.run.smithi158.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:58:13.272 INFO:teuthology.orchestra.run.smithi158.stdout:The following additional packages will be installed: 2023-10-06T02:58:13.272 INFO:teuthology.orchestra.run.smithi158.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-06T02:58:13.272 INFO:teuthology.orchestra.run.smithi158.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-06T02:58:13.273 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-06T02:58:13.273 INFO:teuthology.orchestra.run.smithi158.stdout: usb-modeswitch-data wpasupplicant 2023-10-06T02:58:13.274 INFO:teuthology.orchestra.run.smithi158.stdout:Suggested packages: 2023-10-06T02:58:13.274 INFO:teuthology.orchestra.run.smithi158.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-06T02:58:13.274 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-06T02:58:13.287 INFO:teuthology.orchestra.run.smithi123.stdout:The following NEW packages will be installed: 2023-10-06T02:58:13.287 INFO:teuthology.orchestra.run.smithi123.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-06T02:58:13.287 INFO:teuthology.orchestra.run.smithi123.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-06T02:58:13.288 INFO:teuthology.orchestra.run.smithi123.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-06T02:58:13.288 INFO:teuthology.orchestra.run.smithi123.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-06T02:58:13.289 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages will be upgraded: 2023-10-06T02:58:13.290 INFO:teuthology.orchestra.run.smithi123.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-06T02:58:13.322 INFO:teuthology.orchestra.run.smithi158.stdout:The following NEW packages will be installed: 2023-10-06T02:58:13.322 INFO:teuthology.orchestra.run.smithi158.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-06T02:58:13.322 INFO:teuthology.orchestra.run.smithi158.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-06T02:58:13.323 INFO:teuthology.orchestra.run.smithi158.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-06T02:58:13.323 INFO:teuthology.orchestra.run.smithi158.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-06T02:58:13.324 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages will be upgraded: 2023-10-06T02:58:13.325 INFO:teuthology.orchestra.run.smithi158.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-06T02:58:13.345 INFO:teuthology.orchestra.run.smithi123.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-06T02:58:13.345 INFO:teuthology.orchestra.run.smithi123.stdout:Need to get 10.4 MB of archives. 2023-10-06T02:58:13.345 INFO:teuthology.orchestra.run.smithi123.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-06T02:58:13.345 INFO:teuthology.orchestra.run.smithi123.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-06T02:58:13.367 INFO:teuthology.orchestra.run.smithi124.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:58:13.370 DEBUG:teuthology.orchestra.run.smithi124:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-06T02:58:13.385 INFO:teuthology.orchestra.run.smithi158.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-06T02:58:13.385 INFO:teuthology.orchestra.run.smithi158.stdout:Need to get 10.4 MB of archives. 2023-10-06T02:58:13.385 INFO:teuthology.orchestra.run.smithi158.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-06T02:58:13.385 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-06T02:58:13.446 INFO:teuthology.orchestra.run.smithi124.stdout:Reading package lists... 2023-10-06T02:58:13.475 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-06T02:58:13.476 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-06T02:58:13.477 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-06T02:58:13.481 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-06T02:58:13.482 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-06T02:58:13.499 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-06T02:58:13.500 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-06T02:58:13.501 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-06T02:58:13.502 INFO:teuthology.orchestra.run.smithi123.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-06T02:58:13.502 INFO:teuthology.orchestra.run.smithi123.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-06T02:58:13.508 INFO:teuthology.orchestra.run.smithi123.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-06T02:58:13.509 INFO:teuthology.orchestra.run.smithi123.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-06T02:58:13.510 INFO:teuthology.orchestra.run.smithi123.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-06T02:58:13.511 INFO:teuthology.orchestra.run.smithi123.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-06T02:58:13.525 INFO:teuthology.orchestra.run.smithi123.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-06T02:58:13.525 INFO:teuthology.orchestra.run.smithi123.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-06T02:58:13.533 INFO:teuthology.orchestra.run.smithi123.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-06T02:58:13.535 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-06T02:58:13.536 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-06T02:58:13.536 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-06T02:58:13.540 INFO:teuthology.orchestra.run.smithi123.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-06T02:58:13.540 INFO:teuthology.orchestra.run.smithi123.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-06T02:58:13.540 INFO:teuthology.orchestra.run.smithi027.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:58:13.541 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-06T02:58:13.542 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-06T02:58:13.544 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-06T02:58:13.553 INFO:teuthology.orchestra.run.smithi123.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-06T02:58:13.553 INFO:teuthology.orchestra.run.smithi123.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-06T02:58:13.561 INFO:teuthology.orchestra.run.smithi123.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-06T02:58:13.563 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-06T02:58:13.563 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-06T02:58:13.565 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-06T02:58:13.566 INFO:teuthology.orchestra.run.smithi158.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-06T02:58:13.567 INFO:teuthology.orchestra.run.smithi158.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-06T02:58:13.571 INFO:teuthology.orchestra.run.smithi123.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-06T02:58:13.572 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package modemmanager. 2023-10-06T02:58:13.574 INFO:teuthology.orchestra.run.smithi158.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-06T02:58:13.575 INFO:teuthology.orchestra.run.smithi158.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-06T02:58:13.576 INFO:teuthology.orchestra.run.smithi158.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-06T02:58:13.577 INFO:teuthology.orchestra.run.smithi158.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-06T02:58:13.586 INFO:teuthology.orchestra.run.smithi123.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-06T02:58:13.589 INFO:teuthology.orchestra.run.smithi123.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-06T02:58:13.589 INFO:teuthology.orchestra.run.smithi123.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-06T02:58:13.590 INFO:teuthology.orchestra.run.smithi123.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-06T02:58:13.590 INFO:teuthology.orchestra.run.smithi123.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-06T02:58:13.592 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:13.593 INFO:teuthology.orchestra.run.smithi158.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-06T02:58:13.594 INFO:teuthology.orchestra.run.smithi158.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-06T02:58:13.599 INFO:teuthology.orchestra.run.smithi158.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-06T02:58:13.610 INFO:teuthology.orchestra.run.smithi158.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-06T02:58:13.610 INFO:teuthology.orchestra.run.smithi158.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-06T02:58:13.613 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2023-10-06T02:58:13.624 INFO:teuthology.orchestra.run.smithi158.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-06T02:58:13.624 INFO:teuthology.orchestra.run.smithi158.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-06T02:58:13.631 INFO:teuthology.orchestra.run.smithi158.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-06T02:58:13.632 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:13.641 INFO:teuthology.orchestra.run.smithi158.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-06T02:58:13.647 INFO:teuthology.orchestra.run.smithi124.stdout:Building dependency tree... 2023-10-06T02:58:13.648 INFO:teuthology.orchestra.run.smithi124.stdout:Reading state information... 2023-10-06T02:58:13.657 INFO:teuthology.orchestra.run.smithi158.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-06T02:58:13.660 INFO:teuthology.orchestra.run.smithi158.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-06T02:58:13.660 INFO:teuthology.orchestra.run.smithi158.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-06T02:58:13.660 INFO:teuthology.orchestra.run.smithi158.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-06T02:58:13.661 INFO:teuthology.orchestra.run.smithi158.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-06T02:58:13.821 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2023-10-06T02:58:13.821 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2023-10-06T02:58:13.845 INFO:teuthology.orchestra.run.smithi124.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-06T02:58:13.845 INFO:teuthology.orchestra.run.smithi124.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-06T02:58:13.845 INFO:teuthology.orchestra.run.smithi124.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-06T02:58:13.846 INFO:teuthology.orchestra.run.smithi124.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-06T02:58:13.846 INFO:teuthology.orchestra.run.smithi124.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-06T02:58:13.846 INFO:teuthology.orchestra.run.smithi124.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:58:13.846 INFO:teuthology.orchestra.run.smithi124.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:58:13.846 INFO:teuthology.orchestra.run.smithi124.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:58:13.847 INFO:teuthology.orchestra.run.smithi124.stdout:The following additional packages will be installed: 2023-10-06T02:58:13.847 INFO:teuthology.orchestra.run.smithi124.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-06T02:58:13.847 INFO:teuthology.orchestra.run.smithi124.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-06T02:58:13.847 INFO:teuthology.orchestra.run.smithi124.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-06T02:58:13.847 INFO:teuthology.orchestra.run.smithi124.stdout: usb-modeswitch-data wpasupplicant 2023-10-06T02:58:13.848 INFO:teuthology.orchestra.run.smithi124.stdout:Suggested packages: 2023-10-06T02:58:13.848 INFO:teuthology.orchestra.run.smithi124.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-06T02:58:13.849 INFO:teuthology.orchestra.run.smithi124.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-06T02:58:13.898 INFO:teuthology.orchestra.run.smithi124.stdout:The following NEW packages will be installed: 2023-10-06T02:58:13.899 INFO:teuthology.orchestra.run.smithi124.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-06T02:58:13.899 INFO:teuthology.orchestra.run.smithi124.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-06T02:58:13.899 INFO:teuthology.orchestra.run.smithi124.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-06T02:58:13.899 INFO:teuthology.orchestra.run.smithi124.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-06T02:58:13.900 INFO:teuthology.orchestra.run.smithi124.stdout:The following packages will be upgraded: 2023-10-06T02:58:13.901 INFO:teuthology.orchestra.run.smithi124.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-06T02:58:13.915 INFO:teuthology.orchestra.run.smithi123.stdout:Preconfiguring packages ... 2023-10-06T02:58:13.960 INFO:teuthology.orchestra.run.smithi124.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-06T02:58:13.961 INFO:teuthology.orchestra.run.smithi124.stdout:Need to get 10.4 MB of archives. 2023-10-06T02:58:13.961 INFO:teuthology.orchestra.run.smithi124.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-06T02:58:13.961 INFO:teuthology.orchestra.run.smithi124.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-06T02:58:13.969 INFO:teuthology.orchestra.run.smithi158.stdout:Preconfiguring packages ... 2023-10-06T02:58:14.032 INFO:teuthology.orchestra.run.smithi027.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-06T02:58:14.032 INFO:teuthology.orchestra.run.smithi027.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-06T02:58:14.032 INFO:teuthology.orchestra.run.smithi027.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-06T02:58:14.033 INFO:teuthology.orchestra.run.smithi027.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-06T02:58:14.033 INFO:teuthology.orchestra.run.smithi027.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-06T02:58:14.033 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:58:14.033 INFO:teuthology.orchestra.run.smithi027.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:58:14.033 INFO:teuthology.orchestra.run.smithi027.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:58:14.033 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2023-10-06T02:58:14.034 INFO:teuthology.orchestra.run.smithi027.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-06T02:58:14.034 INFO:teuthology.orchestra.run.smithi027.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-06T02:58:14.035 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-06T02:58:14.035 INFO:teuthology.orchestra.run.smithi027.stdout: usb-modeswitch-data wpasupplicant 2023-10-06T02:58:14.036 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2023-10-06T02:58:14.036 INFO:teuthology.orchestra.run.smithi027.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-06T02:58:14.036 INFO:teuthology.orchestra.run.smithi027.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-06T02:58:14.052 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 10.4 MB in 0s (35.7 MB/s) 2023-10-06T02:58:14.084 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2023-10-06T02:58:14.085 INFO:teuthology.orchestra.run.smithi027.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-06T02:58:14.085 INFO:teuthology.orchestra.run.smithi027.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-06T02:58:14.085 INFO:teuthology.orchestra.run.smithi027.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-06T02:58:14.085 INFO:teuthology.orchestra.run.smithi027.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-06T02:58:14.086 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages will be upgraded: 2023-10-06T02:58:14.087 INFO:teuthology.orchestra.run.smithi027.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-06T02:58:14.090 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 10.4 MB in 0s (31.8 MB/s) 2023-10-06T02:58:14.110 INFO:teuthology.orchestra.run.smithi124.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-06T02:58:14.111 INFO:teuthology.orchestra.run.smithi124.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-06T02:58:14.113 INFO:teuthology.orchestra.run.smithi124.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-06T02:58:14.118 INFO:teuthology.orchestra.run.smithi124.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-06T02:58:14.120 INFO:teuthology.orchestra.run.smithi124.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-06T02:58:14.139 INFO:teuthology.orchestra.run.smithi124.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-06T02:58:14.139 INFO:teuthology.orchestra.run.smithi124.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-06T02:58:14.141 INFO:teuthology.orchestra.run.smithi124.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-06T02:58:14.143 INFO:teuthology.orchestra.run.smithi124.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-06T02:58:14.145 INFO:teuthology.orchestra.run.smithi027.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-06T02:58:14.146 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 10.4 MB of archives. 2023-10-06T02:58:14.146 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-06T02:58:14.146 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-06T02:58:14.147 INFO:teuthology.orchestra.run.smithi124.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-06T02:58:14.149 INFO:teuthology.orchestra.run.smithi124.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-06T02:58:14.150 INFO:teuthology.orchestra.run.smithi124.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-06T02:58:14.151 INFO:teuthology.orchestra.run.smithi124.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-06T02:58:14.151 INFO:teuthology.orchestra.run.smithi124.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-06T02:58:14.168 INFO:teuthology.orchestra.run.smithi124.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-06T02:58:14.169 INFO:teuthology.orchestra.run.smithi124.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-06T02:58:14.175 INFO:teuthology.orchestra.run.smithi124.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-06T02:58:14.182 INFO:teuthology.orchestra.run.smithi124.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-06T02:58:14.182 INFO:teuthology.orchestra.run.smithi124.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-06T02:58:14.196 INFO:teuthology.orchestra.run.smithi124.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-06T02:58:14.196 INFO:teuthology.orchestra.run.smithi124.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-06T02:58:14.204 INFO:teuthology.orchestra.run.smithi124.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-06T02:58:14.214 INFO:teuthology.orchestra.run.smithi124.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-06T02:58:14.229 INFO:teuthology.orchestra.run.smithi124.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-06T02:58:14.231 INFO:teuthology.orchestra.run.smithi124.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-06T02:58:14.232 INFO:teuthology.orchestra.run.smithi124.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-06T02:58:14.232 INFO:teuthology.orchestra.run.smithi124.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-06T02:58:14.233 INFO:teuthology.orchestra.run.smithi124.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-06T02:58:14.253 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package wpasupplicant. 2023-10-06T02:58:14.271 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-06T02:58:14.273 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-06T02:58:14.274 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-06T02:58:14.275 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-06T02:58:14.280 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-06T02:58:14.280 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-06T02:58:14.297 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-06T02:58:14.298 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-06T02:58:14.299 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-06T02:58:14.300 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-06T02:58:14.300 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-06T02:58:14.306 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-06T02:58:14.307 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-06T02:58:14.308 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-06T02:58:14.309 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-06T02:58:14.311 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:58:14.323 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-06T02:58:14.323 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-06T02:58:14.329 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-06T02:58:14.336 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-06T02:58:14.336 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-06T02:58:14.351 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-06T02:58:14.351 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-06T02:58:14.353 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:14.358 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:14.358 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-06T02:58:14.365 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:14.368 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-06T02:58:14.370 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:14.383 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-06T02:58:14.386 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-06T02:58:14.386 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-06T02:58:14.387 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-06T02:58:14.387 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-06T02:58:14.541 INFO:teuthology.orchestra.run.smithi124.stdout:Preconfiguring packages ... 2023-10-06T02:58:14.543 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:14.544 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:14.678 INFO:teuthology.orchestra.run.smithi124.stdout:Fetched 10.4 MB in 0s (32.1 MB/s) 2023-10-06T02:58:14.711 INFO:teuthology.orchestra.run.smithi027.stdout:Preconfiguring packages ... 2023-10-06T02:58:14.847 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 10.4 MB in 0s (35.7 MB/s) 2023-10-06T02:58:14.874 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package network-manager. 2023-10-06T02:58:14.891 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:58:14.944 INFO:teuthology.orchestra.run.smithi124.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:14.949 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:14.956 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:15.073 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:15.078 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:15.110 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:15.230 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:15.658 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ppp. 2023-10-06T02:58:15.675 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-06T02:58:15.679 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:15.749 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:15.927 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:58:16.213 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:16.531 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:17.057 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package pptp-linux. 2023-10-06T02:58:17.070 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:17.074 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:17.077 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-06T02:58:17.115 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-06T02:58:17.205 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:17.210 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:17.225 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:17.365 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:17.476 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-06T02:58:17.493 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-06T02:58:17.552 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-06T02:58:17.628 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:17.687 INFO:teuthology.orchestra.run.smithi124.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:17.691 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:17.786 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:17.817 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:17.822 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:17.829 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-06T02:58:17.849 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-06T02:58:17.887 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-06T02:58:17.967 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:17.972 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:18.019 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:18.079 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:18.103 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:18.230 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:18.274 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-06T02:58:18.291 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-06T02:58:18.343 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:58:18.415 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:18.541 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:18.547 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:18.552 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:18.643 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:18.694 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:58:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:18.749 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:18.963 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:58:19.054 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:19.089 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:58:19.106 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:19.190 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:19.198 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:58:19.201 INFO:teuthology.orchestra.run.smithi124.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:19.206 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:19.324 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:58:19.364 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:58:19.488 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:19.493 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:19.576 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-06T02:58:19.580 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:19.618 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:58:19.618 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:58:19.633 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:58:19.755 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:58:19.782 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:58:19.806 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:19.912 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-06T02:58:19.936 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:58:20.089 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:20.117 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:20.222 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:58:20.235 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:58:20.260 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:20.336 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:20.393 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:58:20.407 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-06T02:58:20.424 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-06T02:58:20.437 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-06T02:58:20.441 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:58:20.465 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:58:20.563 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:20.574 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-06T02:58:20.714 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:58:20.777 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package dump. 2023-10-06T02:58:20.798 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-06T02:58:20.827 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking dump (0.4b46-6) ... 2023-10-06T02:58:20.976 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:58:21.095 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-06T02:58:21.114 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-06T02:58:21.115 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-06T02:58:21.138 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package indent. 2023-10-06T02:58:21.153 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:58:21.158 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:58:21.182 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:58:21.196 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:58:21.506 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package dump. 2023-10-06T02:58:21.523 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-06T02:58:21.564 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking dump (0.4b46-6) ... 2023-10-06T02:58:21.601 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-06T02:58:21.619 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-06T02:58:21.659 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:58:21.687 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-06T02:58:21.803 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-06T02:58:21.860 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package indent. 2023-10-06T02:58:21.877 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:58:21.918 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:58:21.936 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up dump (0.4b46-6) ... 2023-10-06T02:58:22.031 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-06T02:58:22.062 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package dump. 2023-10-06T02:58:22.081 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-06T02:58:22.088 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:22.120 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking dump (0.4b46-6) ... 2023-10-06T02:58:22.205 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:58:22.315 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-06T02:58:22.331 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:58:22.334 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-06T02:58:22.373 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:58:22.432 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package indent. 2023-10-06T02:58:22.449 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:58:22.457 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:58:22.524 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:58:22.626 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-06T02:58:22.646 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-06T02:58:22.667 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:58:22.676 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package dump. 2023-10-06T02:58:22.697 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-06T02:58:22.734 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking dump (0.4b46-6) ... 2023-10-06T02:58:22.793 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:22.801 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:58:22.843 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-06T02:58:22.863 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-06T02:58:22.893 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:58:22.928 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:23.030 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package indent. 2023-10-06T02:58:23.047 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:58:23.053 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-06T02:58:23.063 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-06T02:58:23.080 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-06T02:58:23.088 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:58:23.106 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-06T02:58:23.121 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:58:23.122 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-06T02:58:23.197 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:58:23.230 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:23.246 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-06T02:58:23.263 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-06T02:58:23.330 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:58:23.356 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:23.357 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-06T02:58:23.376 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:23.407 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:23.415 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-06T02:58:23.437 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-06T02:58:23.474 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:58:23.526 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-06T02:58:23.543 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-06T02:58:23.584 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:58:23.640 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-06T02:58:23.658 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:23.699 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:23.744 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-06T02:58:23.760 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-06T02:58:23.761 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:23.781 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-06T02:58:23.802 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:23.810 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:58:23.836 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-06T02:58:23.853 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:23.903 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:24.055 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-06T02:58:24.059 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:24.059 INFO:teuthology.orchestra.run.smithi174.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-06T02:58:24.060 INFO:teuthology.orchestra.run.smithi174.stdout:which means they are currently configured by ifupdown: 2023-10-06T02:58:24.060 INFO:teuthology.orchestra.run.smithi174.stdout:- enp3s0f1 2023-10-06T02:58:24.060 INFO:teuthology.orchestra.run.smithi174.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-06T02:58:24.060 INFO:teuthology.orchestra.run.smithi174.stdout:remove their configuration from /etc/network/interfaces. 2023-10-06T02:58:24.060 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:24.074 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:58:24.080 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-06T02:58:24.097 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:24.113 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:24.138 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:24.214 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-06T02:58:24.290 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-06T02:58:24.307 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:24.348 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:24.441 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-06T02:58:24.457 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:24.466 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-06T02:58:24.486 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:24.490 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:24.524 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:24.526 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-06T02:58:24.588 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-06T02:58:24.592 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-06T02:58:24.605 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:24.611 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:24.637 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:24.651 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:24.801 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-06T02:58:24.822 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:24.835 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-06T02:58:24.852 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-06T02:58:24.859 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:24.893 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:58:24.965 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-06T02:58:24.978 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-06T02:58:24.985 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:24.997 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:25.023 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:25.045 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:25.051 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-06T02:58:25.129 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-06T02:58:25.147 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:25.187 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:25.222 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-06T02:58:25.239 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:58:25.279 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:25.384 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-06T02:58:25.402 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:25.425 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-06T02:58:25.441 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-06T02:58:25.467 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:25.481 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:58:25.565 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-06T02:58:25.576 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:25.585 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-06T02:58:25.623 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:58:25.691 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-06T02:58:25.709 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:25.719 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-06T02:58:25.749 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:25.801 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-06T02:58:25.818 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:58:25.837 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-06T02:58:25.857 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-06T02:58:25.859 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:25.861 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:25.887 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:58:25.951 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-06T02:58:25.968 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:58:25.987 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:26.009 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:26.076 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-06T02:58:26.093 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:26.105 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:26.126 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:26.223 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-06T02:58:26.240 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:58:26.251 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:26.287 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-06T02:58:26.297 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:26.304 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:26.345 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:26.354 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-06T02:58:26.362 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-06T02:58:26.372 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:58:26.382 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:26.412 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:26.412 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:26.519 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:58:26.520 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:58:26.681 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-06T02:58:26.701 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:26.709 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-06T02:58:26.726 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:26.740 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:26.748 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-06T02:58:26.765 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:26.800 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:26.806 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:26.899 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-06T02:58:26.919 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-06T02:58:26.957 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:58:27.012 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-06T02:58:27.032 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:58:27.059 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-06T02:58:27.067 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:27.161 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-06T02:58:27.179 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:27.202 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-06T02:58:27.219 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:27.222 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:58:27.352 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package modemmanager. 2023-10-06T02:58:27.369 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:27.371 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:27.446 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:27.473 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-06T02:58:27.493 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:58:27.518 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-06T02:58:27.522 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:27.563 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-06T02:58:27.579 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-06T02:58:27.621 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:58:27.644 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:58:27.795 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:58:27.806 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-06T02:58:27.826 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-06T02:58:27.855 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:58:28.032 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package modemmanager. 2023-10-06T02:58:28.049 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:28.067 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-06T02:58:28.085 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-06T02:58:28.101 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:28.105 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:58:28.141 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:58:28.225 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package modemmanager. 2023-10-06T02:58:28.245 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:28.260 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package wpasupplicant. 2023-10-06T02:58:28.277 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-06T02:58:28.294 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:28.318 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:58:28.536 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package modemmanager. 2023-10-06T02:58:28.557 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:58:28.630 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:28.857 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package network-manager. 2023-10-06T02:58:28.874 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:58:28.890 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package wpasupplicant. 2023-10-06T02:58:28.910 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-06T02:58:28.939 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:28.940 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package wpasupplicant. 2023-10-06T02:58:28.956 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-06T02:58:28.973 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:58:28.998 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:58:29.319 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package wpasupplicant. 2023-10-06T02:58:29.335 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-06T02:58:29.396 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:58:29.504 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package network-manager. 2023-10-06T02:58:29.522 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:58:29.561 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package network-manager. 2023-10-06T02:58:29.579 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:58:29.585 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:29.652 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:29.680 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ppp. 2023-10-06T02:58:29.697 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-06T02:58:29.961 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:58:30.082 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package network-manager. 2023-10-06T02:58:30.099 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:58:30.163 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:30.318 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package pptp-linux. 2023-10-06T02:58:30.336 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ppp. 2023-10-06T02:58:30.336 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-06T02:58:30.353 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-06T02:58:30.385 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-06T02:58:30.393 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ppp. 2023-10-06T02:58:30.411 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-06T02:58:30.616 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:58:30.679 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:58:30.755 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-06T02:58:30.773 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-06T02:58:30.831 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-06T02:58:30.949 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package pptp-linux. 2023-10-06T02:58:30.964 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ppp. 2023-10-06T02:58:30.968 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-06T02:58:30.984 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-06T02:58:31.007 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package pptp-linux. 2023-10-06T02:58:31.008 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-06T02:58:31.024 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-06T02:58:31.083 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-06T02:58:31.098 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-06T02:58:31.100 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-06T02:58:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-06T02:58:31.263 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:58:31.319 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-06T02:58:31.336 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-06T02:58:31.386 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-06T02:58:31.518 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-06T02:58:31.543 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-06T02:58:31.562 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-06T02:58:31.578 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-06T02:58:31.594 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-06T02:58:31.619 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package pptp-linux. 2023-10-06T02:58:31.631 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:58:31.631 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-06T02:58:31.635 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-06T02:58:31.650 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-06T02:58:31.677 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-06T02:58:31.689 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-06T02:58:31.854 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-06T02:58:31.872 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-06T02:58:31.913 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-06T02:58:31.932 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:32.084 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-06T02:58:32.101 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-06T02:58:32.113 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-06T02:58:32.130 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-06T02:58:32.152 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:58:32.174 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-06T02:58:32.189 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-06T02:58:32.233 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:58:32.299 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-06T02:58:32.316 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-06T02:58:32.316 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-06T02:58:32.351 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:58:32.437 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:58:32.440 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:32.452 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:58:32.458 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-06T02:58:32.477 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-06T02:58:32.516 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-06T02:58:32.781 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:58:32.830 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:58:32.830 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:58:32.907 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:58:32.931 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:32.961 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-06T02:58:32.978 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-06T02:58:33.029 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:58:33.033 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:58:33.151 INFO:teuthology.orchestra.run.smithi174.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:58:33.153 DEBUG:teuthology.parallel:result is None 2023-10-06T02:58:33.248 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:58:33.271 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:33.374 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:58:33.396 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:58:33.396 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:58:33.397 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:33.500 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:58:33.716 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:58:33.727 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:58:33.867 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:58:33.879 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:33.899 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:58:33.899 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:58:33.918 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:33.980 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:58:33.993 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:58:34.043 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-06T02:58:34.098 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:34.177 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:34.224 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-06T02:58:34.303 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:58:34.350 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:34.370 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:34.403 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:58:34.403 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:58:34.476 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:58:34.487 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:58:34.613 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:34.739 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-06T02:58:34.865 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:35.016 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:58:35.047 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:58:35.206 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:58:35.277 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-06T02:58:35.332 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:58:35.379 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-06T02:58:35.466 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-06T02:58:35.517 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up dump (0.4b46-6) ... 2023-10-06T02:58:35.592 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:35.607 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up dump (0.4b46-6) ... 2023-10-06T02:58:35.612 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-06T02:58:35.678 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:35.735 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-06T02:58:35.744 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:58:35.800 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:35.837 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:58:35.943 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:58:35.963 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:58:35.980 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-06T02:58:36.069 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:58:36.089 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:58:36.194 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:58:36.222 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up dump (0.4b46-6) ... 2023-10-06T02:58:36.265 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:58:36.317 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-06T02:58:36.363 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:58:36.374 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:36.391 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:36.464 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:36.500 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:58:36.509 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:36.565 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:36.626 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:58:36.644 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-06T02:58:36.716 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-06T02:58:36.752 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:58:36.765 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-06T02:58:36.837 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:36.883 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:36.937 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:58:36.963 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:36.999 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up dump (0.4b46-6) ... 2023-10-06T02:58:37.010 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:37.063 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:37.086 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-06T02:58:37.151 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:37.189 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:37.310 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:58:37.315 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-06T02:58:37.436 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:58:37.483 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:37.609 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:37.612 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:58:37.663 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:37.663 INFO:teuthology.orchestra.run.smithi158.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-06T02:58:37.663 INFO:teuthology.orchestra.run.smithi158.stdout:which means they are currently configured by ifupdown: 2023-10-06T02:58:37.663 INFO:teuthology.orchestra.run.smithi158.stdout:- enp3s0f1 2023-10-06T02:58:37.663 INFO:teuthology.orchestra.run.smithi158.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-06T02:58:37.664 INFO:teuthology.orchestra.run.smithi158.stdout:remove their configuration from /etc/network/interfaces. 2023-10-06T02:58:37.664 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:37.709 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:37.709 INFO:teuthology.orchestra.run.smithi124.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-06T02:58:37.709 INFO:teuthology.orchestra.run.smithi124.stdout:which means they are currently configured by ifupdown: 2023-10-06T02:58:37.709 INFO:teuthology.orchestra.run.smithi124.stdout:- enp3s0f1 2023-10-06T02:58:37.709 INFO:teuthology.orchestra.run.smithi124.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-06T02:58:37.709 INFO:teuthology.orchestra.run.smithi124.stdout:remove their configuration from /etc/network/interfaces. 2023-10-06T02:58:37.710 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:37.814 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-06T02:58:37.822 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:58:37.863 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-06T02:58:37.948 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:38.099 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:38.100 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-06T02:58:38.196 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-06T02:58:38.208 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-06T02:58:38.418 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:38.513 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:38.513 INFO:teuthology.orchestra.run.smithi027.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-06T02:58:38.513 INFO:teuthology.orchestra.run.smithi027.stdout:which means they are currently configured by ifupdown: 2023-10-06T02:58:38.513 INFO:teuthology.orchestra.run.smithi027.stdout:- ens1f0 2023-10-06T02:58:38.513 INFO:teuthology.orchestra.run.smithi027.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-06T02:58:38.513 INFO:teuthology.orchestra.run.smithi027.stdout:remove their configuration from /etc/network/interfaces. 2023-10-06T02:58:38.513 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:38.578 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:58:38.610 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-06T02:58:38.673 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-06T02:58:38.725 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-06T02:58:38.990 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-06T02:58:39.222 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:39.249 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:39.335 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:39.336 INFO:teuthology.orchestra.run.smithi123.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-06T02:58:39.336 INFO:teuthology.orchestra.run.smithi123.stdout:which means they are currently configured by ifupdown: 2023-10-06T02:58:39.336 INFO:teuthology.orchestra.run.smithi123.stdout:- enp3s0f1 2023-10-06T02:58:39.336 INFO:teuthology.orchestra.run.smithi123.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-06T02:58:39.336 INFO:teuthology.orchestra.run.smithi123.stdout:remove their configuration from /etc/network/interfaces. 2023-10-06T02:58:39.336 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:39.356 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-06T02:58:39.384 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-06T02:58:39.499 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-06T02:58:39.521 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-06T02:58:39.524 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:39.543 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:39.650 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:39.670 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:39.776 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:39.795 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:39.828 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-06T02:58:39.902 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:39.921 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:40.029 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:40.164 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-06T02:58:40.177 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:58:40.177 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:58:40.193 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:58:40.193 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:58:40.290 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:40.365 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-06T02:58:40.416 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:40.542 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:40.687 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:40.696 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-06T02:58:40.707 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-06T02:58:40.799 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-06T02:58:40.816 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-06T02:58:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:58:40.917 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:58:40.943 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:58:40.976 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:58:40.976 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:58:41.041 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-06T02:58:41.052 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:58:41.111 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:58:41.217 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:58:41.342 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:41.345 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:58:41.396 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:58:41.493 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:58:41.512 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-06T02:58:41.619 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:58:41.621 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-06T02:58:41.772 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:58:41.916 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:58:41.927 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:58:41.927 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:58:42.200 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:58:42.448 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-06T02:58:42.565 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-06T02:58:42.724 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:58:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:58:43.160 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:58:45.165 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-06T02:58:45.290 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-06T02:58:45.307 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-06T02:58:45.390 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-06T02:58:46.044 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-06T02:58:46.101 INFO:teuthology.orchestra.run.smithi124.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:58:46.104 DEBUG:teuthology.parallel:result is None 2023-10-06T02:58:46.152 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-06T02:58:46.298 INFO:teuthology.orchestra.run.smithi158.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:58:46.301 DEBUG:teuthology.parallel:result is None 2023-10-06T02:58:46.888 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-06T02:58:46.988 INFO:teuthology.orchestra.run.smithi027.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:58:46.991 DEBUG:teuthology.parallel:result is None 2023-10-06T02:58:47.038 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-06T02:58:47.861 INFO:teuthology.orchestra.run.smithi123.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:58:47.863 DEBUG:teuthology.parallel:result is None 2023-10-06T02:58:47.864 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:58:48.083 DEBUG:teuthology.orchestra.run.smithi027:> dpkg-query -W -f '${Version}' ceph 2023-10-06T02:58:48.108 INFO:teuthology.orchestra.run.smithi027.stdout:17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:58:48.109 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:58:48.109 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296-g736ac5ba-1focal is installed. 2023-10-06T02:58:48.109 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:58:48.257 DEBUG:teuthology.orchestra.run.smithi123:> dpkg-query -W -f '${Version}' ceph 2023-10-06T02:58:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:58:48.280 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:58:48.280 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296-g736ac5ba-1focal is installed. 2023-10-06T02:58:48.282 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:58:48.423 DEBUG:teuthology.orchestra.run.smithi124:> dpkg-query -W -f '${Version}' ceph 2023-10-06T02:58:48.450 INFO:teuthology.orchestra.run.smithi124.stdout:17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:58:48.450 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:58:48.450 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296-g736ac5ba-1focal is installed. 2023-10-06T02:58:48.451 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:58:48.669 DEBUG:teuthology.orchestra.run.smithi158:> dpkg-query -W -f '${Version}' ceph 2023-10-06T02:58:48.693 INFO:teuthology.orchestra.run.smithi158.stdout:17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:58:48.694 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:58:48.694 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296-g736ac5ba-1focal is installed. 2023-10-06T02:58:48.694 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:58:48.910 DEBUG:teuthology.orchestra.run.smithi174:> dpkg-query -W -f '${Version}' ceph 2023-10-06T02:58:48.935 INFO:teuthology.orchestra.run.smithi174.stdout:17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:58:48.936 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:58:48.936 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296-g736ac5ba-1focal is installed. 2023-10-06T02:58:48.936 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T02:58:48.936 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:58:48.937 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:58:48.954 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:58:48.954 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:58:48.971 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T02:58:48.971 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:58:48.988 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T02:58:48.988 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:58:49.005 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T02:58:49.005 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:58:49.022 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T02:58:49.022 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:58:49.022 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:58:49.037 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:58:49.049 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:58:49.049 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:58:49.066 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:58:49.076 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T02:58:49.076 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:58:49.092 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:58:49.104 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T02:58:49.104 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:58:49.119 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:58:49.129 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T02:58:49.129 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:58:49.145 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:58:49.155 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T02:58:49.155 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:58:49.155 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:58:49.172 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:58:49.187 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:58:49.187 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:58:49.203 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:58:49.215 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T02:58:49.216 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:58:49.232 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:58:49.247 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T02:58:49.247 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:58:49.263 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:58:49.273 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T02:58:49.274 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:58:49.289 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:58:49.299 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T02:58:49.299 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:58:49.300 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:58:49.316 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:58:49.332 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:58:49.332 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:58:49.346 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:58:49.405 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T02:58:49.405 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:58:49.422 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:58:49.432 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T02:58:49.432 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:58:49.449 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:58:49.506 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T02:58:49.506 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:58:49.522 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:58:49.578 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T02:58:49.662 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T02:58:49.662 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /var/log/ceph 2023-10-06T02:58:49.665 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /var/log/ceph 2023-10-06T02:58:49.667 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 777 /var/log/ceph 2023-10-06T02:58:49.670 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 777 /var/log/ceph 2023-10-06T02:58:49.673 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2023-10-06T02:58:49.691 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T02:58:49.691 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:58:49.693 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:58:49.724 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:58:49.726 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:58:49.730 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:58:49.750 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T02:58:49.750 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:58:49.752 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:58:49.754 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:58:49.783 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:58:49.785 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:58:49.807 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T02:58:49.807 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T02:58:49.807 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T02:58:49.808 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:58:49.808 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:58:49.816 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:49.855 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:58:49.855 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:58:49.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:49.943 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T02:58:49.943 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:58:49.950 DEBUG:teuthology.orchestra.run.smithi124:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:49.990 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T02:58:49.990 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:58:49.997 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:50.071 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T02:58:50.072 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:58:50.079 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:50.169 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T02:58:50.169 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T02:58:50.170 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412173', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1'], ['client.2']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi027.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi123.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi124.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi158.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi174.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'ceph-fuse': None}, {'pexec': {'clients': ['cd $TESTDIR', 'wget http://download.ceph.com/qa/mdtest-1.9.3.tgz', 'mkdir mdtest-1.9.3', 'cd mdtest-1.9.3', 'tar xvfz $TESTDIR/mdtest-1.9.3.tgz', 'rm $TESTDIR/mdtest-1.9.3.tgz', 'MPI_CC=mpicc make', 'ln -s $TESTDIR/mnt.* $TESTDIR/gmnt']}}, {'ssh_keys': None}, {'mpi': {'exec': '$TESTDIR/mdtest-1.9.3/mdtest -d $TESTDIR/gmnt -I 20 -z 5 -b 2 -R'}}, {'pexec': {'clients': ['rm -f $TESTDIR/gmnt', 'rm -rf $TESTDIR/mdtest-1.9.3', 'rm -rf $TESTDIR/._mdtest-1.9.3']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T02:58:50.170 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:58:50.173 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:58:50.176 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:58:50.178 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:58:50.180 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:58:50.188 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:58:50.220 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:58:50.223 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:58:50.225 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:58:50.230 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:58:50.247 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:58:50.247 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T02:58:50.253 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T02:58:50.254 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_1 2023-10-06T02:58:50.261 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T02:58:50.261 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:58:50.261 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 360 Links: 1 2023-10-06T02:58:50.261 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:58:50.262 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-10-06 02:54:08.836876043 +0000 2023-10-06T02:58:50.262 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-10-06 02:54:08.544882764 +0000 2023-10-06T02:58:50.262 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-10-06 02:54:08.544882764 +0000 2023-10-06T02:58:50.262 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-10-06T02:58:50.262 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T02:58:50.276 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-10-06T02:58:50.277 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-10-06T02:58:50.277 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.00035735 s, 1.4 MB/s 2023-10-06T02:58:50.278 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T02:58:50.327 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_2 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-10-06 02:54:09.360863982 +0000 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-10-06 02:54:09.064870794 +0000 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-10-06 02:54:09.064870794 +0000 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-10-06T02:58:50.335 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T02:58:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-10-06T02:58:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-10-06T02:58:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000384309 s, 1.3 MB/s 2023-10-06T02:58:50.350 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T02:58:50.401 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_3 2023-10-06T02:58:50.409 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T02:58:50.409 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:58:50.410 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-10-06T02:58:50.410 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:58:50.410 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-10-06 02:54:09.888851828 +0000 2023-10-06T02:58:50.410 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-10-06 02:54:09.576859009 +0000 2023-10-06T02:58:50.410 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-10-06 02:54:09.576859009 +0000 2023-10-06T02:58:50.410 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-10-06T02:58:50.411 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T02:58:50.423 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-10-06T02:58:50.424 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-10-06T02:58:50.424 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000401038 s, 1.3 MB/s 2023-10-06T02:58:50.425 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T02:58:50.475 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_4 2023-10-06T02:58:50.483 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T02:58:50.483 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:58:50.483 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-10-06T02:58:50.483 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:58:50.483 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-10-06 02:54:10.428839398 +0000 2023-10-06T02:58:50.483 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-10-06 02:54:10.148845842 +0000 2023-10-06T02:58:50.483 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-10-06 02:54:10.148845842 +0000 2023-10-06T02:58:50.483 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-10-06T02:58:50.484 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T02:58:50.496 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-10-06T02:58:50.497 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-10-06T02:58:50.497 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000416015 s, 1.2 MB/s 2023-10-06T02:58:50.498 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T02:58:50.506 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:58:50.506 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:58:50.506 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T02:58:50.513 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T02:58:50.513 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2023-10-06T02:58:50.520 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T02:58:50.520 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:58:50.520 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 359 Links: 1 2023-10-06T02:58:50.520 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:58:50.520 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-10-06 02:54:08.828364448 +0000 2023-10-06T02:58:50.521 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-10-06 02:54:08.532371261 +0000 2023-10-06T02:58:50.521 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-10-06 02:54:08.532371261 +0000 2023-10-06T02:58:50.521 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-10-06T02:58:50.521 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T02:58:50.533 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-10-06T02:58:50.533 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-10-06T02:58:50.534 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000415935 s, 1.2 MB/s 2023-10-06T02:58:50.534 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T02:58:50.541 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2023-10-06T02:58:50.547 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T02:58:50.548 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:58:50.548 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 365 Links: 1 2023-10-06T02:58:50.548 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:58:50.548 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-10-06 02:54:09.320353123 +0000 2023-10-06T02:58:50.548 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-10-06 02:54:09.032359752 +0000 2023-10-06T02:58:50.548 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-10-06 02:54:09.032359752 +0000 2023-10-06T02:58:50.548 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-10-06T02:58:50.549 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T02:58:50.604 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-10-06T02:58:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-10-06T02:58:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000392462 s, 1.3 MB/s 2023-10-06T02:58:50.606 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T02:58:50.614 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2023-10-06T02:58:50.620 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T02:58:50.620 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:58:50.620 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-10-06T02:58:50.620 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:58:50.620 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-10-06 02:54:09.852340878 +0000 2023-10-06T02:58:50.621 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-10-06 02:54:09.588346953 +0000 2023-10-06T02:58:50.621 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-10-06 02:54:09.588346953 +0000 2023-10-06T02:58:50.621 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-10-06T02:58:50.621 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T02:58:50.674 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-10-06T02:58:50.675 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-10-06T02:58:50.675 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000374209 s, 1.4 MB/s 2023-10-06T02:58:50.676 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T02:58:50.684 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2023-10-06T02:58:50.691 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T02:58:50.691 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:58:50.691 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 377 Links: 1 2023-10-06T02:58:50.691 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:58:50.691 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-10-06 02:54:10.356329277 +0000 2023-10-06T02:58:50.691 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-10-06 02:54:10.080335630 +0000 2023-10-06T02:58:50.691 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-10-06 02:54:10.080335630 +0000 2023-10-06T02:58:50.692 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-10-06T02:58:50.692 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T02:58:50.746 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-10-06T02:58:50.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-10-06T02:58:50.747 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000383808 s, 1.3 MB/s 2023-10-06T02:58:50.748 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T02:58:50.756 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:58:50.756 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T02:58:50.756 INFO:tasks.ceph:Generating config... 2023-10-06T02:58:50.757 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T02:58:50.758 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T02:58:50.758 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T02:58:50.758 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T02:58:50.758 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T02:58:50.758 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T02:58:50.758 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T02:58:50.758 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T02:58:50.758 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T02:58:50.758 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T02:58:50.758 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T02:58:50.759 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T02:58:50.759 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T02:58:50.759 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T02:58:50.759 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T02:58:50.759 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T02:58:50.759 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T02:58:50.759 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T02:58:50.759 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T02:58:50.759 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T02:58:50.759 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-06T02:58:50.759 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-06T02:58:50.759 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-06T02:58:50.760 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T02:58:50.760 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T02:58:50.760 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-06T02:58:50.760 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-06T02:58:50.760 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T02:58:50.760 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T02:58:50.760 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-06T02:58:50.760 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T02:58:50.760 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T02:58:50.760 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T02:58:50.760 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T02:58:50.760 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T02:58:50.761 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T02:58:50.761 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T02:58:50.761 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T02:58:50.796 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T02:58:50.799 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T02:58:50.837 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:58:50.850 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.27'), ('mon.b', '172.21.15.123'), ('mon.c', '[v2:172.21.15.123:3301,v1:172.21.15.123:6790]')] 2023-10-06T02:58:50.851 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.27,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T02:58:50.852 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:58:50.852 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T02:58:50.859 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.27 --add b 172.21.15.123 --addv c '[v2:172.21.15.123:3301,v1:172.21.15.123:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:58:50.944 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:58:50.944 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: generated fsid e03fe5a6-e2a4-4ef7-9a46-008590473953 2023-10-06T02:58:50.944 INFO:teuthology.orchestra.run.smithi027.stdout:setting min_mon_release = octopus 2023-10-06T02:58:50.944 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 0 2023-10-06T02:58:50.944 INFO:teuthology.orchestra.run.smithi027.stdout:fsid e03fe5a6-e2a4-4ef7-9a46-008590473953 2023-10-06T02:58:50.944 INFO:teuthology.orchestra.run.smithi027.stdout:last_changed 2023-10-06T02:58:50.943766+0000 2023-10-06T02:58:50.944 INFO:teuthology.orchestra.run.smithi027.stdout:created 2023-10-06T02:58:50.943766+0000 2023-10-06T02:58:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:min_mon_release 15 (octopus) 2023-10-06T02:58:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:election_strategy: 1 2023-10-06T02:58:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2023-10-06T02:58:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:1: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2023-10-06T02:58:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:2: [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] mon.c 2023-10-06T02:58:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T02:58:50.946 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T02:58:50.951 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e03fe5a6-e2a4-4ef7-9a46-008590473953... 2023-10-06T02:58:50.952 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:58:50.954 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:58:50.957 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:58:50.959 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:58:50.961 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:58:50.981 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2023-10-06T02:58:50.981 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2023-10-06T02:58:50.981 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:58:50.982 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2023-10-06T02:58:50.982 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.982 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2023-10-06T02:58:50.982 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.982 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2023-10-06T02:58:50.982 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.982 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2023-10-06T02:58:50.982 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2023-10-06T02:58:50.982 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.983 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2023-10-06T02:58:50.983 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2023-10-06T02:58:50.983 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.983 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:58:50.983 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2023-10-06T02:58:50.983 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.983 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:58:50.983 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:58:50.983 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.983 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2023-10-06T02:58:50.983 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.984 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2023-10-06T02:58:50.984 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2023-10-06T02:58:50.984 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:58:50.984 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:58:50.984 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2023-10-06T02:58:50.984 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:58:50.984 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2023-10-06T02:58:50.984 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:58:50.984 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:58:50.984 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2023-10-06T02:58:50.984 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.985 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:58:50.985 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.985 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2023-10-06T02:58:50.985 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.985 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2023-10-06T02:58:50.985 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.985 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2023-10-06T02:58:50.985 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2023-10-06T02:58:50.985 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2023-10-06T02:58:50.985 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = "172.21.15.27,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]" 2023-10-06T02:58:50.985 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = e03fe5a6-e2a4-4ef7-9a46-008590473953 2023-10-06T02:58:50.986 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.986 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2023-10-06T02:58:50.986 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2023-10-06T02:58:50.986 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.986 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2023-10-06T02:58:50.986 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2023-10-06T02:58:50.986 INFO:teuthology.orchestra.run.smithi123.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:58:50.986 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.986 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2023-10-06T02:58:50.986 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2023-10-06T02:58:50.986 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.987 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2023-10-06T02:58:50.987 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2023-10-06T02:58:50.987 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2023-10-06T02:58:50.987 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.987 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2023-10-06T02:58:50.987 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2023-10-06T02:58:50.987 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.987 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:58:50.987 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.987 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2023-10-06T02:58:50.987 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.987 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2023-10-06T02:58:50.988 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.988 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:58:50.988 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2023-10-06T02:58:50.988 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.988 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2023-10-06T02:58:50.988 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2023-10-06T02:58:50.988 INFO:teuthology.orchestra.run.smithi123.stdout: bdev async discard = True 2023-10-06T02:58:50.988 INFO:teuthology.orchestra.run.smithi123.stdout: bdev enable discard = True 2023-10-06T02:58:50.988 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore allocator = bitmap 2023-10-06T02:58:50.988 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2023-10-06T02:58:50.988 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2023-10-06T02:58:50.989 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 1/20 2023-10-06T02:58:50.989 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 1/20 2023-10-06T02:58:50.989 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-10-06T02:58:50.989 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2023-10-06T02:58:50.989 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 4/10 2023-10-06T02:58:50.989 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:58:50.989 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2023-10-06T02:58:50.989 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:58:50.989 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:58:50.989 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2023-10-06T02:58:50.989 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2023-10-06T02:58:50.989 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.990 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2023-10-06T02:58:50.990 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-10-06T02:58:50.990 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2023-10-06T02:58:50.990 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2023-10-06T02:58:50.990 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2023-10-06T02:58:50.990 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:58:50.990 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:58:50.990 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2023-10-06T02:58:50.990 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.990 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2023-10-06T02:58:50.990 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-10-06T02:58:50.991 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2023-10-06T02:58:50.991 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2023-10-06T02:58:50.991 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2023-10-06T02:58:50.991 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2023-10-06T02:58:50.991 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2023-10-06T02:58:50.991 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:58:50.991 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2023-10-06T02:58:50.991 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2023-10-06T02:58:50.991 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:58:50.991 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.991 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:58:50.991 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:58:50.991 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:58:50.992 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.992 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:58:50.992 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:58:50.992 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:58:50.992 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.992 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2023-10-06T02:58:50.992 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:58:50.992 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.992 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:58:50.992 INFO:teuthology.orchestra.run.smithi123.stdout: mon op complaint time = 120 2023-10-06T02:58:50.992 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-06T02:58:50.992 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2023-10-06T02:58:50.992 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2023-10-06T02:58:50.993 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2023-10-06T02:58:50.993 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2023-10-06T02:58:50.993 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:58:50.993 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:58:50.993 INFO:teuthology.orchestra.run.smithi123.stdout: client mount timeout = 600 2023-10-06T02:58:50.993 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2023-10-06T02:58:50.993 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-10-06T02:58:50.993 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2023-10-06T02:58:50.993 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2023-10-06T02:58:50.993 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2023-10-06T02:58:50.993 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.b] 2023-10-06T02:58:50.993 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.c] 2023-10-06T02:58:50.994 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2023-10-06T02:58:50.994 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2023-10-06T02:58:50.994 INFO:teuthology.orchestra.run.smithi123.stdout:[mds] 2023-10-06T02:58:50.994 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds = 20 2023-10-06T02:58:50.994 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-10-06T02:58:50.994 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug frag = True 2023-10-06T02:58:50.994 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug scatterstat = True 2023-10-06T02:58:50.994 INFO:teuthology.orchestra.run.smithi123.stdout: mds op complaint time = 180 2023-10-06T02:58:50.994 INFO:teuthology.orchestra.run.smithi123.stdout: mds verify scatter = True 2023-10-06T02:58:50.994 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2023-10-06T02:58:50.994 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2023-10-06T02:58:50.995 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2023-10-06T02:58:50.995 INFO:teuthology.orchestra.run.smithi124.stdout:[global] 2023-10-06T02:58:50.996 INFO:teuthology.orchestra.run.smithi124.stdout: chdir = "" 2023-10-06T02:58:50.996 INFO:teuthology.orchestra.run.smithi124.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:58:50.996 INFO:teuthology.orchestra.run.smithi124.stdout: auth supported = cephx 2023-10-06T02:58:50.996 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:50.996 INFO:teuthology.orchestra.run.smithi124.stdout: filestore xattr use omap = true 2023-10-06T02:58:50.996 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:50.996 INFO:teuthology.orchestra.run.smithi124.stdout: mon clock drift allowed = 1.000 2023-10-06T02:58:50.996 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:50.996 INFO:teuthology.orchestra.run.smithi124.stdout: osd crush chooseleaf type = 0 2023-10-06T02:58:50.996 INFO:teuthology.orchestra.run.smithi124.stdout: auth debug = true 2023-10-06T02:58:50.996 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:50.997 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on old message = true 2023-10-06T02:58:50.997 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on bug = true 2023-10-06T02:58:50.997 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:50.997 INFO:teuthology.orchestra.run.smithi124.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:58:50.997 INFO:teuthology.orchestra.run.smithi124.stdout: mon pg warn max object skew = 0 2023-10-06T02:58:50.997 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:50.997 INFO:teuthology.orchestra.run.smithi124.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:58:50.997 INFO:teuthology.orchestra.run.smithi124.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:58:50.997 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:50.997 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default size = 2 2023-10-06T02:58:50.997 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:50.998 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow primary affinity = true 2023-10-06T02:58:50.998 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow pg remap = true 2023-10-06T02:58:50.998 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:58:50.998 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:58:50.998 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on no sortbitwise = false 2023-10-06T02:58:50.998 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:58:50.998 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on too few osds = false 2023-10-06T02:58:50.998 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:58:50.998 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:58:50.998 INFO:teuthology.orchestra.run.smithi124.stdout: mon_allow_pool_size_one = true 2023-10-06T02:58:50.998 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:50.998 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:58:50.999 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:50.999 INFO:teuthology.orchestra.run.smithi124.stdout: osd default data pool replay window = 5 2023-10-06T02:58:50.999 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:50.999 INFO:teuthology.orchestra.run.smithi124.stdout: mon allow pool delete = true 2023-10-06T02:58:50.999 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:50.999 INFO:teuthology.orchestra.run.smithi124.stdout: mon cluster log file level = debug 2023-10-06T02:58:50.999 INFO:teuthology.orchestra.run.smithi124.stdout: debug asserts on shutdown = true 2023-10-06T02:58:50.999 INFO:teuthology.orchestra.run.smithi124.stdout: mon health detail to clog = false 2023-10-06T02:58:50.999 INFO:teuthology.orchestra.run.smithi124.stdout: mon host = "172.21.15.27,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]" 2023-10-06T02:58:50.999 INFO:teuthology.orchestra.run.smithi124.stdout: fsid = e03fe5a6-e2a4-4ef7-9a46-008590473953 2023-10-06T02:58:50.999 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.000 INFO:teuthology.orchestra.run.smithi124.stdout:[osd] 2023-10-06T02:58:51.000 INFO:teuthology.orchestra.run.smithi124.stdout: osd journal size = 100 2023-10-06T02:58:51.000 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.000 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub load threshold = 5.0 2023-10-06T02:58:51.000 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub max interval = 600 2023-10-06T02:58:51.000 INFO:teuthology.orchestra.run.smithi124.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:58:51.000 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.000 INFO:teuthology.orchestra.run.smithi124.stdout: osd recover clone overlap = true 2023-10-06T02:58:51.000 INFO:teuthology.orchestra.run.smithi124.stdout: osd recovery max chunk = 1048576 2023-10-06T02:58:51.000 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.000 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug shutdown = true 2023-10-06T02:58:51.001 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug op order = true 2023-10-06T02:58:51.001 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug verify stray on activate = true 2023-10-06T02:58:51.001 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.001 INFO:teuthology.orchestra.run.smithi124.stdout: osd open classes on start = true 2023-10-06T02:58:51.001 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug pg log writeout = true 2023-10-06T02:58:51.001 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.001 INFO:teuthology.orchestra.run.smithi124.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:58:51.001 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.001 INFO:teuthology.orchestra.run.smithi124.stdout: osd map max advance = 10 2023-10-06T02:58:51.001 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.001 INFO:teuthology.orchestra.run.smithi124.stdout: journal zero on create = true 2023-10-06T02:58:51.001 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.002 INFO:teuthology.orchestra.run.smithi124.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:58:51.002 INFO:teuthology.orchestra.run.smithi124.stdout: filestore apply finisher threads = 3 2023-10-06T02:58:51.002 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.002 INFO:teuthology.orchestra.run.smithi124.stdout: bdev debug aio = true 2023-10-06T02:58:51.002 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug misdirected ops = true 2023-10-06T02:58:51.002 INFO:teuthology.orchestra.run.smithi124.stdout: bdev async discard = True 2023-10-06T02:58:51.002 INFO:teuthology.orchestra.run.smithi124.stdout: bdev enable discard = True 2023-10-06T02:58:51.002 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore allocator = bitmap 2023-10-06T02:58:51.002 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore block size = 96636764160 2023-10-06T02:58:51.002 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore fsck on mount = True 2023-10-06T02:58:51.003 INFO:teuthology.orchestra.run.smithi124.stdout: debug bluefs = 1/20 2023-10-06T02:58:51.003 INFO:teuthology.orchestra.run.smithi124.stdout: debug bluestore = 1/20 2023-10-06T02:58:51.003 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-06T02:58:51.003 INFO:teuthology.orchestra.run.smithi124.stdout: debug osd = 20 2023-10-06T02:58:51.003 INFO:teuthology.orchestra.run.smithi124.stdout: debug rocksdb = 4/10 2023-10-06T02:58:51.003 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:58:51.003 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd full ratio = 0.9 2023-10-06T02:58:51.003 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:58:51.003 INFO:teuthology.orchestra.run.smithi124.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:58:51.004 INFO:teuthology.orchestra.run.smithi124.stdout: osd objectstore = bluestore 2023-10-06T02:58:51.004 INFO:teuthology.orchestra.run.smithi124.stdout: osd op complaint time = 180 2023-10-06T02:58:51.004 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.004 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr] 2023-10-06T02:58:51.004 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-06T02:58:51.004 INFO:teuthology.orchestra.run.smithi124.stdout: debug mgr = 20 2023-10-06T02:58:51.004 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2023-10-06T02:58:51.004 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2023-10-06T02:58:51.004 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:58:51.004 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:58:51.005 INFO:teuthology.orchestra.run.smithi124.stdout: mgr/telemetry/nag = false 2023-10-06T02:58:51.005 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.005 INFO:teuthology.orchestra.run.smithi124.stdout:[mon] 2023-10-06T02:58:51.005 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-06T02:58:51.005 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2023-10-06T02:58:51.005 INFO:teuthology.orchestra.run.smithi124.stdout: debug paxos = 20 2023-10-06T02:58:51.005 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2023-10-06T02:58:51.005 INFO:teuthology.orchestra.run.smithi124.stdout: mon data avail warn = 5 2023-10-06T02:58:51.005 INFO:teuthology.orchestra.run.smithi124.stdout: mon mgr mkfs grace = 240 2023-10-06T02:58:51.005 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:58:51.005 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd reporter subtree level = osd 2023-10-06T02:58:51.005 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd prime pg temp = true 2023-10-06T02:58:51.006 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:58:51.006 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.006 INFO:teuthology.orchestra.run.smithi124.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:58:51.006 INFO:teuthology.orchestra.run.smithi124.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:58:51.006 INFO:teuthology.orchestra.run.smithi124.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:58:51.006 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.006 INFO:teuthology.orchestra.run.smithi124.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:58:51.006 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:58:51.006 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:58:51.006 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.006 INFO:teuthology.orchestra.run.smithi124.stdout: # 1m isn't quite enough 2023-10-06T02:58:51.007 INFO:teuthology.orchestra.run.smithi124.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:58:51.007 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.007 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:58:51.007 INFO:teuthology.orchestra.run.smithi124.stdout: mon op complaint time = 120 2023-10-06T02:58:51.007 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T02:58:51.007 INFO:teuthology.orchestra.run.smithi124.stdout:[client] 2023-10-06T02:58:51.007 INFO:teuthology.orchestra.run.smithi124.stdout: rgw cache enabled = true 2023-10-06T02:58:51.007 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable ops log = true 2023-10-06T02:58:51.007 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable usage log = true 2023-10-06T02:58:51.007 INFO:teuthology.orchestra.run.smithi124.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:58:51.007 INFO:teuthology.orchestra.run.smithi124.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:58:51.007 INFO:teuthology.orchestra.run.smithi124.stdout: client mount timeout = 600 2023-10-06T02:58:51.008 INFO:teuthology.orchestra.run.smithi124.stdout: debug client = 20 2023-10-06T02:58:51.008 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-06T02:58:51.008 INFO:teuthology.orchestra.run.smithi124.stdout: rados mon op timeout = 900 2023-10-06T02:58:51.008 INFO:teuthology.orchestra.run.smithi124.stdout: rados osd op timeout = 900 2023-10-06T02:58:51.008 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.a] 2023-10-06T02:58:51.008 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.b] 2023-10-06T02:58:51.008 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.c] 2023-10-06T02:58:51.008 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.a] 2023-10-06T02:58:51.008 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.b] 2023-10-06T02:58:51.008 INFO:teuthology.orchestra.run.smithi124.stdout:[mds] 2023-10-06T02:58:51.008 INFO:teuthology.orchestra.run.smithi124.stdout: debug mds = 20 2023-10-06T02:58:51.009 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-06T02:58:51.009 INFO:teuthology.orchestra.run.smithi124.stdout: mds debug frag = True 2023-10-06T02:58:51.009 INFO:teuthology.orchestra.run.smithi124.stdout: mds debug scatterstat = True 2023-10-06T02:58:51.009 INFO:teuthology.orchestra.run.smithi124.stdout: mds op complaint time = 180 2023-10-06T02:58:51.009 INFO:teuthology.orchestra.run.smithi124.stdout: mds verify scatter = True 2023-10-06T02:58:51.009 INFO:teuthology.orchestra.run.smithi124.stdout: osd op complaint time = 180 2023-10-06T02:58:51.010 INFO:teuthology.orchestra.run.smithi124.stdout: rados mon op timeout = 900 2023-10-06T02:58:51.010 INFO:teuthology.orchestra.run.smithi124.stdout: rados osd op timeout = 900 2023-10-06T02:58:51.010 INFO:teuthology.orchestra.run.smithi158.stdout:[global] 2023-10-06T02:58:51.010 INFO:teuthology.orchestra.run.smithi158.stdout: chdir = "" 2023-10-06T02:58:51.010 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:58:51.011 INFO:teuthology.orchestra.run.smithi158.stdout: auth supported = cephx 2023-10-06T02:58:51.011 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.011 INFO:teuthology.orchestra.run.smithi158.stdout: filestore xattr use omap = true 2023-10-06T02:58:51.011 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.011 INFO:teuthology.orchestra.run.smithi158.stdout: mon clock drift allowed = 1.000 2023-10-06T02:58:51.012 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.012 INFO:teuthology.orchestra.run.smithi158.stdout: osd crush chooseleaf type = 0 2023-10-06T02:58:51.012 INFO:teuthology.orchestra.run.smithi158.stdout: auth debug = true 2023-10-06T02:58:51.012 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.012 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on old message = true 2023-10-06T02:58:51.012 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on bug = true 2023-10-06T02:58:51.013 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.013 INFO:teuthology.orchestra.run.smithi158.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:58:51.013 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn max object skew = 0 2023-10-06T02:58:51.013 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.013 INFO:teuthology.orchestra.run.smithi158.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:58:51.013 INFO:teuthology.orchestra.run.smithi158.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:58:51.013 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.013 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default size = 2 2023-10-06T02:58:51.013 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.013 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow primary affinity = true 2023-10-06T02:58:51.013 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow pg remap = true 2023-10-06T02:58:51.013 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:58:51.014 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:58:51.014 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on no sortbitwise = false 2023-10-06T02:58:51.014 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:58:51.014 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on too few osds = false 2023-10-06T02:58:51.014 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:58:51.014 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:58:51.014 INFO:teuthology.orchestra.run.smithi158.stdout: mon_allow_pool_size_one = true 2023-10-06T02:58:51.014 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.014 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:58:51.014 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.014 INFO:teuthology.orchestra.run.smithi158.stdout: osd default data pool replay window = 5 2023-10-06T02:58:51.015 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.015 INFO:teuthology.orchestra.run.smithi158.stdout: mon allow pool delete = true 2023-10-06T02:58:51.015 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.015 INFO:teuthology.orchestra.run.smithi158.stdout: mon cluster log file level = debug 2023-10-06T02:58:51.015 INFO:teuthology.orchestra.run.smithi158.stdout: debug asserts on shutdown = true 2023-10-06T02:58:51.015 INFO:teuthology.orchestra.run.smithi158.stdout: mon health detail to clog = false 2023-10-06T02:58:51.015 INFO:teuthology.orchestra.run.smithi158.stdout: mon host = "172.21.15.27,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]" 2023-10-06T02:58:51.015 INFO:teuthology.orchestra.run.smithi158.stdout: fsid = e03fe5a6-e2a4-4ef7-9a46-008590473953 2023-10-06T02:58:51.015 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.015 INFO:teuthology.orchestra.run.smithi158.stdout:[osd] 2023-10-06T02:58:51.015 INFO:teuthology.orchestra.run.smithi158.stdout: osd journal size = 100 2023-10-06T02:58:51.015 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.016 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub load threshold = 5.0 2023-10-06T02:58:51.016 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub max interval = 600 2023-10-06T02:58:51.016 INFO:teuthology.orchestra.run.smithi158.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:58:51.016 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.016 INFO:teuthology.orchestra.run.smithi158.stdout: osd recover clone overlap = true 2023-10-06T02:58:51.016 INFO:teuthology.orchestra.run.smithi158.stdout: osd recovery max chunk = 1048576 2023-10-06T02:58:51.016 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.016 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug shutdown = true 2023-10-06T02:58:51.016 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug op order = true 2023-10-06T02:58:51.016 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug verify stray on activate = true 2023-10-06T02:58:51.016 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.016 INFO:teuthology.orchestra.run.smithi158.stdout: osd open classes on start = true 2023-10-06T02:58:51.017 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug pg log writeout = true 2023-10-06T02:58:51.017 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.017 INFO:teuthology.orchestra.run.smithi158.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:58:51.017 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.017 INFO:teuthology.orchestra.run.smithi158.stdout: osd map max advance = 10 2023-10-06T02:58:51.017 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.017 INFO:teuthology.orchestra.run.smithi158.stdout: journal zero on create = true 2023-10-06T02:58:51.017 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.017 INFO:teuthology.orchestra.run.smithi158.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:58:51.017 INFO:teuthology.orchestra.run.smithi158.stdout: filestore apply finisher threads = 3 2023-10-06T02:58:51.017 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.017 INFO:teuthology.orchestra.run.smithi158.stdout: bdev debug aio = true 2023-10-06T02:58:51.018 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug misdirected ops = true 2023-10-06T02:58:51.018 INFO:teuthology.orchestra.run.smithi158.stdout: bdev async discard = True 2023-10-06T02:58:51.018 INFO:teuthology.orchestra.run.smithi158.stdout: bdev enable discard = True 2023-10-06T02:58:51.018 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore allocator = bitmap 2023-10-06T02:58:51.018 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore block size = 96636764160 2023-10-06T02:58:51.018 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore fsck on mount = True 2023-10-06T02:58:51.018 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluefs = 1/20 2023-10-06T02:58:51.018 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluestore = 1/20 2023-10-06T02:58:51.018 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-06T02:58:51.018 INFO:teuthology.orchestra.run.smithi158.stdout: debug osd = 20 2023-10-06T02:58:51.018 INFO:teuthology.orchestra.run.smithi158.stdout: debug rocksdb = 4/10 2023-10-06T02:58:51.018 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:58:51.019 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd full ratio = 0.9 2023-10-06T02:58:51.019 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:58:51.019 INFO:teuthology.orchestra.run.smithi158.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:58:51.019 INFO:teuthology.orchestra.run.smithi158.stdout: osd objectstore = bluestore 2023-10-06T02:58:51.019 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2023-10-06T02:58:51.019 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.019 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr] 2023-10-06T02:58:51.019 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-06T02:58:51.019 INFO:teuthology.orchestra.run.smithi158.stdout: debug mgr = 20 2023-10-06T02:58:51.019 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-10-06T02:58:51.019 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-10-06T02:58:51.019 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:58:51.020 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:58:51.020 INFO:teuthology.orchestra.run.smithi158.stdout: mgr/telemetry/nag = false 2023-10-06T02:58:51.020 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.020 INFO:teuthology.orchestra.run.smithi158.stdout:[mon] 2023-10-06T02:58:51.020 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-06T02:58:51.020 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-10-06T02:58:51.020 INFO:teuthology.orchestra.run.smithi158.stdout: debug paxos = 20 2023-10-06T02:58:51.020 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-10-06T02:58:51.020 INFO:teuthology.orchestra.run.smithi158.stdout: mon data avail warn = 5 2023-10-06T02:58:51.020 INFO:teuthology.orchestra.run.smithi158.stdout: mon mgr mkfs grace = 240 2023-10-06T02:58:51.020 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:58:51.020 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd reporter subtree level = osd 2023-10-06T02:58:51.021 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd prime pg temp = true 2023-10-06T02:58:51.021 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:58:51.021 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.021 INFO:teuthology.orchestra.run.smithi158.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:58:51.021 INFO:teuthology.orchestra.run.smithi158.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:58:51.021 INFO:teuthology.orchestra.run.smithi158.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:58:51.021 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.021 INFO:teuthology.orchestra.run.smithi158.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:58:51.021 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:58:51.021 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:58:51.021 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.021 INFO:teuthology.orchestra.run.smithi158.stdout: # 1m isn't quite enough 2023-10-06T02:58:51.022 INFO:teuthology.orchestra.run.smithi158.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:58:51.022 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.022 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:58:51.022 INFO:teuthology.orchestra.run.smithi158.stdout: mon op complaint time = 120 2023-10-06T02:58:51.022 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-06T02:58:51.022 INFO:teuthology.orchestra.run.smithi158.stdout:[client] 2023-10-06T02:58:51.022 INFO:teuthology.orchestra.run.smithi158.stdout: rgw cache enabled = true 2023-10-06T02:58:51.022 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable ops log = true 2023-10-06T02:58:51.022 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable usage log = true 2023-10-06T02:58:51.022 INFO:teuthology.orchestra.run.smithi158.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:58:51.022 INFO:teuthology.orchestra.run.smithi158.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:58:51.022 INFO:teuthology.orchestra.run.smithi158.stdout: client mount timeout = 600 2023-10-06T02:58:51.023 INFO:teuthology.orchestra.run.smithi158.stdout: debug client = 20 2023-10-06T02:58:51.023 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-06T02:58:51.023 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 900 2023-10-06T02:58:51.023 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 900 2023-10-06T02:58:51.023 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.a] 2023-10-06T02:58:51.023 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.b] 2023-10-06T02:58:51.023 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.c] 2023-10-06T02:58:51.023 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2023-10-06T02:58:51.023 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.b] 2023-10-06T02:58:51.023 INFO:teuthology.orchestra.run.smithi158.stdout:[mds] 2023-10-06T02:58:51.023 INFO:teuthology.orchestra.run.smithi158.stdout: debug mds = 20 2023-10-06T02:58:51.023 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-06T02:58:51.024 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug frag = True 2023-10-06T02:58:51.024 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug scatterstat = True 2023-10-06T02:58:51.024 INFO:teuthology.orchestra.run.smithi158.stdout: mds op complaint time = 180 2023-10-06T02:58:51.024 INFO:teuthology.orchestra.run.smithi158.stdout: mds verify scatter = True 2023-10-06T02:58:51.024 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2023-10-06T02:58:51.024 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 900 2023-10-06T02:58:51.024 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 900 2023-10-06T02:58:51.025 INFO:teuthology.orchestra.run.smithi027.stdout:[global] 2023-10-06T02:58:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: chdir = "" 2023-10-06T02:58:51.025 INFO:teuthology.orchestra.run.smithi027.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:58:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: auth supported = cephx 2023-10-06T02:58:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: filestore xattr use omap = true 2023-10-06T02:58:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: mon clock drift allowed = 1.000 2023-10-06T02:58:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: osd crush chooseleaf type = 0 2023-10-06T02:58:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: auth debug = true 2023-10-06T02:58:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.026 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on old message = true 2023-10-06T02:58:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on bug = true 2023-10-06T02:58:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:58:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: mon pg warn max object skew = 0 2023-10-06T02:58:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:58:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:58:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default size = 2 2023-10-06T02:58:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.027 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow primary affinity = true 2023-10-06T02:58:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow pg remap = true 2023-10-06T02:58:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:58:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:58:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on no sortbitwise = false 2023-10-06T02:58:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:58:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on too few osds = false 2023-10-06T02:58:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:58:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:58:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: mon_allow_pool_size_one = true 2023-10-06T02:58:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:58:51.028 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: osd default data pool replay window = 5 2023-10-06T02:58:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: mon allow pool delete = true 2023-10-06T02:58:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: mon cluster log file level = debug 2023-10-06T02:58:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: debug asserts on shutdown = true 2023-10-06T02:58:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: mon health detail to clog = false 2023-10-06T02:58:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: mon host = "172.21.15.27,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]" 2023-10-06T02:58:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: fsid = e03fe5a6-e2a4-4ef7-9a46-008590473953 2023-10-06T02:58:51.029 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.029 INFO:teuthology.orchestra.run.smithi027.stdout:[osd] 2023-10-06T02:58:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: osd journal size = 100 2023-10-06T02:58:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub load threshold = 5.0 2023-10-06T02:58:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub max interval = 600 2023-10-06T02:58:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:58:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: osd recover clone overlap = true 2023-10-06T02:58:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: osd recovery max chunk = 1048576 2023-10-06T02:58:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug shutdown = true 2023-10-06T02:58:51.030 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug op order = true 2023-10-06T02:58:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug verify stray on activate = true 2023-10-06T02:58:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: osd open classes on start = true 2023-10-06T02:58:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug pg log writeout = true 2023-10-06T02:58:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:58:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: osd map max advance = 10 2023-10-06T02:58:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: journal zero on create = true 2023-10-06T02:58:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.031 INFO:teuthology.orchestra.run.smithi027.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:58:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: filestore apply finisher threads = 3 2023-10-06T02:58:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: bdev debug aio = true 2023-10-06T02:58:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug misdirected ops = true 2023-10-06T02:58:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: bdev async discard = True 2023-10-06T02:58:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: bdev enable discard = True 2023-10-06T02:58:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore allocator = bitmap 2023-10-06T02:58:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore block size = 96636764160 2023-10-06T02:58:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore fsck on mount = True 2023-10-06T02:58:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluefs = 1/20 2023-10-06T02:58:51.032 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluestore = 1/20 2023-10-06T02:58:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-06T02:58:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: debug osd = 20 2023-10-06T02:58:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: debug rocksdb = 4/10 2023-10-06T02:58:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:58:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd full ratio = 0.9 2023-10-06T02:58:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:58:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:58:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: osd objectstore = bluestore 2023-10-06T02:58:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2023-10-06T02:58:51.033 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.033 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr] 2023-10-06T02:58:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-06T02:58:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: debug mgr = 20 2023-10-06T02:58:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2023-10-06T02:58:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2023-10-06T02:58:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:58:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:58:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: mgr/telemetry/nag = false 2023-10-06T02:58:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.034 INFO:teuthology.orchestra.run.smithi027.stdout:[mon] 2023-10-06T02:58:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-06T02:58:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2023-10-06T02:58:51.034 INFO:teuthology.orchestra.run.smithi027.stdout: debug paxos = 20 2023-10-06T02:58:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2023-10-06T02:58:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: mon data avail warn = 5 2023-10-06T02:58:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: mon mgr mkfs grace = 240 2023-10-06T02:58:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:58:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd reporter subtree level = osd 2023-10-06T02:58:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd prime pg temp = true 2023-10-06T02:58:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:58:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:58:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:58:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:58:51.035 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:58:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:58:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:58:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: # 1m isn't quite enough 2023-10-06T02:58:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:58:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:58:51.036 INFO:teuthology.orchestra.run.smithi027.stdout: mon op complaint time = 120 2023-10-06T02:58:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:58:51.037 INFO:teuthology.orchestra.run.smithi027.stdout:[client] 2023-10-06T02:58:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: rgw cache enabled = true 2023-10-06T02:58:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable ops log = true 2023-10-06T02:58:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable usage log = true 2023-10-06T02:58:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:58:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:58:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: client mount timeout = 600 2023-10-06T02:58:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: debug client = 20 2023-10-06T02:58:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-06T02:58:51.037 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2023-10-06T02:58:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2023-10-06T02:58:51.038 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.a] 2023-10-06T02:58:51.038 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.b] 2023-10-06T02:58:51.038 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.c] 2023-10-06T02:58:51.038 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2023-10-06T02:58:51.038 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b] 2023-10-06T02:58:51.038 INFO:teuthology.orchestra.run.smithi027.stdout:[mds] 2023-10-06T02:58:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: debug mds = 20 2023-10-06T02:58:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-06T02:58:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug frag = True 2023-10-06T02:58:51.038 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug scatterstat = True 2023-10-06T02:58:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: mds op complaint time = 180 2023-10-06T02:58:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: mds verify scatter = True 2023-10-06T02:58:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2023-10-06T02:58:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2023-10-06T02:58:51.039 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2023-10-06T02:58:51.041 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2023-10-06T02:58:51.041 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2023-10-06T02:58:51.041 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:58:51.041 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2023-10-06T02:58:51.041 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.042 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2023-10-06T02:58:51.042 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.042 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2023-10-06T02:58:51.042 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.042 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2023-10-06T02:58:51.042 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2023-10-06T02:58:51.042 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.042 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2023-10-06T02:58:51.042 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2023-10-06T02:58:51.042 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.042 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:58:51.043 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2023-10-06T02:58:51.043 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.043 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:58:51.043 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:58:51.043 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.043 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2023-10-06T02:58:51.043 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.043 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2023-10-06T02:58:51.043 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2023-10-06T02:58:51.043 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:58:51.043 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:58:51.044 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2023-10-06T02:58:51.044 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:58:51.044 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2023-10-06T02:58:51.044 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:58:51.044 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:58:51.044 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2023-10-06T02:58:51.044 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.044 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:58:51.044 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.044 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2023-10-06T02:58:51.045 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.045 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2023-10-06T02:58:51.045 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.045 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2023-10-06T02:58:51.045 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2023-10-06T02:58:51.045 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2023-10-06T02:58:51.045 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = "172.21.15.27,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]" 2023-10-06T02:58:51.045 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = e03fe5a6-e2a4-4ef7-9a46-008590473953 2023-10-06T02:58:51.045 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.045 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2023-10-06T02:58:51.045 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2023-10-06T02:58:51.046 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.046 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2023-10-06T02:58:51.046 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2023-10-06T02:58:51.046 INFO:teuthology.orchestra.run.smithi174.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:58:51.046 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.046 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2023-10-06T02:58:51.046 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2023-10-06T02:58:51.046 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.046 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2023-10-06T02:58:51.046 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2023-10-06T02:58:51.046 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2023-10-06T02:58:51.046 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.047 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2023-10-06T02:58:51.047 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2023-10-06T02:58:51.047 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.047 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:58:51.047 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.047 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2023-10-06T02:58:51.047 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.047 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2023-10-06T02:58:51.047 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.049 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:58:51.049 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2023-10-06T02:58:51.049 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.049 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2023-10-06T02:58:51.049 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2023-10-06T02:58:51.049 INFO:teuthology.orchestra.run.smithi174.stdout: bdev async discard = True 2023-10-06T02:58:51.049 INFO:teuthology.orchestra.run.smithi174.stdout: bdev enable discard = True 2023-10-06T02:58:51.049 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore allocator = bitmap 2023-10-06T02:58:51.049 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore block size = 96636764160 2023-10-06T02:58:51.049 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore fsck on mount = True 2023-10-06T02:58:51.051 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluefs = 1/20 2023-10-06T02:58:51.051 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluestore = 1/20 2023-10-06T02:58:51.052 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-10-06T02:58:51.052 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 20 2023-10-06T02:58:51.052 INFO:teuthology.orchestra.run.smithi174.stdout: debug rocksdb = 4/10 2023-10-06T02:58:51.052 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:58:51.052 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd full ratio = 0.9 2023-10-06T02:58:51.052 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:58:51.052 INFO:teuthology.orchestra.run.smithi174.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:58:51.052 INFO:teuthology.orchestra.run.smithi174.stdout: osd objectstore = bluestore 2023-10-06T02:58:51.052 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2023-10-06T02:58:51.052 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.052 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2023-10-06T02:58:51.052 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-10-06T02:58:51.053 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2023-10-06T02:58:51.053 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2023-10-06T02:58:51.053 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2023-10-06T02:58:51.053 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:58:51.053 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:58:51.053 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2023-10-06T02:58:51.053 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.053 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2023-10-06T02:58:51.053 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-10-06T02:58:51.053 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2023-10-06T02:58:51.053 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2023-10-06T02:58:51.054 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2023-10-06T02:58:51.054 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2023-10-06T02:58:51.054 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2023-10-06T02:58:51.054 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:58:51.054 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2023-10-06T02:58:51.054 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2023-10-06T02:58:51.054 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:58:51.054 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.054 INFO:teuthology.orchestra.run.smithi174.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:58:51.054 INFO:teuthology.orchestra.run.smithi174.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:58:51.054 INFO:teuthology.orchestra.run.smithi174.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:58:51.054 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.055 INFO:teuthology.orchestra.run.smithi174.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:58:51.055 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:58:51.055 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:58:51.055 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.055 INFO:teuthology.orchestra.run.smithi174.stdout: # 1m isn't quite enough 2023-10-06T02:58:51.055 INFO:teuthology.orchestra.run.smithi174.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:58:51.055 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.055 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:58:51.055 INFO:teuthology.orchestra.run.smithi174.stdout: mon op complaint time = 120 2023-10-06T02:58:51.055 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T02:58:51.055 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2023-10-06T02:58:51.055 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2023-10-06T02:58:51.056 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2023-10-06T02:58:51.056 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2023-10-06T02:58:51.056 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:58:51.056 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:58:51.056 INFO:teuthology.orchestra.run.smithi174.stdout: client mount timeout = 600 2023-10-06T02:58:51.056 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2023-10-06T02:58:51.056 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-10-06T02:58:51.056 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2023-10-06T02:58:51.056 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2023-10-06T02:58:51.056 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2023-10-06T02:58:51.056 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.b] 2023-10-06T02:58:51.056 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.c] 2023-10-06T02:58:51.057 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2023-10-06T02:58:51.057 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2023-10-06T02:58:51.057 INFO:teuthology.orchestra.run.smithi174.stdout:[mds] 2023-10-06T02:58:51.057 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds = 20 2023-10-06T02:58:51.057 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-10-06T02:58:51.057 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug frag = True 2023-10-06T02:58:51.057 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug scatterstat = True 2023-10-06T02:58:51.057 INFO:teuthology.orchestra.run.smithi174.stdout: mds op complaint time = 180 2023-10-06T02:58:51.057 INFO:teuthology.orchestra.run.smithi174.stdout: mds verify scatter = True 2023-10-06T02:58:51.057 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2023-10-06T02:58:51.057 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2023-10-06T02:58:51.057 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2023-10-06T02:58:51.058 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T02:58:51.058 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T02:58:51.118 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T02:58:51.119 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:58:51.119 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T02:58:51.124 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:58:51.124 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T02:58:51.131 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi027.front.sepia.ceph.com 2023-10-06T02:58:51.131 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:58:51.132 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:58:51.132 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:58:51.200 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:58:51.201 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:58:51.207 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi123.front.sepia.ceph.com 2023-10-06T02:58:51.208 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:58:51.208 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:58:51.208 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:58:51.234 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:58:51.235 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:58:51.240 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T02:58:51.240 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T02:58:51.240 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:58:51.240 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:58:51.266 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T02:58:51.266 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:58:51.316 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T02:58:51.317 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T02:58:51.317 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:58:51.317 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:58:51.344 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T02:58:51.345 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:58:51.351 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2023-10-06T02:58:51.352 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T02:58:51.352 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:58:51.352 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:58:51.378 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T02:58:51.379 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:58:51.428 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T02:58:51.429 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T02:58:51.429 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T02:58:51.476 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T02:58:51.479 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T02:58:51.525 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T02:58:51.527 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T02:58:51.528 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T02:58:51.573 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T02:58:51.575 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T02:58:51.634 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T02:58:51.680 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T02:58:51.682 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T02:58:51.697 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T02:58:51.697 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T02:58:51.734 INFO:teuthology.orchestra.run.smithi124.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T02:58:51.749 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T02:58:51.786 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T02:58:51.800 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T02:58:51.836 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T02:58:51.850 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T02:58:51.850 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T02:58:51.850 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T02:58:51.867 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:58:51.867 INFO:tasks.ceph:role: osd.0 2023-10-06T02:58:51.867 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-06T02:58:51.868 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T02:58:52.390 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:58:52.391 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:58:52.391 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:58:52.391 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 2023-10-06T02:58:52.391 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:58:52.391 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:58:52.391 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:58:52.391 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:58:52.391 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:58:52.391 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:58:52.392 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-10-06T02:58:52.392 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T02:58:52.464 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T02:58:52.474 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T02:58:52.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:58:52.477 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T02:58:52.494 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:58:52.495 INFO:tasks.ceph:role: osd.1 2023-10-06T02:58:52.495 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-06T02:58:52.495 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T02:58:53.015 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:58:53.016 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:58:53.016 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:58:53.016 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 2023-10-06T02:58:53.016 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:58:53.016 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:58:53.016 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:58:53.016 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:58:53.016 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:58:53.016 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:58:53.018 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-10-06T02:58:53.018 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T02:58:53.074 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T02:58:53.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:58:53.085 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T02:58:53.085 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T02:58:53.097 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:58:53.097 INFO:tasks.ceph:role: osd.2 2023-10-06T02:58:53.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-06T02:58:53.097 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T02:58:53.550 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:58:53.550 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:58:53.550 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:58:53.550 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 2023-10-06T02:58:53.550 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:58:53.551 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:58:53.551 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:58:53.551 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:58:53.551 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:58:53.551 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:58:53.552 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-10-06T02:58:53.552 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T02:58:53.608 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T02:58:53.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:58:53.618 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T02:58:53.618 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T02:58:53.635 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:58:53.635 INFO:tasks.ceph:role: osd.3 2023-10-06T02:58:53.635 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-06T02:58:53.635 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T02:58:54.133 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:58:54.133 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:58:54.133 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:58:54.133 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 2023-10-06T02:58:54.133 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:58:54.133 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:58:54.133 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:58:54.134 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:58:54.134 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:58:54.134 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:58:54.135 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-10-06T02:58:54.135 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T02:58:54.189 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T02:58:54.200 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T02:58:54.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:58:54.201 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:58:54.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:54.264+0000 7f006abd53c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T02:58:54.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:54.264+0000 7f006abd53c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T02:58:54.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:54.264+0000 7f006abd53c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:58:54.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:54.264+0000 7f006abd53c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:58:54.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:54.264+0000 7f006abd53c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:58:54.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:54.272+0000 7f006abd53c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T02:58:55.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:55.080+0000 7f006abd53c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:58:55.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:55.860+0000 7f006abd53c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:58:56.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:56.652+0000 7f006abd53c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:58:57.520 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T02:58:57.536 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:58:57.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:57.572+0000 7fc22c8c33c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T02:58:57.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:57.572+0000 7fc22c8c33c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T02:58:57.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:57.572+0000 7fc22c8c33c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T02:58:57.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:57.572+0000 7fc22c8c33c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T02:58:57.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:57.572+0000 7fc22c8c33c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T02:58:57.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:57.576+0000 7fc22c8c33c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T02:58:58.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:58.132+0000 7fc22c8c33c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:58:58.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:58.912+0000 7fc22c8c33c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:58:59.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:58:59.692+0000 7fc22c8c33c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:00.564 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T02:59:00.580 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:59:00.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:00.660+0000 7f3dd64223c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T02:59:00.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:00.660+0000 7f3dd64223c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T02:59:00.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:00.660+0000 7f3dd64223c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T02:59:00.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:00.660+0000 7f3dd64223c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T02:59:00.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:00.660+0000 7f3dd64223c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T02:59:00.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:00.660+0000 7f3dd64223c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T02:59:01.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:01.220+0000 7f3dd64223c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:02.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:02.008+0000 7f3dd64223c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:02.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:02.784+0000 7f3dd64223c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:03.651 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T02:59:03.667 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:59:03.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:03.696+0000 7f4db0fd83c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T02:59:03.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:03.696+0000 7f4db0fd83c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T02:59:03.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:03.700+0000 7f4db0fd83c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T02:59:03.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:03.700+0000 7f4db0fd83c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T02:59:03.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:03.700+0000 7f4db0fd83c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T02:59:03.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:03.700+0000 7f4db0fd83c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T02:59:04.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:04.260+0000 7f4db0fd83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:05.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:05.044+0000 7f4db0fd83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:05.844+0000 7f4db0fd83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:06.703 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T02:59:06.718 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T02:59:06.736 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:59:06.736 INFO:tasks.ceph:role: osd.4 2023-10-06T02:59:06.736 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-06T02:59:06.736 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T02:59:07.257 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:59:07.257 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:59:07.257 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:59:07.257 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 2023-10-06T02:59:07.257 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:59:07.258 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:59:07.258 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:59:07.258 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:59:07.258 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:59:07.258 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:59:07.260 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-10-06T02:59:07.261 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T02:59:07.325 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T02:59:07.334 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T02:59:07.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:59:07.335 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T02:59:07.392 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:59:07.392 INFO:tasks.ceph:role: osd.5 2023-10-06T02:59:07.392 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-06T02:59:07.392 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T02:59:07.923 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:59:07.923 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:59:07.923 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:59:07.923 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 2023-10-06T02:59:07.924 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:59:07.924 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:59:07.924 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:59:07.924 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:59:07.924 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:59:07.924 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:59:07.925 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-10-06T02:59:07.925 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T02:59:07.970 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T02:59:08.026 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T02:59:08.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:59:08.027 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T02:59:08.042 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:59:08.042 INFO:tasks.ceph:role: osd.6 2023-10-06T02:59:08.042 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-06T02:59:08.043 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T02:59:08.540 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:59:08.540 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:59:08.540 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:59:08.540 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 2023-10-06T02:59:08.540 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:59:08.540 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:59:08.541 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:59:08.541 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:59:08.541 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:59:08.541 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:59:08.542 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-10-06T02:59:08.542 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T02:59:08.592 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T02:59:08.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:59:08.604 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T02:59:08.605 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T02:59:08.615 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:59:08.616 INFO:tasks.ceph:role: osd.7 2023-10-06T02:59:08.616 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-06T02:59:08.616 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T02:59:09.093 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:59:09.093 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:59:09.093 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:59:09.094 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 2023-10-06T02:59:09.094 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:59:09.094 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:59:09.094 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:59:09.094 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:59:09.094 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:59:09.094 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:59:09.095 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-10-06T02:59:09.095 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T02:59:09.153 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T02:59:09.164 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T02:59:09.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:59:09.165 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:59:09.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:09.276+0000 7f9bc2b513c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T02:59:09.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:09.276+0000 7f9bc2b513c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T02:59:09.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:09.276+0000 7f9bc2b513c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T02:59:09.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:09.276+0000 7f9bc2b513c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T02:59:09.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:09.276+0000 7f9bc2b513c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T02:59:09.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:09.284+0000 7f9bc2b513c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T02:59:10.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:10.084+0000 7f9bc2b513c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:10.872+0000 7f9bc2b513c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:11.656+0000 7f9bc2b513c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:12.531 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T02:59:12.549 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:59:12.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:12.580+0000 7f10de0673c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T02:59:12.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:12.580+0000 7f10de0673c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T02:59:12.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:12.580+0000 7f10de0673c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T02:59:12.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:12.580+0000 7f10de0673c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T02:59:12.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:12.580+0000 7f10de0673c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T02:59:12.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:12.580+0000 7f10de0673c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T02:59:13.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:13.140+0000 7f10de0673c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:13.932+0000 7f10de0673c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:14.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:14.712+0000 7f10de0673c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:15.579 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T02:59:15.638 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:59:15.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:15.672+0000 7f32c23a03c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T02:59:15.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:15.672+0000 7f32c23a03c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T02:59:15.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:15.672+0000 7f32c23a03c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T02:59:15.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:15.672+0000 7f32c23a03c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T02:59:15.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:15.672+0000 7f32c23a03c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T02:59:15.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:15.672+0000 7f32c23a03c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T02:59:16.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:16.236+0000 7f32c23a03c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:17.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:17.028+0000 7f32c23a03c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:17.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:17.812+0000 7f32c23a03c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:18.666 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T02:59:18.680 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:59:18.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:18.760+0000 7fab393f13c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T02:59:18.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:18.760+0000 7fab393f13c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T02:59:18.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:18.760+0000 7fab393f13c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T02:59:18.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:18.760+0000 7fab393f13c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T02:59:18.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:18.760+0000 7fab393f13c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T02:59:18.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:18.760+0000 7fab393f13c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T02:59:19.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:19.312+0000 7fab393f13c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:20.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:20.104+0000 7fab393f13c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:20.172 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:20.174 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:20.177 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:20.179 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:20.182 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:20.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:20.888+0000 7fab393f13c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:21.754 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T02:59:21.806 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T02:59:21.806 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:59:21.806 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T02:59:21.822 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:59:21.822 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T02:59:21.833 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:59:21.842 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T02:59:21.890 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:59:21.891 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T02:59:21.901 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:59:21.901 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T02:59:21.914 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:59:21.915 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T02:59:21.972 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:59:22.063 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T02:59:22.079 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:59:22.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T02:59:22.095 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:59:22.096 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T02:59:22.152 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:59:22.152 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T02:59:22.164 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:59:22.165 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T02:59:22.175 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:59:22.175 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T02:59:22.231 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T02:59:22.231 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T02:59:22.238 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T02:59:22.238 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T02:59:22.245 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T02:59:22.245 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T02:59:22.252 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T02:59:22.252 DEBUG:teuthology.orchestra.run.smithi027:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T02:59:22.255 DEBUG:teuthology.orchestra.run.smithi123:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T02:59:22.267 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr.y] 2023-10-06T02:59:22.267 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDrdx9lodtgHBAAzxGDNE4BwEEMSjRbaESD4g== 2023-10-06T02:59:22.267 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2023-10-06T02:59:22.267 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDrdx9ltv4lIhAAyY7+Nn7z9dZ3DoeEzwqp5w== 2023-10-06T02:59:22.267 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.0] 2023-10-06T02:59:22.267 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDudx9lwWQAEBAAVNbBMovmuLMbfg39y2d2vQ== 2023-10-06T02:59:22.268 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.1] 2023-10-06T02:59:22.268 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDxdx9lrMF5IhAAH8i/Sszr3mntkFHZL/qjgA== 2023-10-06T02:59:22.268 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.2] 2023-10-06T02:59:22.268 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQD0dx9lmIaIJxAAZ4xMLjS3qza7Zqi1IMXkjQ== 2023-10-06T02:59:22.268 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.3] 2023-10-06T02:59:22.268 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQD3dx9leILfKRAAB0oilZcdm6XxQ1vYh00Mig== 2023-10-06T02:59:22.268 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr.x] 2023-10-06T02:59:22.268 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDrdx9lYPBGHxAAlAmgHyQ/UkVChVmjbps7+g== 2023-10-06T02:59:22.268 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b] 2023-10-06T02:59:22.268 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDrdx9lQ8uEKBAAUQaoiznppKOBLf0qYdQohw== 2023-10-06T02:59:22.268 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.4] 2023-10-06T02:59:22.269 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQD9dx9lX+WTEBAAoCnCQswRfSaHg5xdX/FGhQ== 2023-10-06T02:59:22.269 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.5] 2023-10-06T02:59:22.269 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQAAeB9ldUPVIhAAUctDqw2ZmGZLKN5EhVT9nA== 2023-10-06T02:59:22.269 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.6] 2023-10-06T02:59:22.269 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQADeB9lhg0wKBAAWoLiZODzSkNj8LwX3gmSpg== 2023-10-06T02:59:22.269 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.7] 2023-10-06T02:59:22.269 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQAGeB9lE6h5LRAAJTIX4GRgPxmLMFxQ2tYrZg== 2023-10-06T02:59:22.269 INFO:teuthology.orchestra.run.smithi027.stdout:[client.0] 2023-10-06T02:59:22.269 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDrdx9lm51+KxAAUxiixYFSMXEK1v6gSGOM+Q== 2023-10-06T02:59:22.269 INFO:teuthology.orchestra.run.smithi027.stdout:[client.1] 2023-10-06T02:59:22.269 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDrdx9lwFHALhAAqDmYol+x/apK8guKPgAUeQ== 2023-10-06T02:59:22.270 INFO:teuthology.orchestra.run.smithi027.stdout:[client.2] 2023-10-06T02:59:22.270 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDrdx9l3paxMRAAVENXZhBLfwC3WZ+XulMRkQ== 2023-10-06T02:59:22.271 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.y] 2023-10-06T02:59:22.271 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrdx9lodtgHBAAzxGDNE4BwEEMSjRbaESD4g== 2023-10-06T02:59:22.271 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2023-10-06T02:59:22.271 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrdx9ltv4lIhAAyY7+Nn7z9dZ3DoeEzwqp5w== 2023-10-06T02:59:22.271 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.0] 2023-10-06T02:59:22.272 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDudx9lwWQAEBAAVNbBMovmuLMbfg39y2d2vQ== 2023-10-06T02:59:22.272 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.1] 2023-10-06T02:59:22.272 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDxdx9lrMF5IhAAH8i/Sszr3mntkFHZL/qjgA== 2023-10-06T02:59:22.272 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.2] 2023-10-06T02:59:22.272 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQD0dx9lmIaIJxAAZ4xMLjS3qza7Zqi1IMXkjQ== 2023-10-06T02:59:22.272 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.3] 2023-10-06T02:59:22.272 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQD3dx9leILfKRAAB0oilZcdm6XxQ1vYh00Mig== 2023-10-06T02:59:22.272 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.x] 2023-10-06T02:59:22.272 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrdx9lYPBGHxAAlAmgHyQ/UkVChVmjbps7+g== 2023-10-06T02:59:22.272 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2023-10-06T02:59:22.272 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrdx9lQ8uEKBAAUQaoiznppKOBLf0qYdQohw== 2023-10-06T02:59:22.272 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.4] 2023-10-06T02:59:22.273 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQD9dx9lX+WTEBAAoCnCQswRfSaHg5xdX/FGhQ== 2023-10-06T02:59:22.273 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.5] 2023-10-06T02:59:22.273 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQAAeB9ldUPVIhAAUctDqw2ZmGZLKN5EhVT9nA== 2023-10-06T02:59:22.273 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.6] 2023-10-06T02:59:22.273 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQADeB9lhg0wKBAAWoLiZODzSkNj8LwX3gmSpg== 2023-10-06T02:59:22.273 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.7] 2023-10-06T02:59:22.273 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQAGeB9lE6h5LRAAJTIX4GRgPxmLMFxQ2tYrZg== 2023-10-06T02:59:22.273 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2023-10-06T02:59:22.273 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrdx9lm51+KxAAUxiixYFSMXEK1v6gSGOM+Q== 2023-10-06T02:59:22.273 INFO:teuthology.orchestra.run.smithi123.stdout:[client.1] 2023-10-06T02:59:22.273 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrdx9lwFHALhAAqDmYol+x/apK8guKPgAUeQ== 2023-10-06T02:59:22.273 INFO:teuthology.orchestra.run.smithi123.stdout:[client.2] 2023-10-06T02:59:22.274 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrdx9l3paxMRAAVENXZhBLfwC3WZ+XulMRkQ== 2023-10-06T02:59:22.274 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:59:22.276 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:59:22.358 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:59:22.364 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:59:22.412 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.414 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.457 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.460 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.541 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.544 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.587 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.632 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:59:22.667 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:59:22.720 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:59:22.752 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:59:22.800 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.803 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.844 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.847 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.887 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.928 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.974 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:22.976 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:59:23.018 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:59:23.020 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:59:23.109 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:59:23.112 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:59:23.158 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:59:23.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:59:23.206 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T02:59:23.206 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T02:59:23.216 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:59:23.275 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T02:59:23.288 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T02:59:23.305 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:59:23.360 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T02:59:23.374 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T02:59:23.387 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:59:23.444 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T02:59:23.456 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:59:23.459 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:59:23.463 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T02:59:23.464 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T02:59:23.464 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T02:59:23.508 INFO:tasks.ceph.mon.a:Started 2023-10-06T02:59:23.508 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T02:59:23.508 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T02:59:23.510 INFO:tasks.ceph.mon.b:Started 2023-10-06T02:59:23.511 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T02:59:23.511 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T02:59:23.513 INFO:tasks.ceph.mon.c:Started 2023-10-06T02:59:23.513 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T02:59:23.513 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T02:59:23.513 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T02:59:23.515 INFO:tasks.ceph.mgr.y:Started 2023-10-06T02:59:23.515 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T02:59:23.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T02:59:23.518 INFO:tasks.ceph.mgr.x:Started 2023-10-06T02:59:23.518 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T02:59:23.518 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T02:59:23.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f972d395700 1 Processor -- start 2023-10-06T02:59:23.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f972d395700 1 -- start start 2023-10-06T02:59:23.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f972d395700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:23.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f972d395700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972814f800 con 0x7f97280698d0 2023-10-06T02:59:23.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f972d395700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972814fae0 con 0x7f972814f1a0 2023-10-06T02:59:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f972d395700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f972814f620 con 0x7f972814edd0 2023-10-06T02:59:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f9726ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f9726ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42576/0 (socket says 172.21.15.27:42576) 2023-10-06T02:59:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 learned_addr learned my addr 172.21.15.27:0/3255844466 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f97267fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f97280698d0 0x7f972814ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:56060/0 (socket says 172.21.15.27:56060) 2023-10-06T02:59:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 msgr2=0x7f972814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T02:59:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 msgr2=0x7f972814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:59:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:59:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.620+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T02:59:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.824+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.824+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 msgr2=0x7f972814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T02:59:23.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.824+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 msgr2=0x7f972814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:59:23.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.824+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:59:23.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:23.824+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T02:59:24.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:24.228+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:24.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:24.228+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 msgr2=0x7f972814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T02:59:24.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:24.228+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 msgr2=0x7f972814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:59:24.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:24.228+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:59:24.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:24.228+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T02:59:25.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:25.032+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:25.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:25.032+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 msgr2=0x7f972814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T02:59:25.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:25.032+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 msgr2=0x7f972814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:59:25.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:25.032+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:59:25.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:25.032+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T02:59:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f9724ff9700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 msgr2=0x7f972814c630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:59:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f9724ff9700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.27:3300/0 conn(0x7f972814edd0 0x7f972814c630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f9724ff9700 1 -- 172.21.15.27:0/3255844466 >> v1:172.21.15.123:6789/0 conn(0x7f972814f1a0 legacy=0x7f97280b8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f9724ff9700 1 -- 172.21.15.27:0/3255844466 >> v1:172.21.15.27:6789/0 conn(0x7f97280698d0 legacy=0x7f972814ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f9724ff9700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f9724ff9700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f9724ff9700 1 -- 172.21.15.27:0/3255844466 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f972814f620 con 0x7f9708006230 2023-10-06T02:59:26.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f9724ff9700 1 -- 172.21.15.27:0/3255844466 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9708008d70 con 0x7f9708003760 2023-10-06T02:59:26.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:26.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:26.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 msgr2=0x7f9708005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T02:59:26.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 msgr2=0x7f9708005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:59:26.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:59:26.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T02:59:26.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f97267fc700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 msgr2=0x7f97080086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T02:59:26.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f97267fc700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 msgr2=0x7f97080086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:59:26.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:59:26.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.619+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T02:59:26.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.823+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:26.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.823+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:26.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.823+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 msgr2=0x7f9708005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T02:59:26.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.823+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 msgr2=0x7f9708005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:59:26.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.823+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:59:26.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.823+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T02:59:26.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.823+0000 7f97267fc700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 msgr2=0x7f97080086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T02:59:26.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.823+0000 7f97267fc700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 msgr2=0x7f97080086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:59:26.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.823+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:59:26.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:26.823+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T02:59:27.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:27.227+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:27.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:27.227+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:27.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:27.227+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 msgr2=0x7f9708005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T02:59:27.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:27.227+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 msgr2=0x7f9708005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:59:27.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:27.227+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:59:27.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:27.227+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T02:59:27.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:27.227+0000 7f97267fc700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 msgr2=0x7f97080086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T02:59:27.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:27.227+0000 7f97267fc700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 msgr2=0x7f97080086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:59:27.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:27.227+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:59:27.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:27.227+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T02:59:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:28.031+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:28.031+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:28.031+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 msgr2=0x7f9708005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T02:59:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:28.031+0000 7f9726ffd700 1 -- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 msgr2=0x7f9708005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:59:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:28.031+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:59:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:28.031+0000 7f9726ffd700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T02:59:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:28.031+0000 7f97267fc700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 msgr2=0x7f97080086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T02:59:28.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:28.031+0000 7f97267fc700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 msgr2=0x7f97080086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:59:28.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:28.031+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:59:28.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:28.031+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T02:59:28.951 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:28.948+0000 7efc54752000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T02:59:29.619 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:29.616+0000 7efc54752000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T02:59:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9724ff9700 1 -- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 msgr2=0x7f9708005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:59:29.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9724ff9700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:29.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9724ff9700 1 -- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 msgr2=0x7f97080086e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:59:29.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9724ff9700 1 --2- 172.21.15.27:0/3255844466 >> v2:172.21.15.123:3300/0 conn(0x7f9708006230 0x7f97080086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:29.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f97277fe700 1 -- 172.21.15.27:0/3255844466 reap_dead start 2023-10-06T02:59:29.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9724ff9700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:29.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9724ff9700 1 -- 172.21.15.27:0/3255844466 --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9728068fd0 con 0x7f97080066d0 2023-10-06T02:59:29.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9724ff9700 1 -- 172.21.15.27:0/3255844466 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970800efd0 con 0x7f972814f1a0 2023-10-06T02:59:29.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9724ff9700 1 -- 172.21.15.27:0/3255844466 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972814f620 con 0x7f9708003760 2023-10-06T02:59:29.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9725ffb700 1 -- 172.21.15.27:0/3255844466 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569888996 0 0) 0x7f9728068fd0 con 0x7f97080066d0 2023-10-06T02:59:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9725ffb700 1 -- 172.21.15.27:0/3255844466 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9714003570 con 0x7f97080066d0 2023-10-06T02:59:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9725ffb700 1 -- 172.21.15.27:0/3255844466 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139142293 0 0) 0x7f970800efd0 con 0x7f972814f1a0 2023-10-06T02:59:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9725ffb700 1 -- 172.21.15.27:0/3255844466 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9728068fd0 con 0x7f972814f1a0 2023-10-06T02:59:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f97267fc700 1 -- 172.21.15.27:0/3255844466 >> v1:172.21.15.123:6789/0 conn(0x7f972814f1a0 legacy=0x7f970800b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f97267fc700 1 -- 172.21.15.27:0/3255844466 >> v1:172.21.15.27:6789/0 conn(0x7f97080066d0 legacy=0x7f970800c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f97267fc700 1 -- 172.21.15.27:0/3255844466 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97080101c0 con 0x7f9708003760 2023-10-06T02:59:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f97267fc700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9710007cc0 tx=0x7f9710009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2caff988778fac18 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9725ffb700 1 -- 172.21.15.27:0/3255844466 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710005e10 con 0x7f9708003760 2023-10-06T02:59:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9725ffb700 1 -- 172.21.15.27:0/3255844466 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9710017460 con 0x7f9708003760 2023-10-06T02:59:29.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f9725ffb700 1 -- 172.21.15.27:0/3255844466 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710017820 con 0x7f9708003760 2023-10-06T02:59:29.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f972d395700 1 -- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 msgr2=0x7f9708005ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:29.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f972d395700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9710007cc0 tx=0x7f9710009040 comp rx=0 tx=0).stop 2023-10-06T02:59:29.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f972d395700 1 -- 172.21.15.27:0/3255844466 shutdown_connections 2023-10-06T02:59:29.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f972d395700 1 --2- 172.21.15.27:0/3255844466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9708003760 0x7f9708005ba0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:29.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f972d395700 1 -- 172.21.15.27:0/3255844466 >> 172.21.15.27:0/3255844466 conn(0x7f97280be540 msgr2=0x7f97280be940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:29.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f972d395700 1 -- 172.21.15.27:0/3255844466 shutdown_connections 2023-10-06T02:59:29.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.623+0000 7f972d395700 1 -- 172.21.15.27:0/3255844466 wait complete. 2023-10-06T02:59:29.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f972d395700 1 Processor -- start 2023-10-06T02:59:29.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f972d395700 1 -- start start 2023-10-06T02:59:29.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f972d395700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9708003760 0x7f972811d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:29.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f972d395700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97080066d0 0x7f972815f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:29.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f972d395700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f972814f1a0 0x7f97280b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:29.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f972d395700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972815fb70 con 0x7f9708003760 2023-10-06T02:59:29.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f972d395700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97280b6730 con 0x7f972814f1a0 2023-10-06T02:59:29.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f972d395700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972811bde0 con 0x7f97080066d0 2023-10-06T02:59:29.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f9726ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9708003760 0x7f972811d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:29.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f97277fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f972814f1a0 0x7f97280b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:29.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f97267fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97080066d0 0x7f972815f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:29.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f97277fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f972814f1a0 0x7f97280b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:47762/0 (socket says 172.21.15.27:47762) 2023-10-06T02:59:29.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f9726ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9708003760 0x7f972811d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45672/0 (socket says 172.21.15.27:45672) 2023-10-06T02:59:29.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f97267fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97080066d0 0x7f972815f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.27:33064/0 (socket says 172.21.15.27:33064) 2023-10-06T02:59:29.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.627+0000 7f9726ffd700 1 -- 172.21.15.27:0/510317847 learned_addr learned my addr 172.21.15.27:0/510317847 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:29.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f9726ffd700 1 -- 172.21.15.27:0/510317847 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97080066d0 msgr2=0x7f972815f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:29.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f9726ffd700 1 --2- 172.21.15.27:0/510317847 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97080066d0 0x7f972815f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:29.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f9726ffd700 1 -- 172.21.15.27:0/510317847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f972814f1a0 msgr2=0x7f97280b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:29.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f9726ffd700 1 --2- 172.21.15.27:0/510317847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f972814f1a0 0x7f97280b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:29.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f9726ffd700 1 -- 172.21.15.27:0/510317847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971000f040 con 0x7f9708003760 2023-10-06T02:59:29.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f97267fc700 1 --2- 172.21.15.27:0/510317847 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97080066d0 0x7f972815f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:29.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f97277fe700 1 --2- 172.21.15.27:0/510317847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f972814f1a0 0x7f97280b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:29.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f9726ffd700 1 --2- 172.21.15.27:0/510317847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9708003760 0x7f972811d110 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f972001aea0 tx=0x7f9720009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:29.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f971effd700 1 -- 172.21.15.27:0/510317847 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720018da0 con 0x7f9708003760 2023-10-06T02:59:29.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f971effd700 1 -- 172.21.15.27:0/510317847 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972000f040 con 0x7f9708003760 2023-10-06T02:59:29.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f971effd700 1 -- 172.21.15.27:0/510317847 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972000b320 con 0x7f9708003760 2023-10-06T02:59:29.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f972d395700 1 -- 172.21.15.27:0/510317847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972811d650 con 0x7f9708003760 2023-10-06T02:59:29.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f972d395700 1 -- 172.21.15.27:0/510317847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972815f580 con 0x7f9708003760 2023-10-06T02:59:29.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f971effd700 1 -- 172.21.15.27:0/510317847 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9720009720 con 0x7f9708003760 2023-10-06T02:59:29.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f971effd700 1 -- 172.21.15.27:0/510317847 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f972002c820 con 0x7f9708003760 2023-10-06T02:59:29.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.631+0000 7f972d395700 1 -- 172.21.15.27:0/510317847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972804be40 con 0x7f9708003760 2023-10-06T02:59:29.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.635+0000 7f971effd700 1 -- 172.21.15.27:0/510317847 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9720027070 con 0x7f9708003760 2023-10-06T02:59:29.677 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:29.672+0000 7efc54752000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T02:59:29.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.707+0000 7f972d395700 1 -- 172.21.15.27:0/510317847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f972815f950 con 0x7f9708003760 2023-10-06T02:59:29.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.719+0000 7f971effd700 1 -- 172.21.15.27:0/510317847 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9720009bb0 con 0x7f9708003760 2023-10-06T02:59:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.723+0000 7f972d395700 1 -- 172.21.15.27:0/510317847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9708003760 msgr2=0x7f972811d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.723+0000 7f972d395700 1 --2- 172.21.15.27:0/510317847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9708003760 0x7f972811d110 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f972001aea0 tx=0x7f9720009040 comp rx=0 tx=0).stop 2023-10-06T02:59:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.723+0000 7f972d395700 1 -- 172.21.15.27:0/510317847 shutdown_connections 2023-10-06T02:59:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.723+0000 7f972d395700 1 --2- 172.21.15.27:0/510317847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f972814f1a0 0x7f97280b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.723+0000 7f972d395700 1 --2- 172.21.15.27:0/510317847 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97080066d0 0x7f972815f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.723+0000 7f972d395700 1 --2- 172.21.15.27:0/510317847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9708003760 0x7f972811d110 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:29.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.723+0000 7f972d395700 1 -- 172.21.15.27:0/510317847 >> 172.21.15.27:0/510317847 conn(0x7f97280be540 msgr2=0x7f972814b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:29.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.723+0000 7f972d395700 1 -- 172.21.15.27:0/510317847 shutdown_connections 2023-10-06T02:59:29.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:29.723+0000 7f972d395700 1 -- 172.21.15.27:0/510317847 wait complete. 2023-10-06T02:59:29.728 INFO:teuthology.orchestra.run.smithi027.stderr:adjusted tunables profile to default 2023-10-06T02:59:29.743 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T02:59:29.743 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:59:29.743 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T02:59:29.755 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:59:29.756 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T02:59:29.767 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:59:29.767 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T02:59:29.782 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T02:59:29.782 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T02:59:29.792 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:59:29.793 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T02:59:29.793 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:29.788+0000 7efc54752000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:59:29.806 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:59:29.807 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T02:59:29.825 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:29.819+0000 7f07b0ef7000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T02:59:29.864 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:59:29.864 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T02:59:29.873 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T02:59:29.873 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T02:59:29.883 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new a1a922f3-a57d-4ee4-8863-36dd4dbdeade 0 2023-10-06T02:59:30.021 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:30.016+0000 7efc54752000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T02:59:30.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.028+0000 7f81f0d01700 1 Processor -- start 2023-10-06T02:59:30.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.028+0000 7f81f0d01700 1 -- start start 2023-10-06T02:59:30.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.028+0000 7f81f0d01700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81ec0b8630 0x7f81ec0697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.028+0000 7f81f0d01700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81ec144f60 0x7f81ec145390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.028+0000 7f81f0d01700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ec0692f0 con 0x7f81ec06d2a0 2023-10-06T02:59:30.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.028+0000 7f81f0d01700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ec149270 con 0x7f81ec144f60 2023-10-06T02:59:30.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.028+0000 7f81f0d01700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec06a440 con 0x7f81ec0b8630 2023-10-06T02:59:30.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.028+0000 7f81ea59c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81ec0b8630 0x7f81ec0697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.028+0000 7f81ead9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81ec144f60 0x7f81ec145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81ea59c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81ec0b8630 0x7f81ec0697f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:46694/0 (socket says 172.21.15.123:46694) 2023-10-06T02:59:30.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81ea59c700 1 -- 172.21.15.123:0/2324627346 learned_addr learned my addr 172.21.15.123:0/2324627346 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-06T02:59:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81ea59c700 1 -- 172.21.15.123:0/2324627346 >> v2:172.21.15.123:3300/0 conn(0x7f81ec144f60 msgr2=0x7f81ec145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81ea59c700 1 --2- 172.21.15.123:0/2324627346 >> v2:172.21.15.123:3300/0 conn(0x7f81ec144f60 0x7f81ec145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81ea59c700 1 -- 172.21.15.123:0/2324627346 >> v1:172.21.15.123:6789/0 conn(0x7f81ec06d2a0 legacy=0x7f81ec069d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81ea59c700 1 -- 172.21.15.123:0/2324627346 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec148f40 con 0x7f81ec0b8630 2023-10-06T02:59:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81ead9d700 1 --2- 172.21.15.123:0/2324627346 >> v2:172.21.15.123:3300/0 conn(0x7f81ec144f60 0x7f81ec145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:30.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81ea59c700 1 --2- 172.21.15.123:0/2324627346 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81ec0b8630 0x7f81ec0697f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0099b0 tx=0x7f81dc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aebfcd48297fef40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:30.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81e959a700 1 -- 172.21.15.123:0/2324627346 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc009ea0 con 0x7f81ec0b8630 2023-10-06T02:59:30.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81e959a700 1 -- 172.21.15.123:0/2324627346 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc00b860 con 0x7f81ec0b8630 2023-10-06T02:59:30.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81e959a700 1 -- 172.21.15.123:0/2324627346 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc00bc00 con 0x7f81ec0b8630 2023-10-06T02:59:30.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 -- 172.21.15.123:0/2324627346 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81ec0b8630 msgr2=0x7f81ec0697f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 --2- 172.21.15.123:0/2324627346 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81ec0b8630 0x7f81ec0697f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0099b0 tx=0x7f81dc009250 comp rx=0 tx=0).stop 2023-10-06T02:59:30.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 -- 172.21.15.123:0/2324627346 shutdown_connections 2023-10-06T02:59:30.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 --2- 172.21.15.123:0/2324627346 >> v2:172.21.15.123:3300/0 conn(0x7f81ec144f60 0x7f81ec145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 --2- 172.21.15.123:0/2324627346 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81ec0b8630 0x7f81ec0697f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 -- 172.21.15.123:0/2324627346 >> 172.21.15.123:0/2324627346 conn(0x7f81ec0be540 msgr2=0x7f81ec0be940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:30.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 -- 172.21.15.123:0/2324627346 shutdown_connections 2023-10-06T02:59:30.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 -- 172.21.15.123:0/2324627346 wait complete. 2023-10-06T02:59:30.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 Processor -- start 2023-10-06T02:59:30.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 -- start start 2023-10-06T02:59:30.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81ec06d2a0 0x7f81ec13e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81ec0b8630 0x7f81ec0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81ec144f60 0x7f81ec15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec14b3d0 con 0x7f81ec144f60 2023-10-06T02:59:30.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec147b70 con 0x7f81ec06d2a0 2023-10-06T02:59:30.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.032+0000 7f81f0d01700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec146ec0 con 0x7f81ec0b8630 2023-10-06T02:59:30.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81ea59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81ec06d2a0 0x7f81ec13e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81e9d9b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81ec0b8630 0x7f81ec0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81ea59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81ec06d2a0 0x7f81ec13e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50572/0 (socket says 172.21.15.123:50572) 2023-10-06T02:59:30.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81ea59c700 1 -- 172.21.15.123:0/1754018846 learned_addr learned my addr 172.21.15.123:0/1754018846 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-06T02:59:30.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81ead9d700 1 --2- 172.21.15.123:0/1754018846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81ec144f60 0x7f81ec15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81ea59c700 1 -- 172.21.15.123:0/1754018846 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81ec0b8630 msgr2=0x7f81ec0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81ea59c700 1 --2- 172.21.15.123:0/1754018846 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81ec0b8630 0x7f81ec0bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81ea59c700 1 -- 172.21.15.123:0/1754018846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81ec144f60 msgr2=0x7f81ec15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81ea59c700 1 --2- 172.21.15.123:0/1754018846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81ec144f60 0x7f81ec15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81ea59c700 1 -- 172.21.15.123:0/1754018846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e4009a20 con 0x7f81ec06d2a0 2023-10-06T02:59:30.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81ea59c700 1 --2- 172.21.15.123:0/1754018846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81ec06d2a0 0x7f81ec13e9a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f81ec06a580 tx=0x7f81dc019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:30.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81da7fc700 1 -- 172.21.15.123:0/1754018846 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc01e070 con 0x7f81ec06d2a0 2023-10-06T02:59:30.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81da7fc700 1 -- 172.21.15.123:0/1754018846 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc000c40 con 0x7f81ec06d2a0 2023-10-06T02:59:30.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81f0d01700 1 -- 172.21.15.123:0/1754018846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc0094f0 con 0x7f81ec06d2a0 2023-10-06T02:59:30.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81da7fc700 1 -- 172.21.15.123:0/1754018846 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc010470 con 0x7f81ec06d2a0 2023-10-06T02:59:30.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81f0d01700 1 -- 172.21.15.123:0/1754018846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ec147890 con 0x7f81ec06d2a0 2023-10-06T02:59:30.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81da7fc700 1 -- 172.21.15.123:0/1754018846 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f81dc022070 con 0x7f81ec06d2a0 2023-10-06T02:59:30.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81da7fc700 1 -- 172.21.15.123:0/1754018846 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f81dc014070 con 0x7f81ec06d2a0 2023-10-06T02:59:30.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.036+0000 7f81f0d01700 1 -- 172.21.15.123:0/1754018846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ec04be40 con 0x7f81ec06d2a0 2023-10-06T02:59:30.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.040+0000 7f81da7fc700 1 -- 172.21.15.123:0/1754018846 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f81dc029070 con 0x7f81ec06d2a0 2023-10-06T02:59:30.069 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:30.064+0000 7efc54752000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T02:59:30.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.116+0000 7f81f0d01700 1 -- 172.21.15.123:0/1754018846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a1a922f3-a57d-4ee4-8863-36dd4dbdeade", "id": 0} v 0) v1 -- 0x7f81ec0ba770 con 0x7f81ec06d2a0 2023-10-06T02:59:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.124+0000 7f81da7fc700 1 -- 172.21.15.123:0/1754018846 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a1a922f3-a57d-4ee4-8863-36dd4dbdeade", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f81dc024420 con 0x7f81ec06d2a0 2023-10-06T02:59:30.127 INFO:teuthology.orchestra.run.smithi123.stdout:0 2023-10-06T02:59:30.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.124+0000 7f81f0d01700 1 -- 172.21.15.123:0/1754018846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81ec06d2a0 msgr2=0x7f81ec13e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.124+0000 7f81f0d01700 1 --2- 172.21.15.123:0/1754018846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81ec06d2a0 0x7f81ec13e9a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f81ec06a580 tx=0x7f81dc019000 comp rx=0 tx=0).stop 2023-10-06T02:59:30.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.124+0000 7f81f0d01700 1 -- 172.21.15.123:0/1754018846 shutdown_connections 2023-10-06T02:59:30.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.124+0000 7f81f0d01700 1 --2- 172.21.15.123:0/1754018846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81ec144f60 0x7f81ec15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.124+0000 7f81f0d01700 1 --2- 172.21.15.123:0/1754018846 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81ec0b8630 0x7f81ec0bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.124+0000 7f81f0d01700 1 --2- 172.21.15.123:0/1754018846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81ec06d2a0 0x7f81ec13e9a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.124+0000 7f81f0d01700 1 -- 172.21.15.123:0/1754018846 >> 172.21.15.123:0/1754018846 conn(0x7f81ec0be540 msgr2=0x7f81ec14d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:30.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.124+0000 7f81f0d01700 1 -- 172.21.15.123:0/1754018846 shutdown_connections 2023-10-06T02:59:30.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.124+0000 7f81f0d01700 1 -- 172.21.15.123:0/1754018846 wait complete. 2023-10-06T02:59:30.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 82f01570-4085-4e2a-b4e8-8c9bf3e3d412 1 2023-10-06T02:59:30.239 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:30.235+0000 7efc54752000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T02:59:30.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.239+0000 7f1036b5d700 1 Processor -- start 2023-10-06T02:59:30.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.239+0000 7f1036b5d700 1 -- start start 2023-10-06T02:59:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.239+0000 7f1036b5d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f103006e800 0x7f10300b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.239+0000 7f1036b5d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f103006aa70 0x7f103006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.239+0000 7f1036b5d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f10300b4610 0x7f103006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.239+0000 7f1036b5d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10300b5030 con 0x7f103006aa70 2023-10-06T02:59:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.239+0000 7f1036b5d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1030142860 con 0x7f103006e800 2023-10-06T02:59:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.239+0000 7f1036b5d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1030148d40 con 0x7f10300b4610 2023-10-06T02:59:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f10350fa700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f10300b4610 0x7f103006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f10348f9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f103006e800 0x7f10300b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f10348f9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f103006e800 0x7f10300b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50582/0 (socket says 172.21.15.123:50582) 2023-10-06T02:59:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f10348f9700 1 -- 172.21.15.123:0/3270460571 learned_addr learned my addr 172.21.15.123:0/3270460571 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-06T02:59:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f10350fa700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f10300b4610 0x7f103006d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:46710/0 (socket says 172.21.15.123:46710) 2023-10-06T02:59:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f102ffff700 1 --2- 172.21.15.123:0/3270460571 >> v2:172.21.15.27:3300/0 conn(0x7f103006aa70 0x7f103006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f10348f9700 1 -- 172.21.15.123:0/3270460571 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f10300b4610 msgr2=0x7f103006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f10348f9700 1 --2- 172.21.15.123:0/3270460571 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f10300b4610 0x7f103006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f10348f9700 1 -- 172.21.15.123:0/3270460571 >> v2:172.21.15.27:3300/0 conn(0x7f103006aa70 msgr2=0x7f103006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f10348f9700 1 --2- 172.21.15.123:0/3270460571 >> v2:172.21.15.27:3300/0 conn(0x7f103006aa70 0x7f103006d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f10348f9700 1 -- 172.21.15.123:0/3270460571 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10301486f0 con 0x7f103006e800 2023-10-06T02:59:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f10350fa700 1 --2- 172.21.15.123:0/3270460571 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f10300b4610 0x7f103006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f102ffff700 1 --2- 172.21.15.123:0/3270460571 >> v2:172.21.15.27:3300/0 conn(0x7f103006aa70 0x7f103006d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:30.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f10348f9700 1 --2- 172.21.15.123:0/3270460571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f103006e800 0x7f10300b40d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1030068260 tx=0x7f102400b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de36b3b1b9c77be1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:30.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f102f7fe700 1 -- 172.21.15.123:0/3270460571 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400dba0 con 0x7f103006e800 2023-10-06T02:59:30.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f102f7fe700 1 -- 172.21.15.123:0/3270460571 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102400dd00 con 0x7f103006e800 2023-10-06T02:59:30.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f102f7fe700 1 -- 172.21.15.123:0/3270460571 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10240196d0 con 0x7f103006e800 2023-10-06T02:59:30.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f1036b5d700 1 -- 172.21.15.123:0/3270460571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f103006e800 msgr2=0x7f10300b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f1036b5d700 1 --2- 172.21.15.123:0/3270460571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f103006e800 0x7f10300b40d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1030068260 tx=0x7f102400b4f0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f1036b5d700 1 -- 172.21.15.123:0/3270460571 shutdown_connections 2023-10-06T02:59:30.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f1036b5d700 1 --2- 172.21.15.123:0/3270460571 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f10300b4610 0x7f103006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f1036b5d700 1 --2- 172.21.15.123:0/3270460571 >> v2:172.21.15.27:3300/0 conn(0x7f103006aa70 0x7f103006d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f1036b5d700 1 --2- 172.21.15.123:0/3270460571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f103006e800 0x7f10300b40d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f1036b5d700 1 -- 172.21.15.123:0/3270460571 >> 172.21.15.123:0/3270460571 conn(0x7f10300bedd0 msgr2=0x7f10300bf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:30.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f1036b5d700 1 -- 172.21.15.123:0/3270460571 shutdown_connections 2023-10-06T02:59:30.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f1036b5d700 1 -- 172.21.15.123:0/3270460571 wait complete. 2023-10-06T02:59:30.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f1036b5d700 1 Processor -- start 2023-10-06T02:59:30.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.243+0000 7f1036b5d700 1 -- start start 2023-10-06T02:59:30.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f1036b5d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f103006aa70 0x7f1030142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f1036b5d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f103006e800 0x7f103014bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f1036b5d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10300b4610 0x7f10300b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f1036b5d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103014c020 con 0x7f103006aa70 2023-10-06T02:59:30.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f1036b5d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10300b8df0 con 0x7f10300b4610 2023-10-06T02:59:30.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f1036b5d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10300b90d0 con 0x7f103006e800 2023-10-06T02:59:30.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f102ffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f103006e800 0x7f103014bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f10350fa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10300b4610 0x7f10300b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f102ffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f103006e800 0x7f103014bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:46720/0 (socket says 172.21.15.123:46720) 2023-10-06T02:59:30.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f10350fa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10300b4610 0x7f10300b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50596/0 (socket says 172.21.15.123:50596) 2023-10-06T02:59:30.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f102ffff700 1 -- 172.21.15.123:0/2978392726 learned_addr learned my addr 172.21.15.123:0/2978392726 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-06T02:59:30.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f10348f9700 1 --2- 172.21.15.123:0/2978392726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f103006aa70 0x7f1030142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f10350fa700 1 -- 172.21.15.123:0/2978392726 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f103006e800 msgr2=0x7f103014bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f10350fa700 1 --2- 172.21.15.123:0/2978392726 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f103006e800 0x7f103014bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f10350fa700 1 -- 172.21.15.123:0/2978392726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f103006aa70 msgr2=0x7f1030142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f10350fa700 1 --2- 172.21.15.123:0/2978392726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f103006aa70 0x7f1030142e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f10350fa700 1 -- 172.21.15.123:0/2978392726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028009a20 con 0x7f10300b4610 2023-10-06T02:59:30.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f102ffff700 1 --2- 172.21.15.123:0/2978392726 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f103006e800 0x7f103014bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:30.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f10350fa700 1 --2- 172.21.15.123:0/2978392726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10300b4610 0x7f10300b72c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1028009e30 tx=0x7f102800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:30.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f102cff9700 1 -- 172.21.15.123:0/2978392726 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102800caa0 con 0x7f10300b4610 2023-10-06T02:59:30.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f102cff9700 1 -- 172.21.15.123:0/2978392726 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102800f040 con 0x7f10300b4610 2023-10-06T02:59:30.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f1036b5d700 1 -- 172.21.15.123:0/2978392726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102400b790 con 0x7f10300b4610 2023-10-06T02:59:30.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f102cff9700 1 -- 172.21.15.123:0/2978392726 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102800ce70 con 0x7f10300b4610 2023-10-06T02:59:30.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f1036b5d700 1 -- 172.21.15.123:0/2978392726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1030156e50 con 0x7f10300b4610 2023-10-06T02:59:30.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f102cff9700 1 -- 172.21.15.123:0/2978392726 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1028014690 con 0x7f10300b4610 2023-10-06T02:59:30.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f102cff9700 1 -- 172.21.15.123:0/2978392726 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f102801d860 con 0x7f10300b4610 2023-10-06T02:59:30.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.247+0000 7f1036b5d700 1 -- 172.21.15.123:0/2978392726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103004be40 con 0x7f10300b4610 2023-10-06T02:59:30.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.251+0000 7f102cff9700 1 -- 172.21.15.123:0/2978392726 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f102803b6d0 con 0x7f10300b4610 2023-10-06T02:59:30.300 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:30.295+0000 7efc54752000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T02:59:30.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.327+0000 7f1036b5d700 1 -- 172.21.15.123:0/2978392726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "82f01570-4085-4e2a-b4e8-8c9bf3e3d412", "id": 1} v 0) v1 -- 0x7f10301489d0 con 0x7f10300b4610 2023-10-06T02:59:30.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.331+0000 7f102cff9700 1 -- 172.21.15.123:0/2978392726 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "82f01570-4085-4e2a-b4e8-8c9bf3e3d412", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f102802a070 con 0x7f10300b4610 2023-10-06T02:59:30.337 INFO:teuthology.orchestra.run.smithi123.stdout:1 2023-10-06T02:59:30.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.335+0000 7f1036b5d700 1 -- 172.21.15.123:0/2978392726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10300b4610 msgr2=0x7f10300b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.335+0000 7f1036b5d700 1 --2- 172.21.15.123:0/2978392726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10300b4610 0x7f10300b72c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1028009e30 tx=0x7f102800b040 comp rx=0 tx=0).stop 2023-10-06T02:59:30.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.335+0000 7f1036b5d700 1 -- 172.21.15.123:0/2978392726 shutdown_connections 2023-10-06T02:59:30.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.335+0000 7f1036b5d700 1 --2- 172.21.15.123:0/2978392726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10300b4610 0x7f10300b72c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.335+0000 7f1036b5d700 1 --2- 172.21.15.123:0/2978392726 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f103006e800 0x7f103014bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.335+0000 7f1036b5d700 1 --2- 172.21.15.123:0/2978392726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f103006aa70 0x7f1030142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.335+0000 7f1036b5d700 1 -- 172.21.15.123:0/2978392726 >> 172.21.15.123:0/2978392726 conn(0x7f10300bedd0 msgr2=0x7f10300bccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:30.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.335+0000 7f1036b5d700 1 -- 172.21.15.123:0/2978392726 shutdown_connections 2023-10-06T02:59:30.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.335+0000 7f1036b5d700 1 -- 172.21.15.123:0/2978392726 wait complete. 2023-10-06T02:59:30.352 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new c66d843c-8b3b-42ad-9ced-84b982956c2f 2 2023-10-06T02:59:30.360 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:30.355+0000 7efc54752000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T02:59:30.426 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:30.419+0000 7f07b0ef7000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T02:59:30.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f1919e700 1 Processor -- start 2023-10-06T02:59:30.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f1919e700 1 -- start start 2023-10-06T02:59:30.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f1919e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7f140b9cd0 0x7f7f140b3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f1919e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1414be20 con 0x7f7f140ba700 2023-10-06T02:59:30.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f1919e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f14147b50 con 0x7f7f1406d3d0 2023-10-06T02:59:30.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f1919e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1414bb40 con 0x7f7f140b9cd0 2023-10-06T02:59:30.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f13fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7f1406d3d0 0x7f7f140b2f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45308/0 (socket says 172.21.15.123:45308) 2023-10-06T02:59:30.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f13fff700 1 -- 172.21.15.123:0/613623142 learned_addr learned my addr 172.21.15.123:0/613623142 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-10-06T02:59:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f1899d700 1 --2- 172.21.15.123:0/613623142 >> v2:172.21.15.27:3300/0 conn(0x7f7f140b9cd0 0x7f7f140b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553130196 0 0) 0x7f7f14147b50 con 0x7f7f1406d3d0 2023-10-06T02:59:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7efc004680 con 0x7f7f1406d3d0 2023-10-06T02:59:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412340842 0 0) 0x7f7f1414be20 con 0x7f7f140ba700 2023-10-06T02:59:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f14147b50 con 0x7f7f140ba700 2023-10-06T02:59:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 <== mon.1 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 89758732 0 0) 0x7f7efc004680 con 0x7f7f1406d3d0 2023-10-06T02:59:30.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 >> v2:172.21.15.27:3300/0 conn(0x7f7f140b9cd0 msgr2=0x7f7f140b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:30.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 --2- 172.21.15.123:0/613623142 >> v2:172.21.15.27:3300/0 conn(0x7f7f140b9cd0 0x7f7f140b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 >> v1:172.21.15.27:6789/0 conn(0x7f7f140ba700 legacy=0x7f7f14147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f14148ac0 con 0x7f7f1406d3d0 2023-10-06T02:59:30.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 <== mon.1 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1323929577 0 0) 0x7f7f04001470 con 0x7f7f1406d3d0 2023-10-06T02:59:30.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f1899d700 1 --2- 172.21.15.123:0/613623142 >> v2:172.21.15.27:3300/0 conn(0x7f7f140b9cd0 0x7f7f140b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:30.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 >> v1:172.21.15.123:6789/0 conn(0x7f7f1406d3d0 legacy=0x7f7f140b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 --2- 172.21.15.123:0/613623142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc004d00 0x7f7efc0050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 --2- 172.21.15.123:0/613623142 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7efc005920 0x7f7efc005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 --2- 172.21.15.123:0/613623142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7efc0062d0 0x7f7efc00cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1414bb40 con 0x7f7efc004d00 2023-10-06T02:59:30.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc00d1c0 con 0x7f7efc0062d0 2023-10-06T02:59:30.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc00d380 con 0x7f7efc005920 2023-10-06T02:59:30.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f1899d700 1 --2- 172.21.15.123:0/613623142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7efc0062d0 0x7f7efc00cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f13fff700 1 --2- 172.21.15.123:0/613623142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc004d00 0x7f7efc0050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.455+0000 7f7f137fe700 1 --2- 172.21.15.123:0/613623142 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7efc005920 0x7f7efc005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f13fff700 1 -- 172.21.15.123:0/613623142 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7efc005920 msgr2=0x7f7efc005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:30.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f13fff700 1 --2- 172.21.15.123:0/613623142 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7efc005920 0x7f7efc005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f13fff700 1 -- 172.21.15.123:0/613623142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7efc0062d0 msgr2=0x7f7efc00cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:30.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f13fff700 1 --2- 172.21.15.123:0/613623142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7efc0062d0 0x7f7efc00cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f1899d700 1 -- 172.21.15.123:0/613623142 reap_dead start 2023-10-06T02:59:30.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f13fff700 1 -- 172.21.15.123:0/613623142 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc004680 con 0x7f7efc004d00 2023-10-06T02:59:30.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f13fff700 1 --2- 172.21.15.123:0/613623142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc004d00 0x7f7efc0050f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400c2d0 tx=0x7f7f04001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e19d121e97c40f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:30.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400cbc0 con 0x7f7efc004d00 2023-10-06T02:59:30.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0400cd20 con 0x7f7efc004d00 2023-10-06T02:59:30.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f12ffd700 1 -- 172.21.15.123:0/613623142 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04005b70 con 0x7f7efc004d00 2023-10-06T02:59:30.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f1919e700 1 -- 172.21.15.123:0/613623142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc004d00 msgr2=0x7f7efc0050f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f1919e700 1 --2- 172.21.15.123:0/613623142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc004d00 0x7f7efc0050f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400c2d0 tx=0x7f7f04001e10 comp rx=0 tx=0).stop 2023-10-06T02:59:30.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f1919e700 1 -- 172.21.15.123:0/613623142 shutdown_connections 2023-10-06T02:59:30.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f1919e700 1 --2- 172.21.15.123:0/613623142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc004d00 0x7f7efc0050f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f1919e700 1 -- 172.21.15.123:0/613623142 >> 172.21.15.123:0/613623142 conn(0x7f7f140beed0 msgr2=0x7f7f140bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:30.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f1919e700 1 -- 172.21.15.123:0/613623142 shutdown_connections 2023-10-06T02:59:30.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.459+0000 7f7f1919e700 1 -- 172.21.15.123:0/613623142 wait complete. 2023-10-06T02:59:30.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f1919e700 1 Processor -- start 2023-10-06T02:59:30.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f1919e700 1 -- start start 2023-10-06T02:59:30.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f1919e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7efc004d00 0x7f7f1414dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f1919e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f140b7680 0x7f7f14141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f1919e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f14141660 0x7f7f1413ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f1919e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f140b6530 con 0x7f7f140b7680 2023-10-06T02:59:30.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f1919e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14140740 con 0x7f7f14141660 2023-10-06T02:59:30.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f1919e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1414ea60 con 0x7f7efc004d00 2023-10-06T02:59:30.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f13fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7efc004d00 0x7f7f1414dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f13fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7efc004d00 0x7f7f1414dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:46740/0 (socket says 172.21.15.123:46740) 2023-10-06T02:59:30.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f13fff700 1 -- 172.21.15.123:0/3019422108 learned_addr learned my addr 172.21.15.123:0/3019422108 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-06T02:59:30.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f1899d700 1 --2- 172.21.15.123:0/3019422108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f14141660 0x7f7f1413ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f137fe700 1 --2- 172.21.15.123:0/3019422108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f140b7680 0x7f7f14141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f13fff700 1 -- 172.21.15.123:0/3019422108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f14141660 msgr2=0x7f7f1413ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f13fff700 1 --2- 172.21.15.123:0/3019422108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f14141660 0x7f7f1413ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f13fff700 1 -- 172.21.15.123:0/3019422108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f140b7680 msgr2=0x7f7f14141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f13fff700 1 --2- 172.21.15.123:0/3019422108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f140b7680 0x7f7f14141120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f13fff700 1 -- 172.21.15.123:0/3019422108 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1414e2a0 con 0x7f7efc004d00 2023-10-06T02:59:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f1899d700 1 --2- 172.21.15.123:0/3019422108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f14141660 0x7f7f1413ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:30.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f13fff700 1 --2- 172.21.15.123:0/3019422108 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7efc004d00 0x7f7f1414dd60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400c8c0 tx=0x7f7f04015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:30.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7efbfff700 1 -- 172.21.15.123:0/3019422108 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400cbc0 con 0x7f7efc004d00 2023-10-06T02:59:30.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7efbfff700 1 -- 172.21.15.123:0/3019422108 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0400ce90 con 0x7f7efc004d00 2023-10-06T02:59:30.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f1919e700 1 -- 172.21.15.123:0/3019422108 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f141400f0 con 0x7f7efc004d00 2023-10-06T02:59:30.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7efbfff700 1 -- 172.21.15.123:0/3019422108 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f040070d0 con 0x7f7efc004d00 2023-10-06T02:59:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7f1919e700 1 -- 172.21.15.123:0/3019422108 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1413e240 con 0x7f7efc004d00 2023-10-06T02:59:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7efbfff700 1 -- 172.21.15.123:0/3019422108 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7f04007520 con 0x7f7efc004d00 2023-10-06T02:59:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.463+0000 7f7efbfff700 1 -- 172.21.15.123:0/3019422108 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f7f04028980 con 0x7f7efc004d00 2023-10-06T02:59:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.467+0000 7f7f1919e700 1 -- 172.21.15.123:0/3019422108 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1413e430 con 0x7f7efc004d00 2023-10-06T02:59:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.467+0000 7f7efbfff700 1 -- 172.21.15.123:0/3019422108 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7f1413e430 con 0x7f7efc004d00 2023-10-06T02:59:30.483 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:30.475+0000 7f07b0ef7000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T02:59:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.543+0000 7f7f1919e700 1 -- 172.21.15.123:0/3019422108 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c66d843c-8b3b-42ad-9ced-84b982956c2f", "id": 2} v 0) v1 -- 0x7f7f1413ff50 con 0x7f7efc004d00 2023-10-06T02:59:30.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.551+0000 7f7efbfff700 1 -- 172.21.15.123:0/3019422108 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c66d843c-8b3b-42ad-9ced-84b982956c2f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7f1413ff50 con 0x7f7efc004d00 2023-10-06T02:59:30.556 INFO:teuthology.orchestra.run.smithi123.stdout:2 2023-10-06T02:59:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.551+0000 7f7f1919e700 1 -- 172.21.15.123:0/3019422108 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7efc004d00 msgr2=0x7f7f1414dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.551+0000 7f7f1919e700 1 --2- 172.21.15.123:0/3019422108 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7efc004d00 0x7f7f1414dd60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400c8c0 tx=0x7f7f04015000 comp rx=0 tx=0).stop 2023-10-06T02:59:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.551+0000 7f7f1919e700 1 -- 172.21.15.123:0/3019422108 shutdown_connections 2023-10-06T02:59:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.551+0000 7f7f1919e700 1 --2- 172.21.15.123:0/3019422108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f14141660 0x7f7f1413ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.551+0000 7f7f1919e700 1 --2- 172.21.15.123:0/3019422108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f140b7680 0x7f7f14141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.551+0000 7f7f1919e700 1 --2- 172.21.15.123:0/3019422108 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7efc004d00 0x7f7f1414dd60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.551+0000 7f7f1919e700 1 -- 172.21.15.123:0/3019422108 >> 172.21.15.123:0/3019422108 conn(0x7f7f140beed0 msgr2=0x7f7f1414aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.551+0000 7f7f1919e700 1 -- 172.21.15.123:0/3019422108 shutdown_connections 2023-10-06T02:59:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.551+0000 7f7f1919e700 1 -- 172.21.15.123:0/3019422108 wait complete. 2023-10-06T02:59:30.570 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 80a37b15-cb9a-4cf9-8a52-cb49ae4a2773 3 2023-10-06T02:59:30.593 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:30.587+0000 7f07b0ef7000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:59:30.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f171759e700 1 Processor -- start 2023-10-06T02:59:30.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f171759e700 1 -- start start 2023-10-06T02:59:30.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f171759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f17180ba700 0x7f1718147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f171759e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f17180b9cd0 0x7f1718148520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f171759e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f171814be20 con 0x7f171806d3d0 2023-10-06T02:59:30.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f171759e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1718147b50 con 0x7f17180b9cd0 2023-10-06T02:59:30.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f171759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171814bb40 con 0x7f17180ba700 2023-10-06T02:59:30.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f1715d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f17180ba700 0x7f1718147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f171659c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f171806d3d0 0x7f17180b2f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.123:53582/0 (socket says 172.21.15.123:53582) 2023-10-06T02:59:30.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f171659c700 1 -- 172.21.15.123:0/3940415834 learned_addr learned my addr 172.21.15.123:0/3940415834 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-10-06T02:59:30.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f1716d9d700 1 --2- 172.21.15.123:0/3940415834 >> v2:172.21.15.27:3300/0 conn(0x7f17180b9cd0 0x7f1718148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f1716d9d700 1 -- 172.21.15.123:0/3940415834 >> v2:172.21.15.123:3300/0 conn(0x7f17180ba700 msgr2=0x7f1718147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:30.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f1716d9d700 1 --2- 172.21.15.123:0/3940415834 >> v2:172.21.15.123:3300/0 conn(0x7f17180ba700 0x7f1718147fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f1716d9d700 1 -- 172.21.15.123:0/3940415834 >> v1:172.21.15.27:6789/0 conn(0x7f171806d3d0 legacy=0x7f17180b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f171559a700 1 -- 172.21.15.123:0/3940415834 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369101107 0 0) 0x7f171814be20 con 0x7f171806d3d0 2023-10-06T02:59:30.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f1716d9d700 1 -- 172.21.15.123:0/3940415834 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1718148ac0 con 0x7f17180b9cd0 2023-10-06T02:59:30.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f1715d9b700 1 --2- 172.21.15.123:0/3940415834 >> v2:172.21.15.123:3300/0 conn(0x7f17180ba700 0x7f1718147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:30.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f1716d9d700 1 --2- 172.21.15.123:0/3940415834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17180b9cd0 0x7f1718148520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f17180675b0 tx=0x7f1710009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb744148ad060793 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:30.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f171559a700 1 -- 172.21.15.123:0/3940415834 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171000e070 con 0x7f17180b9cd0 2023-10-06T02:59:30.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f171559a700 1 -- 172.21.15.123:0/3940415834 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171000bb60 con 0x7f17180b9cd0 2023-10-06T02:59:30.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.719+0000 7f171559a700 1 -- 172.21.15.123:0/3940415834 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1710012430 con 0x7f17180b9cd0 2023-10-06T02:59:30.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 -- 172.21.15.123:0/3940415834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17180b9cd0 msgr2=0x7f1718148520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 --2- 172.21.15.123:0/3940415834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17180b9cd0 0x7f1718148520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f17180675b0 tx=0x7f1710009780 comp rx=0 tx=0).stop 2023-10-06T02:59:30.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 -- 172.21.15.123:0/3940415834 shutdown_connections 2023-10-06T02:59:30.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 --2- 172.21.15.123:0/3940415834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17180b9cd0 0x7f1718148520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 --2- 172.21.15.123:0/3940415834 >> v2:172.21.15.123:3300/0 conn(0x7f17180ba700 0x7f1718147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 -- 172.21.15.123:0/3940415834 >> 172.21.15.123:0/3940415834 conn(0x7f17180beed0 msgr2=0x7f17180bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:30.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 -- 172.21.15.123:0/3940415834 shutdown_connections 2023-10-06T02:59:30.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 -- 172.21.15.123:0/3940415834 wait complete. 2023-10-06T02:59:30.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 Processor -- start 2023-10-06T02:59:30.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 -- start start 2023-10-06T02:59:30.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f171806d3d0 0x7f171813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17180b9cd0 0x7f171813ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17180ba700 0x7f171815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17180b7620 con 0x7f171806d3d0 2023-10-06T02:59:30.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171815b170 con 0x7f17180ba700 2023-10-06T02:59:30.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171813f460 con 0x7f17180b9cd0 2023-10-06T02:59:30.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f1715d9b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17180b9cd0 0x7f171813ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f1715d9b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17180b9cd0 0x7f171813ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:46746/0 (socket says 172.21.15.123:46746) 2023-10-06T02:59:30.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f1715d9b700 1 -- 172.21.15.123:0/3885998967 learned_addr learned my addr 172.21.15.123:0/3885998967 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-06T02:59:30.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f1716d9d700 1 --2- 172.21.15.123:0/3885998967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17180ba700 0x7f171815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171659c700 1 --2- 172.21.15.123:0/3885998967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f171806d3d0 0x7f171813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f1715d9b700 1 -- 172.21.15.123:0/3885998967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17180ba700 msgr2=0x7f171815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f1715d9b700 1 --2- 172.21.15.123:0/3885998967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17180ba700 0x7f171815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f1715d9b700 1 -- 172.21.15.123:0/3885998967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f171806d3d0 msgr2=0x7f171813e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f1715d9b700 1 --2- 172.21.15.123:0/3885998967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f171806d3d0 0x7f171813e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f1715d9b700 1 -- 172.21.15.123:0/3885998967 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170800a5d0 con 0x7f17180b9cd0 2023-10-06T02:59:30.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171659c700 1 --2- 172.21.15.123:0/3885998967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f171806d3d0 0x7f171813e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:30.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f1715d9b700 1 --2- 172.21.15.123:0/3885998967 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17180b9cd0 0x7f171813ef20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f170800ea10 tx=0x7f170800a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:30.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f170e7fc700 1 -- 172.21.15.123:0/3885998967 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170800c950 con 0x7f17180b9cd0 2023-10-06T02:59:30.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f170e7fc700 1 -- 172.21.15.123:0/3885998967 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170800cab0 con 0x7f17180b9cd0 2023-10-06T02:59:30.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 -- 172.21.15.123:0/3885998967 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1710009a20 con 0x7f17180b9cd0 2023-10-06T02:59:30.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f170e7fc700 1 -- 172.21.15.123:0/3885998967 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170800ce30 con 0x7f17180b9cd0 2023-10-06T02:59:30.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f171759e700 1 -- 172.21.15.123:0/3885998967 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1718141410 con 0x7f17180b9cd0 2023-10-06T02:59:30.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f170e7fc700 1 -- 172.21.15.123:0/3885998967 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1708005c80 con 0x7f17180b9cd0 2023-10-06T02:59:30.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.723+0000 7f170e7fc700 1 -- 172.21.15.123:0/3885998967 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f1708015030 con 0x7f17180b9cd0 2023-10-06T02:59:30.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.727+0000 7f171759e700 1 -- 172.21.15.123:0/3885998967 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17181577a0 con 0x7f17180b9cd0 2023-10-06T02:59:30.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.727+0000 7f170e7fc700 1 -- 172.21.15.123:0/3885998967 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f170801f060 con 0x7f17180b9cd0 2023-10-06T02:59:30.745 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:30.739+0000 7efc54752000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T02:59:30.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.803+0000 7f171759e700 1 -- 172.21.15.123:0/3885998967 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "80a37b15-cb9a-4cf9-8a52-cb49ae4a2773", "id": 3} v 0) v1 -- 0x7f17180700e0 con 0x7f17180b9cd0 2023-10-06T02:59:30.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.811+0000 7f170e7fc700 1 -- 172.21.15.123:0/3885998967 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "80a37b15-cb9a-4cf9-8a52-cb49ae4a2773", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f17080280b0 con 0x7f17180b9cd0 2023-10-06T02:59:30.818 INFO:teuthology.orchestra.run.smithi123.stdout:3 2023-10-06T02:59:30.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.815+0000 7f171759e700 1 -- 172.21.15.123:0/3885998967 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17180b9cd0 msgr2=0x7f171813ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.815+0000 7f171759e700 1 --2- 172.21.15.123:0/3885998967 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17180b9cd0 0x7f171813ef20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f170800ea10 tx=0x7f170800a330 comp rx=0 tx=0).stop 2023-10-06T02:59:30.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.815+0000 7f171759e700 1 -- 172.21.15.123:0/3885998967 shutdown_connections 2023-10-06T02:59:30.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.815+0000 7f171759e700 1 --2- 172.21.15.123:0/3885998967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17180ba700 0x7f171815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.815+0000 7f171759e700 1 --2- 172.21.15.123:0/3885998967 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17180b9cd0 0x7f171813ef20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.815+0000 7f171759e700 1 --2- 172.21.15.123:0/3885998967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f171806d3d0 0x7f171813e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.815+0000 7f171759e700 1 -- 172.21.15.123:0/3885998967 >> 172.21.15.123:0/3885998967 conn(0x7f17180beed0 msgr2=0x7f17180bccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:30.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.815+0000 7f171759e700 1 -- 172.21.15.123:0/3885998967 shutdown_connections 2023-10-06T02:59:30.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.815+0000 7f171759e700 1 -- 172.21.15.123:0/3885998967 wait complete. 2023-10-06T02:59:30.821 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:30.815+0000 7f07b0ef7000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T02:59:30.835 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new d8558fb1-df1c-4c7e-bbe5-3dc157e0374a 4 2023-10-06T02:59:30.858 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:30.855+0000 7efc54752000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T02:59:30.871 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:30.867+0000 7f07b0ef7000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T02:59:30.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.931+0000 7ff2c5964700 1 Processor -- start 2023-10-06T02:59:30.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.931+0000 7ff2c5964700 1 -- start start 2023-10-06T02:59:30.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.931+0000 7ff2c5964700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff2c0069a20 0x7ff2c006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.931+0000 7ff2c5964700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c006e930 0x7ff2c006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.931+0000 7ff2c5964700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c014a730 con 0x7ff2c006a690 2023-10-06T02:59:30.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.931+0000 7ff2c5964700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c0140470 con 0x7ff2c0069a20 2023-10-06T02:59:30.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.931+0000 7ff2c5964700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c01494c0 con 0x7ff2c006e930 2023-10-06T02:59:30.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.931+0000 7ff2be7fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c006e930 0x7ff2c006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.931+0000 7ff2be7fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c006e930 0x7ff2c006bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:46758/0 (socket says 172.21.15.123:46758) 2023-10-06T02:59:30.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.931+0000 7ff2be7fc700 1 -- 172.21.15.123:0/3029032938 learned_addr learned my addr 172.21.15.123:0/3029032938 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-06T02:59:30.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.931+0000 7ff2beffd700 1 --2- 172.21.15.123:0/3029032938 >> v2:172.21.15.27:3300/0 conn(0x7ff2c0069a20 0x7ff2c006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2be7fc700 1 -- 172.21.15.123:0/3029032938 >> v2:172.21.15.27:3300/0 conn(0x7ff2c0069a20 msgr2=0x7ff2c006dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:30.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2be7fc700 1 --2- 172.21.15.123:0/3029032938 >> v2:172.21.15.27:3300/0 conn(0x7ff2c0069a20 0x7ff2c006dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2be7fc700 1 -- 172.21.15.123:0/3029032938 >> v1:172.21.15.27:6789/0 conn(0x7ff2c006a690 legacy=0x7ff2c0149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2be7fc700 1 -- 172.21.15.123:0/3029032938 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c006d7c0 con 0x7ff2c006e930 2023-10-06T02:59:30.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2be7fc700 1 --2- 172.21.15.123:0/3029032938 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c006e930 0x7ff2c006bed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40099b0 tx=0x7ff2b4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfaaf199610e34aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:30.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2bdffb700 1 -- 172.21.15.123:0/3029032938 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4009ea0 con 0x7ff2c006e930 2023-10-06T02:59:30.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2bdffb700 1 -- 172.21.15.123:0/3029032938 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b400b860 con 0x7ff2c006e930 2023-10-06T02:59:30.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2bdffb700 1 -- 172.21.15.123:0/3029032938 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b400bc00 con 0x7ff2c006e930 2023-10-06T02:59:30.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 -- 172.21.15.123:0/3029032938 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c006e930 msgr2=0x7ff2c006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 --2- 172.21.15.123:0/3029032938 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c006e930 0x7ff2c006bed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40099b0 tx=0x7ff2b4009250 comp rx=0 tx=0).stop 2023-10-06T02:59:30.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 -- 172.21.15.123:0/3029032938 shutdown_connections 2023-10-06T02:59:30.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 --2- 172.21.15.123:0/3029032938 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c006e930 0x7ff2c006bed0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 --2- 172.21.15.123:0/3029032938 >> v2:172.21.15.27:3300/0 conn(0x7ff2c0069a20 0x7ff2c006dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 -- 172.21.15.123:0/3029032938 >> 172.21.15.123:0/3029032938 conn(0x7ff2c00bedd0 msgr2=0x7ff2c00bf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:30.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 -- 172.21.15.123:0/3029032938 shutdown_connections 2023-10-06T02:59:30.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 -- 172.21.15.123:0/3029032938 wait complete. 2023-10-06T02:59:30.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 Processor -- start 2023-10-06T02:59:30.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 -- start start 2023-10-06T02:59:30.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c0069a20 0x7ff2c015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2c006a690 0x7ff2c0147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2c0158d50 0x7ff2c01591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:30.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c0144c20 con 0x7ff2c006a690 2023-10-06T02:59:30.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c01451e0 con 0x7ff2c0158d50 2023-10-06T02:59:30.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.935+0000 7ff2c5964700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c01477b0 con 0x7ff2c0069a20 2023-10-06T02:59:30.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2beffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c0069a20 0x7ff2c015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2bf7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2c0158d50 0x7ff2c01591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2beffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c0069a20 0x7ff2c015cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:46766/0 (socket says 172.21.15.123:46766) 2023-10-06T02:59:30.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2be7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2c006a690 0x7ff2c0147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:30.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2beffd700 1 -- 172.21.15.123:0/3271103303 learned_addr learned my addr 172.21.15.123:0/3271103303 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-06T02:59:30.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2beffd700 1 -- 172.21.15.123:0/3271103303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2c0158d50 msgr2=0x7ff2c01591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2beffd700 1 --2- 172.21.15.123:0/3271103303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2c0158d50 0x7ff2c01591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2beffd700 1 -- 172.21.15.123:0/3271103303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2c006a690 msgr2=0x7ff2c0147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2beffd700 1 --2- 172.21.15.123:0/3271103303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2c006a690 0x7ff2c0147270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2beffd700 1 -- 172.21.15.123:0/3271103303 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b40094f0 con 0x7ff2c0069a20 2023-10-06T02:59:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2beffd700 1 --2- 172.21.15.123:0/3271103303 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c0069a20 0x7ff2c015cbf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000ec80 tx=0x7ff2b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2a6ffd700 1 -- 172.21.15.123:0/3271103303 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b000c850 con 0x7ff2c0069a20 2023-10-06T02:59:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2a6ffd700 1 -- 172.21.15.123:0/3271103303 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b000c9b0 con 0x7ff2c0069a20 2023-10-06T02:59:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2c5964700 1 -- 172.21.15.123:0/3271103303 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c01442f0 con 0x7ff2c0069a20 2023-10-06T02:59:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2a6ffd700 1 -- 172.21.15.123:0/3271103303 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b000cd50 con 0x7ff2c0069a20 2023-10-06T02:59:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2c5964700 1 -- 172.21.15.123:0/3271103303 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c01448b0 con 0x7ff2c0069a20 2023-10-06T02:59:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2a6ffd700 1 -- 172.21.15.123:0/3271103303 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff2b0005c80 con 0x7ff2c0069a20 2023-10-06T02:59:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2a6ffd700 1 -- 172.21.15.123:0/3271103303 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7ff2b0013b30 con 0x7ff2c0069a20 2023-10-06T02:59:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.939+0000 7ff2c5964700 1 -- 172.21.15.123:0/3271103303 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c004be40 con 0x7ff2c0069a20 2023-10-06T02:59:30.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:30.943+0000 7ff2a6ffd700 1 -- 172.21.15.123:0/3271103303 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff2b0021060 con 0x7ff2c0069a20 2023-10-06T02:59:31.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.015+0000 7ff2c5964700 1 -- 172.21.15.123:0/3271103303 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d8558fb1-df1c-4c7e-bbe5-3dc157e0374a", "id": 4} v 0) v1 -- 0x7ff2c00be930 con 0x7ff2c0069a20 2023-10-06T02:59:31.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.023+0000 7ff2a6ffd700 1 -- 172.21.15.123:0/3271103303 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8558fb1-df1c-4c7e-bbe5-3dc157e0374a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff2b0017070 con 0x7ff2c0069a20 2023-10-06T02:59:31.030 INFO:teuthology.orchestra.run.smithi123.stdout:4 2023-10-06T02:59:31.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.027+0000 7ff2c5964700 1 -- 172.21.15.123:0/3271103303 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c0069a20 msgr2=0x7ff2c015cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.027+0000 7ff2c5964700 1 --2- 172.21.15.123:0/3271103303 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c0069a20 0x7ff2c015cbf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000ec80 tx=0x7ff2b00091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.027+0000 7ff2c5964700 1 -- 172.21.15.123:0/3271103303 shutdown_connections 2023-10-06T02:59:31.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.027+0000 7ff2c5964700 1 --2- 172.21.15.123:0/3271103303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2c0158d50 0x7ff2c01591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.027+0000 7ff2c5964700 1 --2- 172.21.15.123:0/3271103303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2c006a690 0x7ff2c0147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.027+0000 7ff2c5964700 1 --2- 172.21.15.123:0/3271103303 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2c0069a20 0x7ff2c015cbf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.027+0000 7ff2c5964700 1 -- 172.21.15.123:0/3271103303 >> 172.21.15.123:0/3271103303 conn(0x7ff2c00bedd0 msgr2=0x7ff2c0149a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:31.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.027+0000 7ff2c5964700 1 -- 172.21.15.123:0/3271103303 shutdown_connections 2023-10-06T02:59:31.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.027+0000 7ff2c5964700 1 -- 172.21.15.123:0/3271103303 wait complete. 2023-10-06T02:59:31.042 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 2d799694-1af9-43ef-b7c8-5bdda38668f3 5 2023-10-06T02:59:31.046 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:31.039+0000 7f07b0ef7000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T02:59:31.110 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:31.103+0000 7f07b0ef7000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T02:59:31.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.139+0000 7fcec11c1700 1 Processor -- start 2023-10-06T02:59:31.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.139+0000 7fcec11c1700 1 -- start start 2023-10-06T02:59:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.139+0000 7fcec11c1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcebc0ba440 0x7fcebc0697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.139+0000 7fcec11c1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcebc06a7b0 0x7fcebc0b4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.139+0000 7fcec11c1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc14b6e0 con 0x7fcebc0ba810 2023-10-06T02:59:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.139+0000 7fcec11c1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc0b3e20 con 0x7fcebc06a7b0 2023-10-06T02:59:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.139+0000 7fcec11c1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc14b960 con 0x7fcebc0ba440 2023-10-06T02:59:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.139+0000 7fcebad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcebc0ba440 0x7fcebc0697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.139+0000 7fcebad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcebc0ba440 0x7fcebc0697f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50632/0 (socket says 172.21.15.123:50632) 2023-10-06T02:59:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.139+0000 7fcebad9d700 1 -- 172.21.15.123:0/1229674526 learned_addr learned my addr 172.21.15.123:0/1229674526 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-06T02:59:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.139+0000 7fcebb59e700 1 --2- 172.21.15.123:0/1229674526 >> v2:172.21.15.27:3300/0 conn(0x7fcebc06a7b0 0x7fcebc0b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.139+0000 7fcebad9d700 1 -- 172.21.15.123:0/1229674526 >> v2:172.21.15.27:3300/0 conn(0x7fcebc06a7b0 msgr2=0x7fcebc0b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:31.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.139+0000 7fcebad9d700 1 --2- 172.21.15.123:0/1229674526 >> v2:172.21.15.27:3300/0 conn(0x7fcebc06a7b0 0x7fcebc0b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fcebad9d700 1 -- 172.21.15.123:0/1229674526 >> v1:172.21.15.27:6789/0 conn(0x7fcebc0ba810 legacy=0x7fcebc06a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fcebad9d700 1 -- 172.21.15.123:0/1229674526 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc14c640 con 0x7fcebc0ba440 2023-10-06T02:59:31.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fcebad9d700 1 --2- 172.21.15.123:0/1229674526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcebc0ba440 0x7fcebc0697f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0bed30 tx=0x7fceac009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deaf5a0699c50fef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:31.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fceb9d9b700 1 -- 172.21.15.123:0/1229674526 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac009e70 con 0x7fcebc0ba440 2023-10-06T02:59:31.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fceb9d9b700 1 -- 172.21.15.123:0/1229674526 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac00b860 con 0x7fcebc0ba440 2023-10-06T02:59:31.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fceb9d9b700 1 -- 172.21.15.123:0/1229674526 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac00bc00 con 0x7fcebc0ba440 2023-10-06T02:59:31.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fcec11c1700 1 -- 172.21.15.123:0/1229674526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcebc0ba440 msgr2=0x7fcebc0697f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fcec11c1700 1 --2- 172.21.15.123:0/1229674526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcebc0ba440 0x7fcebc0697f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0bed30 tx=0x7fceac009250 comp rx=0 tx=0).stop 2023-10-06T02:59:31.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fcec11c1700 1 -- 172.21.15.123:0/1229674526 shutdown_connections 2023-10-06T02:59:31.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fcec11c1700 1 --2- 172.21.15.123:0/1229674526 >> v2:172.21.15.27:3300/0 conn(0x7fcebc06a7b0 0x7fcebc0b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fcec11c1700 1 --2- 172.21.15.123:0/1229674526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcebc0ba440 0x7fcebc0697f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fcec11c1700 1 -- 172.21.15.123:0/1229674526 >> 172.21.15.123:0/1229674526 conn(0x7fcebc0bedd0 msgr2=0x7fcebc0bf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:31.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fcec11c1700 1 -- 172.21.15.123:0/1229674526 shutdown_connections 2023-10-06T02:59:31.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fcec11c1700 1 -- 172.21.15.123:0/1229674526 wait complete. 2023-10-06T02:59:31.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fcec11c1700 1 Processor -- start 2023-10-06T02:59:31.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.143+0000 7fcec11c1700 1 -- start start 2023-10-06T02:59:31.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcec11c1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcebc06a7b0 0x7fcebc15e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcec11c1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcebc0ba440 0x7fcebc13f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcec11c1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcebc0ba810 0x7fcebc13f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcec11c1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc145a30 con 0x7fcebc0ba810 2023-10-06T02:59:31.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcec11c1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc148100 con 0x7fcebc06a7b0 2023-10-06T02:59:31.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcec11c1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc15f160 con 0x7fcebc0ba440 2023-10-06T02:59:31.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fceba59c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcebc0ba440 0x7fcebc13f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fceba59c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcebc0ba440 0x7fcebc13f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:46768/0 (socket says 172.21.15.123:46768) 2023-10-06T02:59:31.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fceba59c700 1 -- 172.21.15.123:0/2292662525 learned_addr learned my addr 172.21.15.123:0/2292662525 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-06T02:59:31.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcebad9d700 1 --2- 172.21.15.123:0/2292662525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcebc06a7b0 0x7fcebc15e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcebb59e700 1 --2- 172.21.15.123:0/2292662525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcebc0ba810 0x7fcebc13f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fceba59c700 1 -- 172.21.15.123:0/2292662525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcebc06a7b0 msgr2=0x7fcebc15e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fceba59c700 1 --2- 172.21.15.123:0/2292662525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcebc06a7b0 0x7fcebc15e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fceba59c700 1 -- 172.21.15.123:0/2292662525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcebc0ba810 msgr2=0x7fcebc13f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fceba59c700 1 --2- 172.21.15.123:0/2292662525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcebc0ba810 0x7fcebc13f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fceba59c700 1 -- 172.21.15.123:0/2292662525 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac0094f0 con 0x7fcebc0ba440 2023-10-06T02:59:31.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fceba59c700 1 --2- 172.21.15.123:0/2292662525 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcebc0ba440 0x7fcebc13f460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fceb000c590 tx=0x7fceb000c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:31.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcea2ffd700 1 -- 172.21.15.123:0/2292662525 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0011590 con 0x7fcebc0ba440 2023-10-06T02:59:31.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcea2ffd700 1 -- 172.21.15.123:0/2292662525 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb0011710 con 0x7fcebc0ba440 2023-10-06T02:59:31.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcea2ffd700 1 -- 172.21.15.123:0/2292662525 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0011ad0 con 0x7fcebc0ba440 2023-10-06T02:59:31.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcec11c1700 1 -- 172.21.15.123:0/2292662525 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc145790 con 0x7fcebc0ba440 2023-10-06T02:59:31.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcec11c1700 1 -- 172.21.15.123:0/2292662525 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc14b390 con 0x7fcebc0ba440 2023-10-06T02:59:31.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcea2ffd700 1 -- 172.21.15.123:0/2292662525 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fceb001c6c0 con 0x7fcebc0ba440 2023-10-06T02:59:31.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcea2ffd700 1 -- 172.21.15.123:0/2292662525 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fceb00129a0 con 0x7fcebc0ba440 2023-10-06T02:59:31.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.147+0000 7fcec11c1700 1 -- 172.21.15.123:0/2292662525 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc04be40 con 0x7fcebc0ba440 2023-10-06T02:59:31.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.151+0000 7fcea2ffd700 1 -- 172.21.15.123:0/2292662525 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fceb0017070 con 0x7fcebc0ba440 2023-10-06T02:59:31.158 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:31.155+0000 7efc54752000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T02:59:31.174 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:31.167+0000 7f07b0ef7000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T02:59:31.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.227+0000 7fcec11c1700 1 -- 172.21.15.123:0/2292662525 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2d799694-1af9-43ef-b7c8-5bdda38668f3", "id": 5} v 0) v1 -- 0x7fcebc15f2a0 con 0x7fcebc0ba440 2023-10-06T02:59:31.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.235+0000 7fcea2ffd700 1 -- 172.21.15.123:0/2292662525 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d799694-1af9-43ef-b7c8-5bdda38668f3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fceb001cba0 con 0x7fcebc0ba440 2023-10-06T02:59:31.240 INFO:teuthology.orchestra.run.smithi123.stdout:5 2023-10-06T02:59:31.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.235+0000 7fcec11c1700 1 -- 172.21.15.123:0/2292662525 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcebc0ba440 msgr2=0x7fcebc13f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.235+0000 7fcec11c1700 1 --2- 172.21.15.123:0/2292662525 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcebc0ba440 0x7fcebc13f460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fceb000c590 tx=0x7fceb000c8a0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.235+0000 7fcec11c1700 1 -- 172.21.15.123:0/2292662525 shutdown_connections 2023-10-06T02:59:31.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.235+0000 7fcec11c1700 1 --2- 172.21.15.123:0/2292662525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcebc0ba810 0x7fcebc13f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.235+0000 7fcec11c1700 1 --2- 172.21.15.123:0/2292662525 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcebc0ba440 0x7fcebc13f460 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.235+0000 7fcec11c1700 1 --2- 172.21.15.123:0/2292662525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcebc06a7b0 0x7fcebc15e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.235+0000 7fcec11c1700 1 -- 172.21.15.123:0/2292662525 >> 172.21.15.123:0/2292662525 conn(0x7fcebc0bedd0 msgr2=0x7fcebc141790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:31.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.235+0000 7fcec11c1700 1 -- 172.21.15.123:0/2292662525 shutdown_connections 2023-10-06T02:59:31.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.235+0000 7fcec11c1700 1 -- 172.21.15.123:0/2292662525 wait complete. 2023-10-06T02:59:31.254 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 15c386f4-8e30-4314-a81f-4685707175f2 6 2023-10-06T02:59:31.323 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:31.319+0000 7efc54752000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:59:31.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.347+0000 7fdaef4f7700 1 Processor -- start 2023-10-06T02:59:31.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.347+0000 7fdaef4f7700 1 -- start start 2023-10-06T02:59:31.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae80bb6e0 0x7fdae8067af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdae8068030 0x7fdae814ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae80ba3a0 con 0x7fdae806f0c0 2023-10-06T02:59:31.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80ba680 con 0x7fdae8068030 2023-10-06T02:59:31.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80bb220 con 0x7fdae80bb6e0 2023-10-06T02:59:31.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaedcf4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae80bb6e0 0x7fdae8067af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaeecf6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdae8068030 0x7fdae814ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaedcf4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae80bb6e0 0x7fdae8067af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:46774/0 (socket says 172.21.15.123:46774) 2023-10-06T02:59:31.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaedcf4700 1 -- 172.21.15.123:0/3366066819 learned_addr learned my addr 172.21.15.123:0/3366066819 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-06T02:59:31.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaedcf4700 1 -- 172.21.15.123:0/3366066819 >> v2:172.21.15.123:3300/0 conn(0x7fdae8068030 msgr2=0x7fdae814ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:31.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaedcf4700 1 --2- 172.21.15.123:0/3366066819 >> v2:172.21.15.123:3300/0 conn(0x7fdae8068030 0x7fdae814ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaedcf4700 1 -- 172.21.15.123:0/3366066819 >> v1:172.21.15.123:6789/0 conn(0x7fdae806f0c0 legacy=0x7fdae80bab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaedcf4700 1 -- 172.21.15.123:0/3366066819 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae80b64c0 con 0x7fdae80bb6e0 2023-10-06T02:59:31.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaeecf6700 1 --2- 172.21.15.123:0/3366066819 >> v2:172.21.15.123:3300/0 conn(0x7fdae8068030 0x7fdae814ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:31.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaedcf4700 1 --2- 172.21.15.123:0/3366066819 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae80bb6e0 0x7fdae8067af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdad80099b0 tx=0x7fdad8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e917c265095ba16d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:31.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaed4f3700 1 -- 172.21.15.123:0/3366066819 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8009ea0 con 0x7fdae80bb6e0 2023-10-06T02:59:31.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaed4f3700 1 -- 172.21.15.123:0/3366066819 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad800b860 con 0x7fdae80bb6e0 2023-10-06T02:59:31.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaed4f3700 1 -- 172.21.15.123:0/3366066819 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad800bc00 con 0x7fdae80bb6e0 2023-10-06T02:59:31.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 -- 172.21.15.123:0/3366066819 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae80bb6e0 msgr2=0x7fdae8067af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 --2- 172.21.15.123:0/3366066819 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae80bb6e0 0x7fdae8067af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdad80099b0 tx=0x7fdad8009250 comp rx=0 tx=0).stop 2023-10-06T02:59:31.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 -- 172.21.15.123:0/3366066819 shutdown_connections 2023-10-06T02:59:31.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 --2- 172.21.15.123:0/3366066819 >> v2:172.21.15.123:3300/0 conn(0x7fdae8068030 0x7fdae814ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 --2- 172.21.15.123:0/3366066819 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae80bb6e0 0x7fdae8067af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 -- 172.21.15.123:0/3366066819 >> 172.21.15.123:0/3366066819 conn(0x7fdae80bfd60 msgr2=0x7fdae80c0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:31.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 -- 172.21.15.123:0/3366066819 shutdown_connections 2023-10-06T02:59:31.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 -- 172.21.15.123:0/3366066819 wait complete. 2023-10-06T02:59:31.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 Processor -- start 2023-10-06T02:59:31.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 -- start start 2023-10-06T02:59:31.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae8068030 0x7fdae814f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdae806f0c0 0x7fdae80a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdae80bb6e0 0x7fdae80a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae814e010 con 0x7fdae806f0c0 2023-10-06T02:59:31.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae815ba80 con 0x7fdae80bb6e0 2023-10-06T02:59:31.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaef4f7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae815b710 con 0x7fdae8068030 2023-10-06T02:59:31.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaee4f5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae8068030 0x7fdae814f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.351+0000 7fdaeecf6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdae80bb6e0 0x7fdae80a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdaee4f5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae8068030 0x7fdae814f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:46784/0 (socket says 172.21.15.123:46784) 2023-10-06T02:59:31.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdaee4f5700 1 -- 172.21.15.123:0/2744665153 learned_addr learned my addr 172.21.15.123:0/2744665153 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-06T02:59:31.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdaedcf4700 1 --2- 172.21.15.123:0/2744665153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdae806f0c0 0x7fdae80a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdaee4f5700 1 -- 172.21.15.123:0/2744665153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdae80bb6e0 msgr2=0x7fdae80a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdaee4f5700 1 --2- 172.21.15.123:0/2744665153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdae80bb6e0 0x7fdae80a2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdaee4f5700 1 -- 172.21.15.123:0/2744665153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdae806f0c0 msgr2=0x7fdae80a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdaee4f5700 1 --2- 172.21.15.123:0/2744665153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdae806f0c0 0x7fdae80a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdaee4f5700 1 -- 172.21.15.123:0/2744665153 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae0009a20 con 0x7fdae8068030 2023-10-06T02:59:31.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdaedcf4700 1 --2- 172.21.15.123:0/2744665153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdae806f0c0 0x7fdae80a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:31.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdaee4f5700 1 --2- 172.21.15.123:0/2744665153 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae8068030 0x7fdae814f230 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdae400c5c0 tx=0x7fdae400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:31.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdade7fc700 1 -- 172.21.15.123:0/2744665153 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4011590 con 0x7fdae8068030 2023-10-06T02:59:31.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdade7fc700 1 -- 172.21.15.123:0/2744665153 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae4011710 con 0x7fdae8068030 2023-10-06T02:59:31.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdade7fc700 1 -- 172.21.15.123:0/2744665153 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4011ad0 con 0x7fdae8068030 2023-10-06T02:59:31.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdaef4f7700 1 -- 172.21.15.123:0/2744665153 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad80094f0 con 0x7fdae8068030 2023-10-06T02:59:31.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdaef4f7700 1 -- 172.21.15.123:0/2744665153 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae80a3260 con 0x7fdae8068030 2023-10-06T02:59:31.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdade7fc700 1 -- 172.21.15.123:0/2744665153 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdae401c6c0 con 0x7fdae8068030 2023-10-06T02:59:31.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdade7fc700 1 -- 172.21.15.123:0/2744665153 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fdae4012a20 con 0x7fdae8068030 2023-10-06T02:59:31.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.355+0000 7fdaef4f7700 1 -- 172.21.15.123:0/2744665153 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae815b540 con 0x7fdae8068030 2023-10-06T02:59:31.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.359+0000 7fdade7fc700 1 -- 172.21.15.123:0/2744665153 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdae4017070 con 0x7fdae8068030 2023-10-06T02:59:31.389 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:31.383+0000 7efc54752000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T02:59:31.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.435+0000 7fdaef4f7700 1 -- 172.21.15.123:0/2744665153 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "15c386f4-8e30-4314-a81f-4685707175f2", "id": 6} v 0) v1 -- 0x7fdae80b60f0 con 0x7fdae8068030 2023-10-06T02:59:31.439 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:31.435+0000 7efc54752000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T02:59:31.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.443+0000 7fdade7fc700 1 -- 172.21.15.123:0/2744665153 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15c386f4-8e30-4314-a81f-4685707175f2", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdae401cba0 con 0x7fdae8068030 2023-10-06T02:59:31.448 INFO:teuthology.orchestra.run.smithi123.stdout:6 2023-10-06T02:59:31.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.443+0000 7fdaef4f7700 1 -- 172.21.15.123:0/2744665153 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae8068030 msgr2=0x7fdae814f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.443+0000 7fdaef4f7700 1 --2- 172.21.15.123:0/2744665153 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae8068030 0x7fdae814f230 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdae400c5c0 tx=0x7fdae400c8d0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.443+0000 7fdaef4f7700 1 -- 172.21.15.123:0/2744665153 shutdown_connections 2023-10-06T02:59:31.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.443+0000 7fdaef4f7700 1 --2- 172.21.15.123:0/2744665153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdae80bb6e0 0x7fdae80a2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.443+0000 7fdaef4f7700 1 --2- 172.21.15.123:0/2744665153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdae806f0c0 0x7fdae80a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.443+0000 7fdaef4f7700 1 --2- 172.21.15.123:0/2744665153 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdae8068030 0x7fdae814f230 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.443+0000 7fdaef4f7700 1 -- 172.21.15.123:0/2744665153 >> 172.21.15.123:0/2744665153 conn(0x7fdae80bfd60 msgr2=0x7fdae80bed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:31.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.443+0000 7fdaef4f7700 1 -- 172.21.15.123:0/2744665153 shutdown_connections 2023-10-06T02:59:31.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.443+0000 7fdaef4f7700 1 -- 172.21.15.123:0/2744665153 wait complete. 2023-10-06T02:59:31.462 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9 7 2023-10-06T02:59:31.500 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:31.495+0000 7efc54752000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T02:59:31.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.551+0000 7f5bf8f5a700 1 Processor -- start 2023-10-06T02:59:31.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.551+0000 7f5bf8f5a700 1 -- start start 2023-10-06T02:59:31.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5bf40b3670 0x7f5bf414b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf40b2f00 con 0x7f5bf406b2e0 2023-10-06T02:59:31.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf40b31e0 con 0x7f5bf414acb0 2023-10-06T02:59:31.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf40b3a70 con 0x7f5bf40b3670 2023-10-06T02:59:31.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf37fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5bf414acb0 0x7f5bf406d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45318/0 (socket says 172.21.15.123:45318) 2023-10-06T02:59:31.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf37fe700 1 -- 172.21.15.123:0/3914910644 learned_addr learned my addr 172.21.15.123:0/3914910644 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-10-06T02:59:31.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf3fff700 1 --2- 172.21.15.123:0/3914910644 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5bf40b3670 0x7f5bf414b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf2ffd700 1 -- 172.21.15.123:0/3914910644 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674180065 0 0) 0x7f5bf40b31e0 con 0x7f5bf414acb0 2023-10-06T02:59:31.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf2ffd700 1 -- 172.21.15.123:0/3914910644 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5be0003570 con 0x7f5bf414acb0 2023-10-06T02:59:31.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf3fff700 1 -- 172.21.15.123:0/3914910644 >> v1:172.21.15.123:6789/0 conn(0x7f5bf414acb0 legacy=0x7f5bf406d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf3fff700 1 -- 172.21.15.123:0/3914910644 >> v1:172.21.15.27:6789/0 conn(0x7f5bf406b2e0 legacy=0x7f5bf414b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf3fff700 1 -- 172.21.15.123:0/3914910644 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf40bb940 con 0x7f5bf40b3670 2023-10-06T02:59:31.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf3fff700 1 --2- 172.21.15.123:0/3914910644 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5bf40b3670 0x7f5bf414b790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009e90 tx=0x7f5bec009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde94999461ca975 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:31.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf2ffd700 1 -- 172.21.15.123:0/3914910644 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00e070 con 0x7f5bf40b3670 2023-10-06T02:59:31.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf2ffd700 1 -- 172.21.15.123:0/3914910644 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec00bc30 con 0x7f5bf40b3670 2023-10-06T02:59:31.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf2ffd700 1 -- 172.21.15.123:0/3914910644 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec012430 con 0x7f5bf40b3670 2023-10-06T02:59:31.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3914910644 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5bf40b3670 msgr2=0x7f5bf414b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 --2- 172.21.15.123:0/3914910644 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5bf40b3670 0x7f5bf414b790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009e90 tx=0x7f5bec009780 comp rx=0 tx=0).stop 2023-10-06T02:59:31.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3914910644 shutdown_connections 2023-10-06T02:59:31.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 --2- 172.21.15.123:0/3914910644 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5bf40b3670 0x7f5bf414b790 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3914910644 >> 172.21.15.123:0/3914910644 conn(0x7f5bf40beed0 msgr2=0x7f5bf40bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:31.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3914910644 shutdown_connections 2023-10-06T02:59:31.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3914910644 wait complete. 2023-10-06T02:59:31.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 Processor -- start 2023-10-06T02:59:31.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 -- start start 2023-10-06T02:59:31.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5bf406b2e0 0x7f5bf40b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bf40b3670 0x7f5bf40b8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bf414acb0 0x7f5bf415e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf411bfd0 con 0x7f5bf414acb0 2023-10-06T02:59:31.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4147620 con 0x7f5bf40b3670 2023-10-06T02:59:31.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.555+0000 7f5bf8f5a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf40b6e70 con 0x7f5bf406b2e0 2023-10-06T02:59:31.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bf40b3670 0x7f5bf40b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bf37fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5bf406b2e0 0x7f5bf40b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bf40b3670 0x7f5bf40b8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50654/0 (socket says 172.21.15.123:50654) 2023-10-06T02:59:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bebfff700 1 -- 172.21.15.123:0/3281070988 learned_addr learned my addr 172.21.15.123:0/3281070988 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-06T02:59:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bf3fff700 1 --2- 172.21.15.123:0/3281070988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bf414acb0 0x7f5bf415e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bebfff700 1 -- 172.21.15.123:0/3281070988 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5bf406b2e0 msgr2=0x7f5bf40b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bebfff700 1 --2- 172.21.15.123:0/3281070988 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5bf406b2e0 0x7f5bf40b7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bebfff700 1 -- 172.21.15.123:0/3281070988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bf414acb0 msgr2=0x7f5bf415e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bebfff700 1 --2- 172.21.15.123:0/3281070988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bf414acb0 0x7f5bf415e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bebfff700 1 -- 172.21.15.123:0/3281070988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec009a20 con 0x7f5bf40b3670 2023-10-06T02:59:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bebfff700 1 --2- 172.21.15.123:0/3281070988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bf40b3670 0x7f5bf40b8280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c590 tx=0x7f5bdc00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5beb7fe700 1 -- 172.21.15.123:0/3281070988 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc011590 con 0x7f5bf40b3670 2023-10-06T02:59:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5beb7fe700 1 -- 172.21.15.123:0/3281070988 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc011710 con 0x7f5bf40b3670 2023-10-06T02:59:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3281070988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf40b9410 con 0x7f5bf40b3670 2023-10-06T02:59:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5beb7fe700 1 -- 172.21.15.123:0/3281070988 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc011ad0 con 0x7f5bf40b3670 2023-10-06T02:59:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3281070988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf415ec40 con 0x7f5bf40b3670 2023-10-06T02:59:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5beb7fe700 1 -- 172.21.15.123:0/3281070988 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5bdc01c6c0 con 0x7f5bf40b3670 2023-10-06T02:59:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5beb7fe700 1 -- 172.21.15.123:0/3281070988 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f5bdc012a90 con 0x7f5bf40b3670 2023-10-06T02:59:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.559+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3281070988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf4147860 con 0x7f5bf40b3670 2023-10-06T02:59:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.563+0000 7f5beb7fe700 1 -- 172.21.15.123:0/3281070988 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5bf4147860 con 0x7f5bf40b3670 2023-10-06T02:59:31.598 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:31.591+0000 7f07b0ef7000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T02:59:31.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.635+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3281070988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9", "id": 7} v 0) v1 -- 0x7f5bf411bda0 con 0x7f5bf40b3670 2023-10-06T02:59:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.647+0000 7f5beb7fe700 1 -- 172.21.15.123:0/3281070988 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5bf411bda0 con 0x7f5bf40b3670 2023-10-06T02:59:31.650 INFO:teuthology.orchestra.run.smithi123.stdout:7 2023-10-06T02:59:31.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.647+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3281070988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bf40b3670 msgr2=0x7f5bf40b8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.647+0000 7f5bf8f5a700 1 --2- 172.21.15.123:0/3281070988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bf40b3670 0x7f5bf40b8280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c590 tx=0x7f5bdc00c8a0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.647+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3281070988 shutdown_connections 2023-10-06T02:59:31.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.647+0000 7f5bf8f5a700 1 --2- 172.21.15.123:0/3281070988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bf414acb0 0x7f5bf415e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.647+0000 7f5bf8f5a700 1 --2- 172.21.15.123:0/3281070988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bf40b3670 0x7f5bf40b8280 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.647+0000 7f5bf8f5a700 1 --2- 172.21.15.123:0/3281070988 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5bf406b2e0 0x7f5bf40b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.647+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3281070988 >> 172.21.15.123:0/3281070988 conn(0x7f5bf40beed0 msgr2=0x7f5bf414ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:31.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.647+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3281070988 shutdown_connections 2023-10-06T02:59:31.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-06T02:59:31.647+0000 7f5bf8f5a700 1 -- 172.21.15.123:0/3281070988 wait complete. 2023-10-06T02:59:31.665 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T02:59:31.665 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T02:59:31.667 INFO:tasks.ceph.osd.0:Started 2023-10-06T02:59:31.667 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T02:59:31.667 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T02:59:31.669 INFO:tasks.ceph.osd.1:Started 2023-10-06T02:59:31.669 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T02:59:31.669 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T02:59:31.671 INFO:tasks.ceph.osd.2:Started 2023-10-06T02:59:31.671 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T02:59:31.671 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T02:59:31.673 INFO:tasks.ceph.osd.3:Started 2023-10-06T02:59:31.673 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T02:59:31.673 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T02:59:31.675 INFO:tasks.ceph.osd.4:Started 2023-10-06T02:59:31.675 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T02:59:31.676 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T02:59:31.678 INFO:tasks.ceph.osd.5:Started 2023-10-06T02:59:31.678 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T02:59:31.678 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T02:59:31.680 INFO:tasks.ceph.osd.6:Started 2023-10-06T02:59:31.680 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T02:59:31.681 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T02:59:31.683 INFO:tasks.ceph.osd.7:Started 2023-10-06T02:59:31.683 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:31.720 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:31.715+0000 7f07b0ef7000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T02:59:31.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9322655700 1 Processor -- start 2023-10-06T02:59:31.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9322655700 1 -- start start 2023-10-06T02:59:31.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9322655700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f931c148660 0x7f931c1527a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9322655700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931c068760 con 0x7f931c06c5c0 2023-10-06T02:59:31.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9322655700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931c14bab0 con 0x7f931c0ba0c0 2023-10-06T02:59:31.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9322655700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931c147b20 con 0x7f931c148660 2023-10-06T02:59:31.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f931bfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f931c06c5c0 0x7f931c14b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:55026/0 (socket says 172.21.15.27:55026) 2023-10-06T02:59:31.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f931bfff700 1 -- 172.21.15.27:0/2388735303 learned_addr learned my addr 172.21.15.27:0/2388735303 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:31.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9320bf2700 1 --2- 172.21.15.27:0/2388735303 >> v2:172.21.15.27:3300/0 conn(0x7f931c148660 0x7f931c1527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f931affd700 1 -- 172.21.15.27:0/2388735303 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690715117 0 0) 0x7f931c068760 con 0x7f931c06c5c0 2023-10-06T02:59:31.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f931affd700 1 -- 172.21.15.27:0/2388735303 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9304003570 con 0x7f931c06c5c0 2023-10-06T02:59:31.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9320bf2700 1 -- 172.21.15.27:0/2388735303 >> v1:172.21.15.123:6789/0 conn(0x7f931c0ba0c0 legacy=0x7f931c147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f931affd700 1 -- 172.21.15.27:0/2388735303 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3873882346 0 0) 0x7f9304003570 con 0x7f931c06c5c0 2023-10-06T02:59:31.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9320bf2700 1 -- 172.21.15.27:0/2388735303 >> v1:172.21.15.27:6789/0 conn(0x7f931c06c5c0 legacy=0x7f931c14b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9320bf2700 1 -- 172.21.15.27:0/2388735303 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c14bd90 con 0x7f931c148660 2023-10-06T02:59:31.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9320bf2700 1 --2- 172.21.15.27:0/2388735303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c148660 0x7f931c1527a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f930c0098e0 tx=0x7f930c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606ea9d780e809f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:31.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f931affd700 1 -- 172.21.15.27:0/2388735303 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310001470 con 0x7f931c148660 2023-10-06T02:59:31.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f931affd700 1 -- 172.21.15.27:0/2388735303 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c011420 con 0x7f931c148660 2023-10-06T02:59:31.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f931affd700 1 -- 172.21.15.27:0/2388735303 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c0117a0 con 0x7f931c148660 2023-10-06T02:59:31.800 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:31.791+0000 7efc54752000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T02:59:31.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9322655700 1 -- 172.21.15.27:0/2388735303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c148660 msgr2=0x7f931c1527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9322655700 1 --2- 172.21.15.27:0/2388735303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c148660 0x7f931c1527a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f930c0098e0 tx=0x7f930c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9322655700 1 -- 172.21.15.27:0/2388735303 shutdown_connections 2023-10-06T02:59:31.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9322655700 1 --2- 172.21.15.27:0/2388735303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c148660 0x7f931c1527a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9322655700 1 -- 172.21.15.27:0/2388735303 >> 172.21.15.27:0/2388735303 conn(0x7f931c0bde40 msgr2=0x7f931c0be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:31.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9322655700 1 -- 172.21.15.27:0/2388735303 shutdown_connections 2023-10-06T02:59:31.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.791+0000 7f9322655700 1 -- 172.21.15.27:0/2388735303 wait complete. 2023-10-06T02:59:31.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f9322655700 1 Processor -- start 2023-10-06T02:59:31.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f9322655700 1 -- start start 2023-10-06T02:59:31.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f9322655700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c06c5c0 0x7f931c133d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f9322655700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931c0ba0c0 0x7f931c14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f9322655700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f931c148660 0x7f931c14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:31.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f9322655700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c134b70 con 0x7f931c06c5c0 2023-10-06T02:59:31.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f9322655700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c14b010 con 0x7f931c148660 2023-10-06T02:59:31.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f9322655700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931c146210 con 0x7f931c0ba0c0 2023-10-06T02:59:31.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f931bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c06c5c0 0x7f931c133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f931bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c06c5c0 0x7f931c133d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45718/0 (socket says 172.21.15.27:45718) 2023-10-06T02:59:31.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f931bfff700 1 -- 172.21.15.27:0/3711567698 learned_addr learned my addr 172.21.15.27:0/3711567698 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:31.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f931b7fe700 1 --2- 172.21.15.27:0/3711567698 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931c0ba0c0 0x7f931c14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f9320bf2700 1 --2- 172.21.15.27:0/3711567698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f931c148660 0x7f931c14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:31.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f931bfff700 1 -- 172.21.15.27:0/3711567698 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931c0ba0c0 msgr2=0x7f931c14a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f931bfff700 1 --2- 172.21.15.27:0/3711567698 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931c0ba0c0 0x7f931c14a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f931bfff700 1 -- 172.21.15.27:0/3711567698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f931c148660 msgr2=0x7f931c14aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f931bfff700 1 --2- 172.21.15.27:0/3711567698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f931c148660 0x7f931c14aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f931bfff700 1 -- 172.21.15.27:0/3711567698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c009420 con 0x7f931c06c5c0 2023-10-06T02:59:31.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f931bfff700 1 --2- 172.21.15.27:0/3711567698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c06c5c0 0x7f931c133d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f931000cbc0 tx=0x7f9310001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:31.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f9303fff700 1 -- 172.21.15.27:0/3711567698 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310007150 con 0x7f931c06c5c0 2023-10-06T02:59:31.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.795+0000 7f9303fff700 1 -- 172.21.15.27:0/3711567698 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93100072d0 con 0x7f931c06c5c0 2023-10-06T02:59:31.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.799+0000 7f9322655700 1 -- 172.21.15.27:0/3711567698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c12c570 con 0x7f931c06c5c0 2023-10-06T02:59:31.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.799+0000 7f9303fff700 1 -- 172.21.15.27:0/3711567698 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310007690 con 0x7f931c06c5c0 2023-10-06T02:59:31.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.799+0000 7f9322655700 1 -- 172.21.15.27:0/3711567698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931c15caa0 con 0x7f931c06c5c0 2023-10-06T02:59:31.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.799+0000 7f9303fff700 1 -- 172.21.15.27:0/3711567698 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9310004cc0 con 0x7f931c06c5c0 2023-10-06T02:59:31.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.799+0000 7f9303fff700 1 -- 172.21.15.27:0/3711567698 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f931000a590 con 0x7f931c06c5c0 2023-10-06T02:59:31.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.799+0000 7f9322655700 1 -- 172.21.15.27:0/3711567698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c15cd20 con 0x7f931c06c5c0 2023-10-06T02:59:31.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.803+0000 7f9303fff700 1 -- 172.21.15.27:0/3711567698 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9310018070 con 0x7f931c06c5c0 2023-10-06T02:59:31.859 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:31.855+0000 7efc54752000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T02:59:31.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.867+0000 7f9322655700 1 -- 172.21.15.27:0/3711567698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f931c04be40 con 0x7f931c06c5c0 2023-10-06T02:59:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.867+0000 7f9303fff700 1 -- 172.21.15.27:0/3711567698 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f931000abd0 con 0x7f931c06c5c0 2023-10-06T02:59:31.872 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:31.872 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":10,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:31.641681+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.867+0000 7f9322655700 1 -- 172.21.15.27:0/3711567698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c06c5c0 msgr2=0x7f931c133d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.867+0000 7f9322655700 1 --2- 172.21.15.27:0/3711567698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c06c5c0 0x7f931c133d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f931000cbc0 tx=0x7f9310001ad0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.867+0000 7f9322655700 1 -- 172.21.15.27:0/3711567698 shutdown_connections 2023-10-06T02:59:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.867+0000 7f9322655700 1 --2- 172.21.15.27:0/3711567698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f931c148660 0x7f931c14aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.867+0000 7f9322655700 1 --2- 172.21.15.27:0/3711567698 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931c0ba0c0 0x7f931c14a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.867+0000 7f9322655700 1 --2- 172.21.15.27:0/3711567698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c06c5c0 0x7f931c133d70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.867+0000 7f9322655700 1 -- 172.21.15.27:0/3711567698 >> 172.21.15.27:0/3711567698 conn(0x7f931c0bde40 msgr2=0x7f931c0b7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.867+0000 7f9322655700 1 -- 172.21.15.27:0/3711567698 shutdown_connections 2023-10-06T02:59:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:31.867+0000 7f9322655700 1 -- 172.21.15.27:0/3711567698 wait complete. 2023-10-06T02:59:31.884 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T02:59:31.884 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T02:59:31.929 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:31.923+0000 7efc54752000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T02:59:32.031 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:32.027+0000 7f07b0ef7000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T02:59:32.032 INFO:tasks.ceph.osd.1.smithi027.stderr:2023-10-06T02:59:32.027+0000 7f4f1cb483c0 -1 Falling back to public interface 2023-10-06T02:59:32.064 INFO:tasks.ceph.osd.2.smithi027.stderr:2023-10-06T02:59:32.059+0000 7fd2c32c73c0 -1 Falling back to public interface 2023-10-06T02:59:32.104 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:32.099+0000 7efc54752000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T02:59:32.176 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:32.171+0000 7efc54752000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T02:59:32.203 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:32.199+0000 7f07b0ef7000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:59:32.272 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:32.267+0000 7f07b0ef7000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T02:59:32.283 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-10-06T02:59:32.279+0000 7f6445e3f3c0 -1 Falling back to public interface 2023-10-06T02:59:32.284 INFO:tasks.ceph.osd.3.smithi027.stderr:2023-10-06T02:59:32.279+0000 7f66f74333c0 -1 Falling back to public interface 2023-10-06T02:59:32.292 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-10-06T02:59:32.287+0000 7f6d363133c0 -1 Falling back to public interface 2023-10-06T02:59:32.296 INFO:tasks.ceph.osd.0.smithi027.stderr:2023-10-06T02:59:32.291+0000 7ffb361043c0 -1 Falling back to public interface 2023-10-06T02:59:32.304 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-10-06T02:59:32.299+0000 7fc06bbbd3c0 -1 Falling back to public interface 2023-10-06T02:59:32.304 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-10-06T02:59:32.299+0000 7fde0c25a3c0 -1 Falling back to public interface 2023-10-06T02:59:32.304 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-10-06T02:59:32.299+0000 7fc06ab86700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6817/0: (98) Address already in use 2023-10-06T02:59:32.325 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:32.319+0000 7f07b0ef7000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T02:59:32.383 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:32.379+0000 7f07b0ef7000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T02:59:32.679 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:32.675+0000 7f07b0ef7000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T02:59:32.690 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:32.740 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:32.735+0000 7f07b0ef7000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T02:59:32.781 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.775+0000 7f7b4d8ea700 1 Processor -- start 2023-10-06T02:59:32.781 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.775+0000 7f7b4d8ea700 1 -- start start 2023-10-06T02:59:32.783 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.775+0000 7f7b4d8ea700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b480b8e00 0x7f7b4814ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:32.783 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.775+0000 7f7b4d8ea700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b480ba970 0x7f7b4814aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:32.783 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.775+0000 7f7b4d8ea700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4814c940 con 0x7f7b4814aff0 2023-10-06T02:59:32.783 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.775+0000 7f7b4d8ea700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b480b54c0 con 0x7f7b480ba970 2023-10-06T02:59:32.784 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.775+0000 7f7b4d8ea700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4814f410 con 0x7f7b480b8e00 2023-10-06T02:59:32.784 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.775+0000 7f7b467fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b480ba970 0x7f7b4814aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:32.784 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.775+0000 7f7b467fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b480ba970 0x7f7b4814aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45730/0 (socket says 172.21.15.27:45730) 2023-10-06T02:59:32.784 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.775+0000 7f7b467fc700 1 -- 172.21.15.27:0/563924168 learned_addr learned my addr 172.21.15.27:0/563924168 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:32.784 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.775+0000 7f7b46ffd700 1 --2- 172.21.15.27:0/563924168 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b480b8e00 0x7f7b4814ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:32.784 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b467fc700 1 -- 172.21.15.27:0/563924168 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b480b8e00 msgr2=0x7f7b4814ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:32.784 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b467fc700 1 --2- 172.21.15.27:0/563924168 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b480b8e00 0x7f7b4814ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:32.784 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b467fc700 1 -- 172.21.15.27:0/563924168 >> v1:172.21.15.123:6789/0 conn(0x7f7b4814aff0 legacy=0x7f7b4806a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:32.784 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b467fc700 1 -- 172.21.15.27:0/563924168 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4814f6f0 con 0x7f7b480ba970 2023-10-06T02:59:32.784 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b467fc700 1 --2- 172.21.15.27:0/563924168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480ba970 0x7f7b4814aab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0099b0 tx=0x7f7b3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d6ae1a8d28a7cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:32.785 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b45ffb700 1 -- 172.21.15.27:0/563924168 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c009ea0 con 0x7f7b480ba970 2023-10-06T02:59:32.785 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b45ffb700 1 -- 172.21.15.27:0/563924168 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c00b860 con 0x7f7b480ba970 2023-10-06T02:59:32.785 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b45ffb700 1 -- 172.21.15.27:0/563924168 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00bc00 con 0x7f7b480ba970 2023-10-06T02:59:32.788 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/563924168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480ba970 msgr2=0x7f7b4814aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:32.788 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 --2- 172.21.15.27:0/563924168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480ba970 0x7f7b4814aab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0099b0 tx=0x7f7b3c009250 comp rx=0 tx=0).stop 2023-10-06T02:59:32.788 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/563924168 shutdown_connections 2023-10-06T02:59:32.788 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 --2- 172.21.15.27:0/563924168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480ba970 0x7f7b4814aab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:32.788 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 --2- 172.21.15.27:0/563924168 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b480b8e00 0x7f7b4814ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:32.788 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/563924168 >> 172.21.15.27:0/563924168 conn(0x7f7b480be590 msgr2=0x7f7b480be990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:32.788 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/563924168 shutdown_connections 2023-10-06T02:59:32.789 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/563924168 wait complete. 2023-10-06T02:59:32.789 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 Processor -- start 2023-10-06T02:59:32.789 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 -- start start 2023-10-06T02:59:32.789 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480b8e00 0x7f7b480b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:32.789 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b480ba970 0x7f7b480b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:32.789 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4814aff0 0x7f7b4815e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:32.789 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480b2ec0 con 0x7f7b480b8e00 2023-10-06T02:59:32.789 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480b8140 con 0x7f7b4814aff0 2023-10-06T02:59:32.790 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b4d8ea700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480b2610 con 0x7f7b480ba970 2023-10-06T02:59:32.790 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b46ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480b8e00 0x7f7b480b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:32.790 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b46ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480b8e00 0x7f7b480b85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45736/0 (socket says 172.21.15.27:45736) 2023-10-06T02:59:32.790 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b46ffd700 1 -- 172.21.15.27:0/3934913441 learned_addr learned my addr 172.21.15.27:0/3934913441 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:32.790 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b467fc700 1 --2- 172.21.15.27:0/3934913441 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b480ba970 0x7f7b480b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:32.790 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b477fe700 1 --2- 172.21.15.27:0/3934913441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4814aff0 0x7f7b4815e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:32.790 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b46ffd700 1 -- 172.21.15.27:0/3934913441 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b480ba970 msgr2=0x7f7b480b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:32.790 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b46ffd700 1 --2- 172.21.15.27:0/3934913441 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b480ba970 0x7f7b480b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:32.790 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b46ffd700 1 -- 172.21.15.27:0/3934913441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4814aff0 msgr2=0x7f7b4815e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:32.790 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.779+0000 7f7b46ffd700 1 --2- 172.21.15.27:0/3934913441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4814aff0 0x7f7b4815e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:32.791 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.783+0000 7f7b46ffd700 1 -- 172.21.15.27:0/3934913441 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c0094f0 con 0x7f7b480b8e00 2023-10-06T02:59:32.791 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.783+0000 7f7b46ffd700 1 --2- 172.21.15.27:0/3934913441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480b8e00 0x7f7b480b85d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800ec80 tx=0x7f7b380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:32.791 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.783+0000 7f7b2effd700 1 -- 172.21.15.27:0/3934913441 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800c850 con 0x7f7b480b8e00 2023-10-06T02:59:32.791 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.783+0000 7f7b2effd700 1 -- 172.21.15.27:0/3934913441 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3800c9b0 con 0x7f7b480b8e00 2023-10-06T02:59:32.791 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.783+0000 7f7b2effd700 1 -- 172.21.15.27:0/3934913441 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800cd50 con 0x7f7b480b8e00 2023-10-06T02:59:32.791 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.783+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/3934913441 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b48147910 con 0x7f7b480b8e00 2023-10-06T02:59:32.791 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.783+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/3934913441 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b480b2940 con 0x7f7b480b8e00 2023-10-06T02:59:32.791 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.783+0000 7f7b2effd700 1 -- 172.21.15.27:0/3934913441 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7b38005c80 con 0x7f7b480b8e00 2023-10-06T02:59:32.791 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.783+0000 7f7b2effd700 1 -- 172.21.15.27:0/3934913441 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f7b38006700 con 0x7f7b480b8e00 2023-10-06T02:59:32.792 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.783+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/3934913441 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b480b9b90 con 0x7f7b480b8e00 2023-10-06T02:59:32.792 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.787+0000 7f7b2effd700 1 -- 172.21.15.27:0/3934913441 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7b480b9b90 con 0x7f7b480b8e00 2023-10-06T02:59:32.809 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:32.803+0000 7f07b0ef7000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T02:59:32.853 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.847+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/3934913441 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b48147b50 con 0x7f7b480b8e00 2023-10-06T02:59:32.853 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.847+0000 7f7b2effd700 1 -- 172.21.15.27:0/3934913441 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f7b48147b50 con 0x7f7b480b8e00 2023-10-06T02:59:32.854 INFO:teuthology.misc.health.smithi027.stdout: 2023-10-06T02:59:32.854 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":10,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:31.641681+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:32.855 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.847+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/3934913441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480b8e00 msgr2=0x7f7b480b85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:32.855 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.847+0000 7f7b4d8ea700 1 --2- 172.21.15.27:0/3934913441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480b8e00 0x7f7b480b85d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800ec80 tx=0x7f7b380091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:32.855 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.847+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/3934913441 shutdown_connections 2023-10-06T02:59:32.855 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.847+0000 7f7b4d8ea700 1 --2- 172.21.15.27:0/3934913441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4814aff0 0x7f7b4815e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:32.855 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.847+0000 7f7b4d8ea700 1 --2- 172.21.15.27:0/3934913441 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b480ba970 0x7f7b480b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:32.855 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.847+0000 7f7b4d8ea700 1 --2- 172.21.15.27:0/3934913441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480b8e00 0x7f7b480b85d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:32.855 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.847+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/3934913441 >> 172.21.15.27:0/3934913441 conn(0x7f7b480be590 msgr2=0x7f7b48069620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:32.855 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.851+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/3934913441 shutdown_connections 2023-10-06T02:59:32.856 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:32.851+0000 7f7b4d8ea700 1 -- 172.21.15.27:0/3934913441 wait complete. 2023-10-06T02:59:32.863 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T02:59:32.922 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:32.919+0000 7efc54752000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T02:59:32.985 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:32.979+0000 7f07b0ef7000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T02:59:33.055 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:33.051+0000 7f07b0ef7000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T02:59:33.805 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-10-06T02:59:33.799+0000 7f07b0ef7000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T02:59:33.969 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:33.963+0000 7efc3d84e700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T02:59:33.970 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-06T02:59:33.967+0000 7efc3d84e700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T02:59:35.846 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-10-06T02:59:35.843+0000 7fde0c25a3c0 -1 osd.6 0 log_to_monitors true 2023-10-06T02:59:35.905 INFO:tasks.ceph.osd.1.smithi027.stderr:2023-10-06T02:59:35.899+0000 7f4f1cb483c0 -1 osd.1 0 log_to_monitors true 2023-10-06T02:59:35.917 INFO:tasks.ceph.osd.2.smithi027.stderr:2023-10-06T02:59:35.911+0000 7fd2c32c73c0 -1 osd.2 0 log_to_monitors true 2023-10-06T02:59:35.983 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-10-06T02:59:35.979+0000 7f6445e3f3c0 -1 osd.5 0 log_to_monitors true 2023-10-06T02:59:36.057 INFO:tasks.ceph.osd.3.smithi027.stderr:2023-10-06T02:59:36.051+0000 7f66f74333c0 -1 osd.3 0 log_to_monitors true 2023-10-06T02:59:36.062 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-10-06T02:59:36.059+0000 7f6d363133c0 -1 osd.7 0 log_to_monitors true 2023-10-06T02:59:36.105 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-10-06T02:59:36.099+0000 7fc06bbbd3c0 -1 osd.4 0 log_to_monitors true 2023-10-06T02:59:36.157 INFO:tasks.ceph.osd.0.smithi027.stderr:2023-10-06T02:59:36.151+0000 7ffb361043c0 -1 osd.0 0 log_to_monitors true 2023-10-06T02:59:39.671 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:39.795 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fb12de700 1 Processor -- start 2023-10-06T02:59:39.796 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fb12de700 1 -- start start 2023-10-06T02:59:39.797 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fb12de700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8fac0bdd10 0x7f8fac0be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.797 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fb12de700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fac069cd0 0x7f8fac143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.797 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fb12de700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fac1439e0 con 0x7f8fac143560 2023-10-06T02:59:39.797 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fb12de700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fac0696a0 con 0x7f8fac0bdd10 2023-10-06T02:59:39.797 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fb12de700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac14a670 con 0x7f8fac069cd0 2023-10-06T02:59:39.797 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fabfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8fac0bdd10 0x7f8fac0be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.798 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fb0add700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8fac143560 0x7f8fac06a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60360/0 (socket says 172.21.15.27:60360) 2023-10-06T02:59:39.798 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fb0add700 1 -- 172.21.15.27:0/3098330651 learned_addr learned my addr 172.21.15.27:0/3098330651 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:39.798 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fabfff700 1 -- 172.21.15.27:0/3098330651 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fac069cd0 msgr2=0x7f8fac143020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:59:39.799 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fabfff700 1 --2- 172.21.15.27:0/3098330651 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fac069cd0 0x7f8fac143020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.799 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fabfff700 1 -- 172.21.15.27:0/3098330651 >> v1:172.21.15.27:6789/0 conn(0x7f8fac143560 legacy=0x7f8fac06a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.799 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8faaffd700 1 -- 172.21.15.27:0/3098330651 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901949920 0 0) 0x7f8f9c001110 con 0x7f8fac143560 2023-10-06T02:59:39.799 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fabfff700 1 -- 172.21.15.27:0/3098330651 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac0698f0 con 0x7f8fac0bdd10 2023-10-06T02:59:39.799 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8fabfff700 1 --2- 172.21.15.27:0/3098330651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fac0bdd10 0x7f8fac0be0e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009e60 tx=0x7f8fa4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac34c83ec9bc9b65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.799 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8faaffd700 1 -- 172.21.15.27:0/3098330651 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400e070 con 0x7f8fac0bdd10 2023-10-06T02:59:39.799 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8faaffd700 1 -- 172.21.15.27:0/3098330651 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa400bc30 con 0x7f8fac0bdd10 2023-10-06T02:59:39.799 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.791+0000 7f8faaffd700 1 -- 172.21.15.27:0/3098330651 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4012430 con 0x7f8fac0bdd10 2023-10-06T02:59:39.800 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.795+0000 7f8fb12de700 1 -- 172.21.15.27:0/3098330651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fac0bdd10 msgr2=0x7f8fac0be0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.800 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.795+0000 7f8fb12de700 1 --2- 172.21.15.27:0/3098330651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fac0bdd10 0x7f8fac0be0e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009e60 tx=0x7f8fa4009780 comp rx=0 tx=0).stop 2023-10-06T02:59:39.801 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.795+0000 7f8fb12de700 1 -- 172.21.15.27:0/3098330651 shutdown_connections 2023-10-06T02:59:39.801 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.795+0000 7f8fb12de700 1 --2- 172.21.15.27:0/3098330651 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fac069cd0 0x7f8fac143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.801 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.795+0000 7f8fb12de700 1 --2- 172.21.15.27:0/3098330651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fac0bdd10 0x7f8fac0be0e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.801 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.795+0000 7f8fb12de700 1 -- 172.21.15.27:0/3098330651 >> 172.21.15.27:0/3098330651 conn(0x7f8fac06d7f0 msgr2=0x7f8fac062d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:39.801 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.795+0000 7f8fb12de700 1 -- 172.21.15.27:0/3098330651 shutdown_connections 2023-10-06T02:59:39.801 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.795+0000 7f8fb12de700 1 -- 172.21.15.27:0/3098330651 wait complete. 2023-10-06T02:59:39.802 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.795+0000 7f8fb12de700 1 Processor -- start 2023-10-06T02:59:39.802 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.795+0000 7f8fb12de700 1 -- start start 2023-10-06T02:59:39.804 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fb12de700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fac069cd0 0x7f8fac15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.805 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fb12de700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fac0bdd10 0x7f8fac0b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.805 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fb12de700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fac143560 0x7f8fac14c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.805 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fb12de700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac15e310 con 0x7f8fac0bdd10 2023-10-06T02:59:39.805 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fb12de700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac15e890 con 0x7f8fac069cd0 2023-10-06T02:59:39.805 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fb12de700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac149ac0 con 0x7f8fac143560 2023-10-06T02:59:39.805 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fab7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fac0bdd10 0x7f8fac0b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.805 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fab7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fac0bdd10 0x7f8fac0b8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57300/0 (socket says 172.21.15.27:57300) 2023-10-06T02:59:39.805 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fabfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fac069cd0 0x7f8fac15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.805 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fab7fe700 1 -- 172.21.15.27:0/1130359790 learned_addr learned my addr 172.21.15.27:0/1130359790 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:39.805 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fb0add700 1 --2- 172.21.15.27:0/1130359790 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fac143560 0x7f8fac14c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.806 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fab7fe700 1 -- 172.21.15.27:0/1130359790 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fac143560 msgr2=0x7f8fac14c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.806 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fab7fe700 1 --2- 172.21.15.27:0/1130359790 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fac143560 0x7f8fac14c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.806 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fab7fe700 1 -- 172.21.15.27:0/1130359790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fac069cd0 msgr2=0x7f8fac15ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.806 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fab7fe700 1 --2- 172.21.15.27:0/1130359790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fac069cd0 0x7f8fac15ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.806 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fab7fe700 1 -- 172.21.15.27:0/1130359790 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa4009a20 con 0x7f8fac0bdd10 2023-10-06T02:59:39.806 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fab7fe700 1 --2- 172.21.15.27:0/1130359790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fac0bdd10 0x7f8fac0b8410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000b5e0 tx=0x7f8fa00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.807 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8f93fff700 1 -- 172.21.15.27:0/1130359790 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000f510 con 0x7f8fac0bdd10 2023-10-06T02:59:39.807 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fb12de700 1 -- 172.21.15.27:0/1130359790 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fac0b8950 con 0x7f8fac0bdd10 2023-10-06T02:59:39.807 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8fb12de700 1 -- 172.21.15.27:0/1130359790 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fac15e520 con 0x7f8fac0bdd10 2023-10-06T02:59:39.807 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8f93fff700 1 -- 172.21.15.27:0/1130359790 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa000f690 con 0x7f8fac0bdd10 2023-10-06T02:59:39.807 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.799+0000 7f8f93fff700 1 -- 172.21.15.27:0/1130359790 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000fa50 con 0x7f8fac0bdd10 2023-10-06T02:59:39.808 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.803+0000 7f8fb12de700 1 -- 172.21.15.27:0/1130359790 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8c0052b0 con 0x7f8fac0bdd10 2023-10-06T02:59:39.808 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.803+0000 7f8f93fff700 1 -- 172.21.15.27:0/1130359790 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 79903+0+0 (secure 0 0 0) 0x7f8fa001a400 con 0x7f8fac0bdd10 2023-10-06T02:59:39.808 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.803+0000 7f8f93fff700 1 --2- 172.21.15.27:0/1130359790 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8f98060540 0x7f8f980629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.809 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.803+0000 7f8f93fff700 1 -- 172.21.15.27:0/1130359790 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f8fa007b330 con 0x7f8fac0bdd10 2023-10-06T02:59:39.809 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.803+0000 7f8fabfff700 1 --2- 172.21.15.27:0/1130359790 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8f98060540 0x7f8f980629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.809 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.803+0000 7f8fabfff700 1 --2- 172.21.15.27:0/1130359790 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8f98060540 0x7f8f980629f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009e60 tx=0x7f8fa4019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.816 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:39.811+0000 7f8f93fff700 1 -- 172.21.15.27:0/1130359790 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8fa0050200 con 0x7f8fac0bdd10 2023-10-06T02:59:40.009 INFO:tasks.ceph.osd.0.smithi027.stderr:2023-10-06T02:59:40.003+0000 7ffb318a4700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T02:59:40.016 INFO:tasks.ceph.osd.0.smithi027.stderr:2023-10-06T02:59:40.011+0000 7ffb2a648700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:59:40.052 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-10-06T02:59:40.047+0000 7fde0921f700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T02:59:40.057 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-10-06T02:59:40.051+0000 7fde0079e700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:59:40.061 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-10-06T02:59:40.051+0000 7f6d31ab3700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T02:59:40.063 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-10-06T02:59:40.059+0000 7f6d2a857700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:59:40.066 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-10-06T02:59:40.063+0000 7f6442e04700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T02:59:40.072 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-10-06T02:59:40.067+0000 7f643a383700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:59:40.087 INFO:tasks.ceph.osd.2.smithi027.stderr:2023-10-06T02:59:40.083+0000 7fd2bea67700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T02:59:40.087 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-10-06T02:59:40.083+0000 7fc068b82700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T02:59:40.093 INFO:tasks.ceph.osd.2.smithi027.stderr:2023-10-06T02:59:40.087+0000 7fd2b780b700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:59:40.093 INFO:tasks.ceph.osd.1.smithi027.stderr:2023-10-06T02:59:40.087+0000 7f4f19b0d700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T02:59:40.094 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-10-06T02:59:40.091+0000 7fc060101700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:59:40.099 INFO:tasks.ceph.osd.1.smithi027.stderr:2023-10-06T02:59:40.095+0000 7f4f1108c700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:59:40.112 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.107+0000 7f8fb12de700 1 -- 172.21.15.27:0/1130359790 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f8c005560 con 0x7f8fac0bdd10 2023-10-06T02:59:40.113 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.107+0000 7f8f93fff700 1 -- 172.21.15.27:0/1130359790 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f8fa0009210 con 0x7f8fac0bdd10 2023-10-06T02:59:40.113 INFO:teuthology.misc.health.smithi027.stdout: 2023-10-06T02:59:40.113 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":12,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:37.736534+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:40.116 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.111+0000 7f8fb12de700 1 -- 172.21.15.27:0/1130359790 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8f98060540 msgr2=0x7f8f980629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.116 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.111+0000 7f8fb12de700 1 --2- 172.21.15.27:0/1130359790 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8f98060540 0x7f8f980629f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009e60 tx=0x7f8fa4019000 comp rx=0 tx=0).stop 2023-10-06T02:59:40.116 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.111+0000 7f8fb12de700 1 -- 172.21.15.27:0/1130359790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fac0bdd10 msgr2=0x7f8fac0b8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.116 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.111+0000 7f8fb12de700 1 --2- 172.21.15.27:0/1130359790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fac0bdd10 0x7f8fac0b8410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000b5e0 tx=0x7f8fa00090f0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.117 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.111+0000 7f8fb12de700 1 -- 172.21.15.27:0/1130359790 shutdown_connections 2023-10-06T02:59:40.117 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.111+0000 7f8fb12de700 1 --2- 172.21.15.27:0/1130359790 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8f98060540 0x7f8f980629f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.117 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.111+0000 7f8fb12de700 1 --2- 172.21.15.27:0/1130359790 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fac143560 0x7f8fac14c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.117 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.111+0000 7f8fb12de700 1 --2- 172.21.15.27:0/1130359790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fac0bdd10 0x7f8fac0b8410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.117 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.111+0000 7f8fb12de700 1 --2- 172.21.15.27:0/1130359790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fac069cd0 0x7f8fac15ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.117 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.111+0000 7f8fb12de700 1 -- 172.21.15.27:0/1130359790 >> 172.21.15.27:0/1130359790 conn(0x7f8fac06d7f0 msgr2=0x7f8fac06ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.117 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.111+0000 7f8fb12de700 1 -- 172.21.15.27:0/1130359790 shutdown_connections 2023-10-06T02:59:40.117 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:40.111+0000 7f8fb12de700 1 -- 172.21.15.27:0/1130359790 wait complete. 2023-10-06T02:59:40.128 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T02:59:40.148 INFO:tasks.ceph.osd.3.smithi027.stderr:2023-10-06T02:59:40.143+0000 7f66f2bd3700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T02:59:40.156 INFO:tasks.ceph.osd.3.smithi027.stderr:2023-10-06T02:59:40.151+0000 7f66eb977700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:59:46.936 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:47.041 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.035+0000 7fc2d0d40700 1 Processor -- start 2023-10-06T02:59:47.041 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.035+0000 7fc2d0d40700 1 -- start start 2023-10-06T02:59:47.043 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2d0d40700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc2cc06e090 0x7fc2cc0bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.044 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2d0d40700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2cc0b6de0 0x7fc2cc0b7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.044 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2d0d40700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2cc0bc660 con 0x7fc2cc0a26d0 2023-10-06T02:59:47.044 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2d0d40700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2cc06eb50 con 0x7fc2cc06e090 2023-10-06T02:59:47.044 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2d0d40700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc06ed60 con 0x7fc2cc0b6de0 2023-10-06T02:59:47.044 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2caffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc2cc0a26d0 0x7fc2cc0a2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60374/0 (socket says 172.21.15.27:60374) 2023-10-06T02:59:47.044 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2caffd700 1 -- 172.21.15.27:0/2487688677 learned_addr learned my addr 172.21.15.27:0/2487688677 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:47.044 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2cb7fe700 1 --2- 172.21.15.27:0/2487688677 >> v2:172.21.15.123:3300/0 conn(0x7fc2cc06e090 0x7fc2cc0bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.044 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2cbfff700 1 --2- 172.21.15.27:0/2487688677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2cc0b6de0 0x7fc2cc0b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.045 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2ca7fc700 1 -- 172.21.15.27:0/2487688677 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827640333 0 0) 0x7fc2cc0bc660 con 0x7fc2cc0a26d0 2023-10-06T02:59:47.046 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2ca7fc700 1 -- 172.21.15.27:0/2487688677 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b4003570 con 0x7fc2cc0a26d0 2023-10-06T02:59:47.046 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2cb7fe700 1 -- 172.21.15.27:0/2487688677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2cc0b6de0 msgr2=0x7fc2cc0b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:47.046 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2cb7fe700 1 --2- 172.21.15.27:0/2487688677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2cc0b6de0 0x7fc2cc0b7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.046 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2cb7fe700 1 -- 172.21.15.27:0/2487688677 >> v1:172.21.15.27:6789/0 conn(0x7fc2cc0a26d0 legacy=0x7fc2cc0a2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.046 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2cb7fe700 1 -- 172.21.15.27:0/2487688677 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc0a3200 con 0x7fc2cc06e090 2023-10-06T02:59:47.046 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2cbfff700 1 --2- 172.21.15.27:0/2487688677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2cc0b6de0 0x7fc2cc0b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:47.046 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2cb7fe700 1 --2- 172.21.15.27:0/2487688677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2cc06e090 0x7fc2cc0bcb60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009e60 tx=0x7fc2bc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91ad3a1ec0d30aef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:47.046 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2ca7fc700 1 -- 172.21.15.27:0/2487688677 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00e070 con 0x7fc2cc06e090 2023-10-06T02:59:47.046 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2ca7fc700 1 -- 172.21.15.27:0/2487688677 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc00bb40 con 0x7fc2cc06e090 2023-10-06T02:59:47.046 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2ca7fc700 1 -- 172.21.15.27:0/2487688677 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc012430 con 0x7fc2cc06e090 2023-10-06T02:59:47.047 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2d0d40700 1 -- 172.21.15.27:0/2487688677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2cc06e090 msgr2=0x7fc2cc0bcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.047 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2d0d40700 1 --2- 172.21.15.27:0/2487688677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2cc06e090 0x7fc2cc0bcb60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009e60 tx=0x7fc2bc009780 comp rx=0 tx=0).stop 2023-10-06T02:59:47.048 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2d0d40700 1 -- 172.21.15.27:0/2487688677 shutdown_connections 2023-10-06T02:59:47.048 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2d0d40700 1 --2- 172.21.15.27:0/2487688677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2cc0b6de0 0x7fc2cc0b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.048 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2d0d40700 1 --2- 172.21.15.27:0/2487688677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2cc06e090 0x7fc2cc0bcb60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.048 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2d0d40700 1 -- 172.21.15.27:0/2487688677 >> 172.21.15.27:0/2487688677 conn(0x7fc2cc0c2020 msgr2=0x7fc2cc0c23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:47.048 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2d0d40700 1 -- 172.21.15.27:0/2487688677 shutdown_connections 2023-10-06T02:59:47.048 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.039+0000 7fc2d0d40700 1 -- 172.21.15.27:0/2487688677 wait complete. 2023-10-06T02:59:47.048 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2d0d40700 1 Processor -- start 2023-10-06T02:59:47.049 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2d0d40700 1 -- start start 2023-10-06T02:59:47.051 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2d0d40700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2cc06e090 0x7fc2cc14c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.051 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2d0d40700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2cc0a26d0 0x7fc2cc0b9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.051 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2d0d40700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2cc0b6de0 0x7fc2cc14df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.052 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2d0d40700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0badd0 con 0x7fc2cc06e090 2023-10-06T02:59:47.052 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2d0d40700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0bba20 con 0x7fc2cc0b6de0 2023-10-06T02:59:47.052 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2d0d40700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0bbeb0 con 0x7fc2cc0a26d0 2023-10-06T02:59:47.052 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2cb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2cc06e090 0x7fc2cc14c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.052 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2cb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2cc06e090 0x7fc2cc14c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57304/0 (socket says 172.21.15.27:57304) 2023-10-06T02:59:47.052 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2cb7fe700 1 -- 172.21.15.27:0/4281786907 learned_addr learned my addr 172.21.15.27:0/4281786907 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:47.052 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2caffd700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2cc0a26d0 0x7fc2cc0b9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.052 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2cbfff700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2cc0b6de0 0x7fc2cc14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.052 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2cb7fe700 1 -- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2cc0a26d0 msgr2=0x7fc2cc0b9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.052 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2cb7fe700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2cc0a26d0 0x7fc2cc0b9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.052 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2cb7fe700 1 -- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2cc0b6de0 msgr2=0x7fc2cc14df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.053 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.043+0000 7fc2cb7fe700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2cc0b6de0 0x7fc2cc14df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.053 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.047+0000 7fc2cb7fe700 1 -- 172.21.15.27:0/4281786907 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c4009420 con 0x7fc2cc06e090 2023-10-06T02:59:47.053 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.047+0000 7fc2cbfff700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2cc0b6de0 0x7fc2cc14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:47.053 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.047+0000 7fc2cb7fe700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2cc06e090 0x7fc2cc14c560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0097c0 tx=0x7fc2bc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:47.053 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.047+0000 7fc2b37fe700 1 -- 172.21.15.27:0/4281786907 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc012b20 con 0x7fc2cc06e090 2023-10-06T02:59:47.053 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.047+0000 7fc2b37fe700 1 -- 172.21.15.27:0/4281786907 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc021070 con 0x7fc2cc06e090 2023-10-06T02:59:47.053 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.047+0000 7fc2d0d40700 1 -- 172.21.15.27:0/4281786907 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2bc009a20 con 0x7fc2cc06e090 2023-10-06T02:59:47.053 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.047+0000 7fc2b37fe700 1 -- 172.21.15.27:0/4281786907 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc026430 con 0x7fc2cc06e090 2023-10-06T02:59:47.053 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.047+0000 7fc2d0d40700 1 -- 172.21.15.27:0/4281786907 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc14cbf0 con 0x7fc2cc06e090 2023-10-06T02:59:47.054 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.047+0000 7fc2d0d40700 1 -- 172.21.15.27:0/4281786907 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2cc0bfbf0 con 0x7fc2cc06e090 2023-10-06T02:59:47.055 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.051+0000 7fc2b37fe700 1 -- 172.21.15.27:0/4281786907 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc2bc023030 con 0x7fc2cc06e090 2023-10-06T02:59:47.056 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.051+0000 7fc2b37fe700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc2b8060550 0x7fc2b8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.057 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.051+0000 7fc2b37fe700 1 -- 172.21.15.27:0/4281786907 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc2bc07e800 con 0x7fc2cc06e090 2023-10-06T02:59:47.057 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.051+0000 7fc2caffd700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc2b8060550 0x7fc2b8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.057 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.051+0000 7fc2caffd700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc2b8060550 0x7fc2b8062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc14caa0 tx=0x7fc2c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:47.065 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.059+0000 7fc2b37fe700 1 -- 172.21.15.27:0/4281786907 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc2bc04f120 con 0x7fc2cc06e090 2023-10-06T02:59:47.230 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.223+0000 7fc2d0d40700 1 -- 172.21.15.27:0/4281786907 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2cc0b8300 con 0x7fc2cc06e090 2023-10-06T02:59:47.231 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.227+0000 7fc2b37fe700 1 -- 172.21.15.27:0/4281786907 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12127 (secure 0 0 0) 0x7fc2bc052740 con 0x7fc2cc06e090 2023-10-06T02:59:47.232 INFO:teuthology.misc.health.smithi027.stdout: 2023-10-06T02:59:47.232 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":17,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:45.061178+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:47.234 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.227+0000 7fc2d0d40700 1 -- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc2b8060550 msgr2=0x7fc2b8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.234 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.227+0000 7fc2d0d40700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc2b8060550 0x7fc2b8062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc14caa0 tx=0x7fc2c0009040 comp rx=0 tx=0).stop 2023-10-06T02:59:47.234 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.227+0000 7fc2d0d40700 1 -- 172.21.15.27:0/4281786907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2cc06e090 msgr2=0x7fc2cc14c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.234 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.227+0000 7fc2d0d40700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2cc06e090 0x7fc2cc14c560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0097c0 tx=0x7fc2bc019000 comp rx=0 tx=0).stop 2023-10-06T02:59:47.235 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.227+0000 7fc2d0d40700 1 -- 172.21.15.27:0/4281786907 shutdown_connections 2023-10-06T02:59:47.235 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.227+0000 7fc2d0d40700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc2b8060550 0x7fc2b8062a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.235 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.227+0000 7fc2d0d40700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2cc0b6de0 0x7fc2cc14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.235 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.227+0000 7fc2d0d40700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2cc0a26d0 0x7fc2cc0b9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.235 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.227+0000 7fc2d0d40700 1 --2- 172.21.15.27:0/4281786907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2cc06e090 0x7fc2cc14c560 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.235 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.227+0000 7fc2d0d40700 1 -- 172.21.15.27:0/4281786907 >> 172.21.15.27:0/4281786907 conn(0x7fc2cc0c2020 msgr2=0x7fc2cc0bfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:47.235 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.227+0000 7fc2d0d40700 1 -- 172.21.15.27:0/4281786907 shutdown_connections 2023-10-06T02:59:47.235 INFO:teuthology.misc.health.smithi027.stderr:2023-10-06T02:59:47.227+0000 7fc2d0d40700 1 -- 172.21.15.27:0/4281786907 wait complete. 2023-10-06T02:59:47.246 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T02:59:47.246 INFO:tasks.ceph:Creating RBD pool 2023-10-06T02:59:47.246 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T02:59:47.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.343+0000 7f0478fcf700 1 Processor -- start 2023-10-06T02:59:47.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.343+0000 7f0478fcf700 1 -- start start 2023-10-06T02:59:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0478fcf700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f047406d3b0 0x7f047414d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0478fcf700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047414d8b0 con 0x7f047406eae0 2023-10-06T02:59:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0478fcf700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04740b5b60 con 0x7f0474069900 2023-10-06T02:59:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0478fcf700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04740b57f0 con 0x7f047406d3b0 2023-10-06T02:59:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f046bfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f047406eae0 0x7f0474148690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60378/0 (socket says 172.21.15.27:60378) 2023-10-06T02:59:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f046bfff700 1 -- 172.21.15.27:0/665799290 learned_addr learned my addr 172.21.15.27:0/665799290 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0473fff700 1 --2- 172.21.15.27:0/665799290 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f047406d3b0 0x7f047414d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75844428 0 0) 0x7f047414d8b0 con 0x7f047406eae0 2023-10-06T02:59:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0460003570 con 0x7f047406eae0 2023-10-06T02:59:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997865140 0 0) 0x7f04740b5b60 con 0x7f0474069900 2023-10-06T02:59:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f047414d8b0 con 0x7f0474069900 2023-10-06T02:59:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2917536229 0 0) 0x7f0460003570 con 0x7f047406eae0 2023-10-06T02:59:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f047406d3b0 msgr2=0x7f047414d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 --2- 172.21.15.27:0/665799290 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f047406d3b0 0x7f047414d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 >> v1:172.21.15.123:6789/0 conn(0x7f0474069900 legacy=0x7f047414cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047406db30 con 0x7f047406eae0 2023-10-06T02:59:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1323929577 0 0) 0x7f045c001470 con 0x7f047406eae0 2023-10-06T02:59:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 >> v1:172.21.15.27:6789/0 conn(0x7f047406eae0 legacy=0x7f0474148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 --2- 172.21.15.27:0/665799290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0460003c20 0x7f0460004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 --2- 172.21.15.27:0/665799290 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f047406d3b0 0x7f0460004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 --2- 172.21.15.27:0/665799290 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0460004d50 0x7f04600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04740b57f0 con 0x7f0460004d50 2023-10-06T02:59:47.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046000bb40 con 0x7f0460003c20 2023-10-06T02:59:47.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0460010110 con 0x7f047406d3b0 2023-10-06T02:59:47.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0473fff700 1 --2- 172.21.15.27:0/665799290 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0460004d50 0x7f04600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f04737fe700 1 --2- 172.21.15.27:0/665799290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0460003c20 0x7f0460004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f046bfff700 1 --2- 172.21.15.27:0/665799290 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f047406d3b0 0x7f0460004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0473fff700 1 -- 172.21.15.27:0/665799290 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f047406d3b0 msgr2=0x7f0460004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:47.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0473fff700 1 --2- 172.21.15.27:0/665799290 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f047406d3b0 0x7f0460004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0473fff700 1 -- 172.21.15.27:0/665799290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0460003c20 msgr2=0x7f0460004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:47.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0473fff700 1 --2- 172.21.15.27:0/665799290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0460003c20 0x7f0460004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0473fff700 1 -- 172.21.15.27:0/665799290 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0460003570 con 0x7f0460004d50 2023-10-06T02:59:47.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0473fff700 1 --2- 172.21.15.27:0/665799290 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0460004d50 0x7f04600051c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f046c00e210 tx=0x7f046c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a48691ea6b99c93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:47.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c00eac0 con 0x7f0460004d50 2023-10-06T02:59:47.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c00f040 con 0x7f0460004d50 2023-10-06T02:59:47.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.347+0000 7f0472ffd700 1 -- 172.21.15.27:0/665799290 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c00ee70 con 0x7f0460004d50 2023-10-06T02:59:47.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 -- 172.21.15.27:0/665799290 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0460004d50 msgr2=0x7f04600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 --2- 172.21.15.27:0/665799290 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0460004d50 0x7f04600051c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f046c00e210 tx=0x7f046c00b040 comp rx=0 tx=0).stop 2023-10-06T02:59:47.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0473fff700 1 -- 172.21.15.27:0/665799290 reap_dead start 2023-10-06T02:59:47.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 -- 172.21.15.27:0/665799290 shutdown_connections 2023-10-06T02:59:47.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 -- 172.21.15.27:0/665799290 >> 172.21.15.27:0/665799290 conn(0x7f04740bec30 msgr2=0x7f04740bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:47.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 -- 172.21.15.27:0/665799290 shutdown_connections 2023-10-06T02:59:47.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 -- 172.21.15.27:0/665799290 wait complete. 2023-10-06T02:59:47.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 Processor -- start 2023-10-06T02:59:47.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 -- start start 2023-10-06T02:59:47.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04741466e0 0x7f047413f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f047413fce0 0x7f04740b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04740b2f00 0x7f047415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047414b9c0 con 0x7f047413fce0 2023-10-06T02:59:47.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047413fad0 con 0x7f04740b2f00 2023-10-06T02:59:47.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047414b650 con 0x7f04741466e0 2023-10-06T02:59:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f046bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f047413fce0 0x7f04740b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f046bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f047413fce0 0x7f04740b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57314/0 (socket says 172.21.15.27:57314) 2023-10-06T02:59:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f046bfff700 1 -- 172.21.15.27:0/2705072966 learned_addr learned my addr 172.21.15.27:0/2705072966 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f04737fe700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04741466e0 0x7f047413f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0473fff700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04740b2f00 0x7f047415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f046bfff700 1 -- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04741466e0 msgr2=0x7f047413f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f046bfff700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04741466e0 0x7f047413f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f046bfff700 1 -- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04740b2f00 msgr2=0x7f047415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f046bfff700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04740b2f00 0x7f047415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f046bfff700 1 -- 172.21.15.27:0/2705072966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04740b4c30 con 0x7f047413fce0 2023-10-06T02:59:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f046bfff700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f047413fce0 0x7f04740b46f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f045c0015a0 tx=0x7f045c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:47.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f046b7fe700 1 -- 172.21.15.27:0/2705072966 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c018030 con 0x7f047413fce0 2023-10-06T02:59:47.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f046b7fe700 1 -- 172.21.15.27:0/2705072966 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c0077f0 con 0x7f047413fce0 2023-10-06T02:59:47.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f046b7fe700 1 -- 172.21.15.27:0/2705072966 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c00fa70 con 0x7f047413fce0 2023-10-06T02:59:47.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 -- 172.21.15.27:0/2705072966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0474146ab0 con 0x7f047413fce0 2023-10-06T02:59:47.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.351+0000 7f0478fcf700 1 -- 172.21.15.27:0/2705072966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047414c280 con 0x7f047413fce0 2023-10-06T02:59:47.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.355+0000 7f0478fcf700 1 -- 172.21.15.27:0/2705072966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047414c470 con 0x7f047413fce0 2023-10-06T02:59:47.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.355+0000 7f046b7fe700 1 -- 172.21.15.27:0/2705072966 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f045c01b070 con 0x7f047413fce0 2023-10-06T02:59:47.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.355+0000 7f046b7fe700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f0454060580 0x7f0454062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.355+0000 7f046b7fe700 1 -- 172.21.15.27:0/2705072966 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f045c019070 con 0x7f047413fce0 2023-10-06T02:59:47.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.355+0000 7f04737fe700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f0454060580 0x7f0454062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.359+0000 7f04737fe700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f0454060580 0x7f0454062a30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0464007e40 tx=0x7f0464007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:47.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.363+0000 7f046b7fe700 1 -- 172.21.15.27:0/2705072966 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f047414c470 con 0x7f047413fce0 2023-10-06T02:59:47.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:47.523+0000 7f0478fcf700 1 -- 172.21.15.27:0/2705072966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f047414be00 con 0x7f047413fce0 2023-10-06T02:59:48.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.083+0000 7f046b7fe700 1 -- 172.21.15.27:0/2705072966 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f047414be00 con 0x7f047413fce0 2023-10-06T02:59:48.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.091+0000 7f0478fcf700 1 -- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f0454060580 msgr2=0x7f0454062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.091+0000 7f0478fcf700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f0454060580 0x7f0454062a30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0464007e40 tx=0x7f0464007d30 comp rx=0 tx=0).stop 2023-10-06T02:59:48.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.091+0000 7f0478fcf700 1 -- 172.21.15.27:0/2705072966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f047413fce0 msgr2=0x7f04740b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.091+0000 7f0478fcf700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f047413fce0 0x7f04740b46f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f045c0015a0 tx=0x7f045c001e10 comp rx=0 tx=0).stop 2023-10-06T02:59:48.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.091+0000 7f0478fcf700 1 -- 172.21.15.27:0/2705072966 shutdown_connections 2023-10-06T02:59:48.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.091+0000 7f0478fcf700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f0454060580 0x7f0454062a30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.091+0000 7f0478fcf700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04740b2f00 0x7f047415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.091+0000 7f0478fcf700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f047413fce0 0x7f04740b46f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.091+0000 7f0478fcf700 1 --2- 172.21.15.27:0/2705072966 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04741466e0 0x7f047413f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.091+0000 7f0478fcf700 1 -- 172.21.15.27:0/2705072966 >> 172.21.15.27:0/2705072966 conn(0x7f04740bec30 msgr2=0x7f04740bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:48.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.091+0000 7f0478fcf700 1 -- 172.21.15.27:0/2705072966 shutdown_connections 2023-10-06T02:59:48.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.091+0000 7f0478fcf700 1 -- 172.21.15.27:0/2705072966 wait complete. 2023-10-06T02:59:48.097 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'rbd' created 2023-10-06T02:59:48.111 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T02:59:48.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb60c51700 1 Processor -- start 2023-10-06T02:59:48.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb60c51700 1 -- start start 2023-10-06T02:59:48.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb60c51700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ffb5c14c560 0x7ffb5c1475e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb60c51700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5c14b9c0 con 0x7ffb5c06da00 2023-10-06T02:59:48.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb60c51700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5c0b4420 con 0x7ffb5c0bf550 2023-10-06T02:59:48.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb60c51700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5c0b40d0 con 0x7ffb5c14c560 2023-10-06T02:59:48.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb53fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ffb5c14c560 0x7ffb5c1475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb53fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ffb5c14c560 0x7ffb5c1475e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57326/0 (socket says 172.21.15.27:57326) 2023-10-06T02:59:48.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb5bfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ffb5c06da00 0x7ffb5c147b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60392/0 (socket says 172.21.15.27:60392) 2023-10-06T02:59:48.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb53fff700 1 -- 172.21.15.27:0/4214959837 learned_addr learned my addr 172.21.15.27:0/4214959837 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:48.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb53fff700 1 -- 172.21.15.27:0/4214959837 >> v1:172.21.15.123:6789/0 conn(0x7ffb5c0bf550 legacy=0x7ffb5c14be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb53fff700 1 -- 172.21.15.27:0/4214959837 >> v1:172.21.15.27:6789/0 conn(0x7ffb5c06da00 legacy=0x7ffb5c147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb53fff700 1 -- 172.21.15.27:0/4214959837 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c0b4700 con 0x7ffb5c14c560 2023-10-06T02:59:48.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb5affd700 1 -- 172.21.15.27:0/4214959837 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502156663 0 0) 0x7ffb5c14b9c0 con 0x7ffb5c06da00 2023-10-06T02:59:48.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb53fff700 1 --2- 172.21.15.27:0/4214959837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb5c14c560 0x7ffb5c1475e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffb440099b0 tx=0x7ffb44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617fa80381e207c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:48.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb5affd700 1 -- 172.21.15.27:0/4214959837 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4400b860 con 0x7ffb5c14c560 2023-10-06T02:59:48.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb5affd700 1 -- 172.21.15.27:0/4214959837 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4400b9c0 con 0x7ffb5c14c560 2023-10-06T02:59:48.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb5affd700 1 -- 172.21.15.27:0/4214959837 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4400bd60 con 0x7ffb5c14c560 2023-10-06T02:59:48.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb60c51700 1 -- 172.21.15.27:0/4214959837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb5c14c560 msgr2=0x7ffb5c1475e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.219+0000 7ffb60c51700 1 --2- 172.21.15.27:0/4214959837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb5c14c560 0x7ffb5c1475e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffb440099b0 tx=0x7ffb44009250 comp rx=0 tx=0).stop 2023-10-06T02:59:48.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 -- 172.21.15.27:0/4214959837 shutdown_connections 2023-10-06T02:59:48.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 --2- 172.21.15.27:0/4214959837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb5c14c560 0x7ffb5c1475e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 -- 172.21.15.27:0/4214959837 >> 172.21.15.27:0/4214959837 conn(0x7ffb5c067b30 msgr2=0x7ffb5c0bec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:48.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 -- 172.21.15.27:0/4214959837 shutdown_connections 2023-10-06T02:59:48.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 -- 172.21.15.27:0/4214959837 wait complete. 2023-10-06T02:59:48.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 Processor -- start 2023-10-06T02:59:48.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 -- start start 2023-10-06T02:59:48.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ffb5c06da00 0x7ffb5c0bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb5c0bf550 0x7ffb5c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c14c560 0x7ffb5c14e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0bdd90 con 0x7ffb5c0bf550 2023-10-06T02:59:48.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c1446b0 con 0x7ffb5c14c560 2023-10-06T02:59:48.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c144920 con 0x7ffb5c06da00 2023-10-06T02:59:48.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb53fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb5c0bf550 0x7ffb5c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb53fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb5c0bf550 0x7ffb5c15c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57336/0 (socket says 172.21.15.27:57336) 2023-10-06T02:59:48.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb53fff700 1 -- 172.21.15.27:0/3075983474 learned_addr learned my addr 172.21.15.27:0/3075983474 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:48.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb5bfff700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c14c560 0x7ffb5c14e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb5b7fe700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ffb5c06da00 0x7ffb5c0bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb53fff700 1 -- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ffb5c06da00 msgr2=0x7ffb5c0bcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb53fff700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ffb5c06da00 0x7ffb5c0bcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb53fff700 1 -- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c14c560 msgr2=0x7ffb5c14e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb53fff700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c14c560 0x7ffb5c14e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb53fff700 1 -- 172.21.15.27:0/3075983474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb440094f0 con 0x7ffb5c0bf550 2023-10-06T02:59:48.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb53fff700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb5c0bf550 0x7ffb5c15c070 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c068b70 tx=0x7ffb44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:48.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb537fe700 1 -- 172.21.15.27:0/3075983474 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4401f070 con 0x7ffb5c0bf550 2023-10-06T02:59:48.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb537fe700 1 -- 172.21.15.27:0/3075983474 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb44011e30 con 0x7ffb5c0bf550 2023-10-06T02:59:48.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 -- 172.21.15.27:0/3075983474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5c144c30 con 0x7ffb5c0bf550 2023-10-06T02:59:48.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb537fe700 1 -- 172.21.15.27:0/3075983474 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb44025420 con 0x7ffb5c0bf550 2023-10-06T02:59:48.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.223+0000 7ffb60c51700 1 -- 172.21.15.27:0/3075983474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5c0bd5d0 con 0x7ffb5c0bf550 2023-10-06T02:59:48.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.227+0000 7ffb60c51700 1 -- 172.21.15.27:0/3075983474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5c144450 con 0x7ffb5c0bf550 2023-10-06T02:59:48.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.227+0000 7ffb537fe700 1 -- 172.21.15.27:0/3075983474 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ffb44023070 con 0x7ffb5c0bf550 2023-10-06T02:59:48.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.227+0000 7ffb537fe700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ffb3c060550 0x7ffb3c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.227+0000 7ffb537fe700 1 -- 172.21.15.27:0/3075983474 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5195+0+0 (secure 0 0 0) 0x7ffb4407da10 con 0x7ffb5c0bf550 2023-10-06T02:59:48.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.231+0000 7ffb5b7fe700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ffb3c060550 0x7ffb3c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.231+0000 7ffb5b7fe700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ffb3c060550 0x7ffb3c062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0039f0 tx=0x7ffb4c007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:48.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.235+0000 7ffb537fe700 1 -- 172.21.15.27:0/3075983474 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ffb5c144450 con 0x7ffb5c0bf550 2023-10-06T02:59:48.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:48.399+0000 7ffb60c51700 1 -- 172.21.15.27:0/3075983474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffb5c144450 con 0x7ffb5c0bf550 2023-10-06T02:59:49.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.087+0000 7ffb537fe700 1 -- 172.21.15.27:0/3075983474 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7ffb5c144450 con 0x7ffb5c0bf550 2023-10-06T02:59:49.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.091+0000 7ffb60c51700 1 -- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ffb3c060550 msgr2=0x7ffb3c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.091+0000 7ffb60c51700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ffb3c060550 0x7ffb3c062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0039f0 tx=0x7ffb4c007ec0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.095+0000 7ffb60c51700 1 -- 172.21.15.27:0/3075983474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb5c0bf550 msgr2=0x7ffb5c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.095+0000 7ffb60c51700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb5c0bf550 0x7ffb5c15c070 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c068b70 tx=0x7ffb44017000 comp rx=0 tx=0).stop 2023-10-06T02:59:49.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.103+0000 7ffb60c51700 1 -- 172.21.15.27:0/3075983474 shutdown_connections 2023-10-06T02:59:49.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.103+0000 7ffb60c51700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ffb3c060550 0x7ffb3c062a00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.103+0000 7ffb60c51700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c14c560 0x7ffb5c14e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.103+0000 7ffb60c51700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb5c0bf550 0x7ffb5c15c070 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.103+0000 7ffb60c51700 1 --2- 172.21.15.27:0/3075983474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ffb5c06da00 0x7ffb5c0bcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.103+0000 7ffb60c51700 1 -- 172.21.15.27:0/3075983474 >> 172.21.15.27:0/3075983474 conn(0x7ffb5c067b30 msgr2=0x7ffb5c1473b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:49.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.103+0000 7ffb60c51700 1 -- 172.21.15.27:0/3075983474 shutdown_connections 2023-10-06T02:59:49.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.103+0000 7ffb60c51700 1 -- 172.21.15.27:0/3075983474 wait complete. 2023-10-06T02:59:49.110 INFO:teuthology.orchestra.run.smithi027.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T02:59:49.122 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T02:59:49.122 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:59:49.122 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:59:49.124 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:59:49.125 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:59:49.125 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:59:49.127 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:59:49.128 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T02:59:49.128 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:49.202 INFO:tasks.ceph.mds.b.smithi123.stdout:starting mds.b at 2023-10-06T02:59:49.223 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-10-06T02:59:49.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.227+0000 7f7c1b341700 1 Processor -- start 2023-10-06T02:59:49.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.227+0000 7f7c1b341700 1 -- start start 2023-10-06T02:59:49.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.227+0000 7f7c1b341700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7c141457b0 0x7f7c140b9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.227+0000 7f7c1b341700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7c1406b900 0x7f7c140b9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.227+0000 7f7c1b341700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1414bf90 con 0x7f7c1406d3d0 2023-10-06T02:59:49.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1b341700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c140b4900 con 0x7f7c1406b900 2023-10-06T02:59:49.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1b341700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1414c270 con 0x7f7c141457b0 2023-10-06T02:59:49.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1ab40700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7c1406b900 0x7f7c140b9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1ab40700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7c1406b900 0x7f7c140b9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58910/0 (socket says 172.21.15.27:58910) 2023-10-06T02:59:49.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1ab40700 1 -- 172.21.15.27:0/384953414 learned_addr learned my addr 172.21.15.27:0/384953414 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:49.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c19b3e700 1 --2- 172.21.15.27:0/384953414 >> v2:172.21.15.123:3300/0 conn(0x7f7c141457b0 0x7f7c140b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1ab40700 1 -- 172.21.15.27:0/384953414 >> v2:172.21.15.123:3300/0 conn(0x7f7c141457b0 msgr2=0x7f7c140b9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:49.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1ab40700 1 --2- 172.21.15.27:0/384953414 >> v2:172.21.15.123:3300/0 conn(0x7f7c141457b0 0x7f7c140b9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1ab40700 1 -- 172.21.15.27:0/384953414 >> v1:172.21.15.123:6789/0 conn(0x7f7c1406d3d0 legacy=0x7f7c141450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1ab40700 1 -- 172.21.15.27:0/384953414 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c14069970 con 0x7f7c1406b900 2023-10-06T02:59:49.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1ab40700 1 --2- 172.21.15.27:0/384953414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c1406b900 0x7f7c140b9b60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7c14069110 tx=0x7f7c0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9024aab06df407eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:49.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1933d700 1 -- 172.21.15.27:0/384953414 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00e070 con 0x7f7c1406b900 2023-10-06T02:59:49.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1933d700 1 -- 172.21.15.27:0/384953414 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c00ba50 con 0x7f7c1406b900 2023-10-06T02:59:49.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1933d700 1 -- 172.21.15.27:0/384953414 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0092e0 con 0x7f7c1406b900 2023-10-06T02:59:49.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1b341700 1 -- 172.21.15.27:0/384953414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c1406b900 msgr2=0x7f7c140b9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1b341700 1 --2- 172.21.15.27:0/384953414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c1406b900 0x7f7c140b9b60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7c14069110 tx=0x7f7c0c009840 comp rx=0 tx=0).stop 2023-10-06T02:59:49.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1b341700 1 -- 172.21.15.27:0/384953414 shutdown_connections 2023-10-06T02:59:49.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1b341700 1 --2- 172.21.15.27:0/384953414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c1406b900 0x7f7c140b9b60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1b341700 1 --2- 172.21.15.27:0/384953414 >> v2:172.21.15.123:3300/0 conn(0x7f7c141457b0 0x7f7c140b9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1b341700 1 -- 172.21.15.27:0/384953414 >> 172.21.15.27:0/384953414 conn(0x7f7c140bae20 msgr2=0x7f7c140bb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:49.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1b341700 1 -- 172.21.15.27:0/384953414 shutdown_connections 2023-10-06T02:59:49.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1b341700 1 -- 172.21.15.27:0/384953414 wait complete. 2023-10-06T02:59:49.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1b341700 1 Processor -- start 2023-10-06T02:59:49.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.231+0000 7f7c1b341700 1 -- start start 2023-10-06T02:59:49.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1b341700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c1406b900 0x7f7c14146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1b341700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c1406d3d0 0x7f7c14143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1b341700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c141457b0 0x7f7c1415eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1b341700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14147650 con 0x7f7c141457b0 2023-10-06T02:59:49.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1b341700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14144510 con 0x7f7c1406d3d0 2023-10-06T02:59:49.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1b341700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14150980 con 0x7f7c1406b900 2023-10-06T02:59:49.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1ab40700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c141457b0 0x7f7c1415eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1ab40700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c141457b0 0x7f7c1415eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58924/0 (socket says 172.21.15.27:58924) 2023-10-06T02:59:49.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1ab40700 1 -- 172.21.15.27:0/1845751022 learned_addr learned my addr 172.21.15.27:0/1845751022 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:49.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c19b3e700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c1406d3d0 0x7f7c14143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1a33f700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c1406b900 0x7f7c14146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1ab40700 1 -- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c1406b900 msgr2=0x7f7c14146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1ab40700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c1406b900 0x7f7c14146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1ab40700 1 -- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c1406d3d0 msgr2=0x7f7c14143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1ab40700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c1406d3d0 0x7f7c14143fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1ab40700 1 -- 172.21.15.27:0/1845751022 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c009ae0 con 0x7f7c141457b0 2023-10-06T02:59:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1ab40700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c141457b0 0x7f7c1415eab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c012000 tx=0x7f7c0c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c0a7fc700 1 -- 172.21.15.27:0/1845751022 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0094e0 con 0x7f7c141457b0 2023-10-06T02:59:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c0a7fc700 1 -- 172.21.15.27:0/1845751022 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c00be60 con 0x7f7c141457b0 2023-10-06T02:59:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1b341700 1 -- 172.21.15.27:0/1845751022 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c14150c60 con 0x7f7c141457b0 2023-10-06T02:59:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c0a7fc700 1 -- 172.21.15.27:0/1845751022 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c026460 con 0x7f7c141457b0 2023-10-06T02:59:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1b341700 1 -- 172.21.15.27:0/1845751022 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c14147020 con 0x7f7c141457b0 2023-10-06T02:59:49.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c1b341700 1 -- 172.21.15.27:0/1845751022 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c140700e0 con 0x7f7c141457b0 2023-10-06T02:59:49.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.235+0000 7f7c0a7fc700 1 -- 172.21.15.27:0/1845751022 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7c0c003040 con 0x7f7c141457b0 2023-10-06T02:59:49.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.239+0000 7f7c0a7fc700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7bf8060550 0x7f7bf8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.239+0000 7f7c0a7fc700 1 -- 172.21.15.27:0/1845751022 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7c0c07e430 con 0x7f7c141457b0 2023-10-06T02:59:49.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.239+0000 7f7c1a33f700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7bf8060550 0x7f7bf8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.239+0000 7f7c1a33f700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7bf8060550 0x7f7bf8062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7c10003a80 tx=0x7f7c10007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:49.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.243+0000 7f7c0a7fc700 1 -- 172.21.15.27:0/1845751022 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7c0c04ec10 con 0x7f7c141457b0 2023-10-06T02:59:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.403+0000 7f7c1b341700 1 -- 172.21.15.27:0/1845751022 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c1404b600 con 0x7f7c141457b0 2023-10-06T02:59:49.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.407+0000 7f7c0a7fc700 1 -- 172.21.15.27:0/1845751022 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13660 (secure 0 0 0) 0x7f7c0c008f30 con 0x7f7c141457b0 2023-10-06T02:59:49.412 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:49.412 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":19,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:49.083407+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:59:47.570918+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:49.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.411+0000 7f7c1b341700 1 -- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7bf8060550 msgr2=0x7f7bf8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.411+0000 7f7c1b341700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7bf8060550 0x7f7bf8062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7c10003a80 tx=0x7f7c10007ec0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.411+0000 7f7c1b341700 1 -- 172.21.15.27:0/1845751022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c141457b0 msgr2=0x7f7c1415eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.411+0000 7f7c1b341700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c141457b0 0x7f7c1415eab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c012000 tx=0x7f7c0c018000 comp rx=0 tx=0).stop 2023-10-06T02:59:49.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.411+0000 7f7c1b341700 1 -- 172.21.15.27:0/1845751022 shutdown_connections 2023-10-06T02:59:49.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.411+0000 7f7c1b341700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7bf8060550 0x7f7bf8062a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.411+0000 7f7c1b341700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c141457b0 0x7f7c1415eab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.411+0000 7f7c1b341700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c1406d3d0 0x7f7c14143fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.411+0000 7f7c1b341700 1 --2- 172.21.15.27:0/1845751022 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c1406b900 0x7f7c14146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.411+0000 7f7c1b341700 1 -- 172.21.15.27:0/1845751022 >> 172.21.15.27:0/1845751022 conn(0x7f7c140bae20 msgr2=0x7f7c1406c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:49.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.411+0000 7f7c1b341700 1 -- 172.21.15.27:0/1845751022 shutdown_connections 2023-10-06T02:59:49.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.411+0000 7f7c1b341700 1 -- 172.21.15.27:0/1845751022 wait complete. 2023-10-06T02:59:49.431 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:59:43.021608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:59:47.570918+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:59:49.431 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:59:49.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.543+0000 7f30367da700 1 Processor -- start 2023-10-06T02:59:49.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.543+0000 7f30367da700 1 -- start start 2023-10-06T02:59:49.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.543+0000 7f30367da700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f30300b8b10 0x7f30300bcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.543+0000 7f30367da700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f30300bd120 0x7f30300a2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.543+0000 7f30367da700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30300a4450 con 0x7f30300bc810 2023-10-06T02:59:49.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.543+0000 7f30367da700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30300b7b10 con 0x7f30300b8b10 2023-10-06T02:59:49.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.543+0000 7f30367da700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30300b7db0 con 0x7f30300bd120 2023-10-06T02:59:49.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f3034fd7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f30300b8b10 0x7f30300bcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f30357d8700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f30300bc810 0x7f303006cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52138/0 (socket says 172.21.15.27:52138) 2023-10-06T02:59:49.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f30357d8700 1 -- 172.21.15.27:0/3666605072 learned_addr learned my addr 172.21.15.27:0/3666605072 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:49.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f3035fd9700 1 --2- 172.21.15.27:0/3666605072 >> v2:172.21.15.123:3300/0 conn(0x7f30300bd120 0x7f30300a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f3034fd7700 1 -- 172.21.15.27:0/3666605072 >> v2:172.21.15.123:3300/0 conn(0x7f30300bd120 msgr2=0x7f30300a2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:49.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f3034fd7700 1 --2- 172.21.15.27:0/3666605072 >> v2:172.21.15.123:3300/0 conn(0x7f30300bd120 0x7f30300a2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f3034fd7700 1 -- 172.21.15.27:0/3666605072 >> v1:172.21.15.27:6789/0 conn(0x7f30300bc810 legacy=0x7f303006cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f3023fff700 1 -- 172.21.15.27:0/3666605072 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606927234 0 0) 0x7f30300a4450 con 0x7f30300bc810 2023-10-06T02:59:49.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f3034fd7700 1 -- 172.21.15.27:0/3666605072 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30300b8090 con 0x7f30300b8b10 2023-10-06T02:59:49.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f3034fd7700 1 --2- 172.21.15.27:0/3666605072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30300b8b10 0x7f30300bcbe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f30240098e0 tx=0x7f30240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5d7b4d1d20bae4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:49.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f3023fff700 1 -- 172.21.15.27:0/3666605072 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024011630 con 0x7f30300b8b10 2023-10-06T02:59:49.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f3023fff700 1 -- 172.21.15.27:0/3666605072 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3024011790 con 0x7f30300b8b10 2023-10-06T02:59:49.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f3023fff700 1 -- 172.21.15.27:0/3666605072 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024011b30 con 0x7f30300b8b10 2023-10-06T02:59:49.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f30367da700 1 -- 172.21.15.27:0/3666605072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30300b8b10 msgr2=0x7f30300bcbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f30367da700 1 --2- 172.21.15.27:0/3666605072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30300b8b10 0x7f30300bcbe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f30240098e0 tx=0x7f30240091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f30367da700 1 -- 172.21.15.27:0/3666605072 shutdown_connections 2023-10-06T02:59:49.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f30367da700 1 --2- 172.21.15.27:0/3666605072 >> v2:172.21.15.123:3300/0 conn(0x7f30300bd120 0x7f30300a2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f30367da700 1 --2- 172.21.15.27:0/3666605072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30300b8b10 0x7f30300bcbe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f30367da700 1 -- 172.21.15.27:0/3666605072 >> 172.21.15.27:0/3666605072 conn(0x7f30300bea10 msgr2=0x7f30300bee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:49.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f30367da700 1 -- 172.21.15.27:0/3666605072 shutdown_connections 2023-10-06T02:59:49.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.547+0000 7f30367da700 1 -- 172.21.15.27:0/3666605072 wait complete. 2023-10-06T02:59:49.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30367da700 1 Processor -- start 2023-10-06T02:59:49.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30367da700 1 -- start start 2023-10-06T02:59:49.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30367da700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30300b8b10 0x7f303014d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30367da700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30300bc810 0x7f303014a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30367da700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f30300bd120 0x7f30300a6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30367da700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303014a300 con 0x7f30300b8b10 2023-10-06T02:59:49.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30367da700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3030149730 con 0x7f30300bc810 2023-10-06T02:59:49.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30367da700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30300a7e00 con 0x7f30300bd120 2023-10-06T02:59:49.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30357d8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30300b8b10 0x7f303014d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30357d8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30300b8b10 0x7f303014d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58938/0 (socket says 172.21.15.27:58938) 2023-10-06T02:59:49.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30357d8700 1 -- 172.21.15.27:0/3748777234 learned_addr learned my addr 172.21.15.27:0/3748777234 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:49.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f3034fd7700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30300bc810 0x7f303014a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f3035fd9700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f30300bd120 0x7f30300a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30357d8700 1 -- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f30300bd120 msgr2=0x7f30300a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30357d8700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f30300bd120 0x7f30300a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30357d8700 1 -- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30300bc810 msgr2=0x7f303014a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30357d8700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30300bc810 0x7f303014a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30357d8700 1 -- 172.21.15.27:0/3748777234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3024009420 con 0x7f30300b8b10 2023-10-06T02:59:49.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30357d8700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30300b8b10 0x7f303014d660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f302c00c7e0 tx=0x7f302c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:49.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30217fa700 1 -- 172.21.15.27:0/3748777234 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c005b30 con 0x7f30300b8b10 2023-10-06T02:59:49.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30217fa700 1 -- 172.21.15.27:0/3748777234 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c005c90 con 0x7f30300b8b10 2023-10-06T02:59:49.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30367da700 1 -- 172.21.15.27:0/3748777234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3030149fd0 con 0x7f30300b8b10 2023-10-06T02:59:49.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30217fa700 1 -- 172.21.15.27:0/3748777234 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c007300 con 0x7f30300b8b10 2023-10-06T02:59:49.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.551+0000 7f30367da700 1 -- 172.21.15.27:0/3748777234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30300a6000 con 0x7f30300b8b10 2023-10-06T02:59:49.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.555+0000 7f30367da700 1 -- 172.21.15.27:0/3748777234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30300876c0 con 0x7f30300b8b10 2023-10-06T02:59:49.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.555+0000 7f30217fa700 1 -- 172.21.15.27:0/3748777234 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f302c01b3b0 con 0x7f30300b8b10 2023-10-06T02:59:49.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.555+0000 7f30217fa700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3014060550 0x7f3014062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.555+0000 7f30217fa700 1 -- 172.21.15.27:0/3748777234 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f302c07bad0 con 0x7f30300b8b10 2023-10-06T02:59:49.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.559+0000 7f3034fd7700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3014060550 0x7f3014062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.559+0000 7f3034fd7700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3014060550 0x7f3014062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f302400a010 tx=0x7f3024017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:49.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.567+0000 7f30217fa700 1 -- 172.21.15.27:0/3748777234 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f302c04c2b0 con 0x7f30300b8b10 2023-10-06T02:59:49.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.723+0000 7f30367da700 1 -- 172.21.15.27:0/3748777234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30300a29a0 con 0x7f30300b8b10 2023-10-06T02:59:49.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.723+0000 7f30217fa700 1 -- 172.21.15.27:0/3748777234 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f302c0170a0 con 0x7f30300b8b10 2023-10-06T02:59:49.730 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-10-06T02:59:49.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.727+0000 7f30367da700 1 -- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3014060550 msgr2=0x7f3014062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.727+0000 7f30367da700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3014060550 0x7f3014062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f302400a010 tx=0x7f3024017000 comp rx=0 tx=0).stop 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.727+0000 7f30367da700 1 -- 172.21.15.27:0/3748777234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30300b8b10 msgr2=0x7f303014d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.727+0000 7f30367da700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30300b8b10 0x7f303014d660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f302c00c7e0 tx=0x7f302c007df0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.727+0000 7f30367da700 1 -- 172.21.15.27:0/3748777234 shutdown_connections 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.727+0000 7f30367da700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3014060550 0x7f3014062a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.727+0000 7f30367da700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f30300bd120 0x7f30300a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.727+0000 7f30367da700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30300bc810 0x7f303014a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.727+0000 7f30367da700 1 --2- 172.21.15.27:0/3748777234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30300b8b10 0x7f303014d660 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.727+0000 7f30367da700 1 -- 172.21.15.27:0/3748777234 >> 172.21.15.27:0/3748777234 conn(0x7f30300bea10 msgr2=0x7f3030151180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:49.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.727+0000 7f30367da700 1 -- 172.21.15.27:0/3748777234 shutdown_connections 2023-10-06T02:59:49.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.727+0000 7f30367da700 1 -- 172.21.15.27:0/3748777234 wait complete. 2023-10-06T02:59:49.744 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:59:49.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.847+0000 7fa444b05700 1 Processor -- start 2023-10-06T02:59:49.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.847+0000 7fa444b05700 1 -- start start 2023-10-06T02:59:49.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa444b05700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4400bc590 0x7fa4400b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa444b05700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4400a43c0 0x7fa44014adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa444b05700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4400a17e0 con 0x7fa4400b7e20 2023-10-06T02:59:49.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa444b05700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44014c870 con 0x7fa4400bc590 2023-10-06T02:59:49.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa444b05700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4400bd590 con 0x7fa4400a43c0 2023-10-06T02:59:49.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa43f7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa4400b7e20 0x7fa4400a3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52154/0 (socket says 172.21.15.27:52154) 2023-10-06T02:59:49.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa43f7fe700 1 -- 172.21.15.27:0/920381517 learned_addr learned my addr 172.21.15.27:0/920381517 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:49.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa437fff700 1 --2- 172.21.15.27:0/920381517 >> v2:172.21.15.123:3300/0 conn(0x7fa4400bc590 0x7fa4400b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa43ffff700 1 --2- 172.21.15.27:0/920381517 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4400a43c0 0x7fa44014adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa43effd700 1 -- 172.21.15.27:0/920381517 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516486370 0 0) 0x7fa4400a17e0 con 0x7fa4400b7e20 2023-10-06T02:59:49.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa43effd700 1 -- 172.21.15.27:0/920381517 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa42c003570 con 0x7fa4400b7e20 2023-10-06T02:59:49.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa437fff700 1 -- 172.21.15.27:0/920381517 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4400a43c0 msgr2=0x7fa44014adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:49.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa437fff700 1 --2- 172.21.15.27:0/920381517 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4400a43c0 0x7fa44014adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa437fff700 1 -- 172.21.15.27:0/920381517 >> v1:172.21.15.27:6789/0 conn(0x7fa4400b7e20 legacy=0x7fa4400a3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa437fff700 1 -- 172.21.15.27:0/920381517 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44014bd90 con 0x7fa4400bc590 2023-10-06T02:59:49.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa43ffff700 1 --2- 172.21.15.27:0/920381517 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4400a43c0 0x7fa44014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:49.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa437fff700 1 --2- 172.21.15.27:0/920381517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400bc590 0x7fa4400b81f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4280098e0 tx=0x7fa4280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d488c425ebeb8f7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:49.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa43effd700 1 -- 172.21.15.27:0/920381517 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa428011630 con 0x7fa4400bc590 2023-10-06T02:59:49.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa43effd700 1 -- 172.21.15.27:0/920381517 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa428011790 con 0x7fa4400bc590 2023-10-06T02:59:49.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa43effd700 1 -- 172.21.15.27:0/920381517 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa428011b30 con 0x7fa4400bc590 2023-10-06T02:59:49.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa444b05700 1 -- 172.21.15.27:0/920381517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400bc590 msgr2=0x7fa4400b81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa444b05700 1 --2- 172.21.15.27:0/920381517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400bc590 0x7fa4400b81f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4280098e0 tx=0x7fa4280091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa444b05700 1 -- 172.21.15.27:0/920381517 shutdown_connections 2023-10-06T02:59:49.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa444b05700 1 --2- 172.21.15.27:0/920381517 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4400a43c0 0x7fa44014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa444b05700 1 --2- 172.21.15.27:0/920381517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400bc590 0x7fa4400b81f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa444b05700 1 -- 172.21.15.27:0/920381517 >> 172.21.15.27:0/920381517 conn(0x7fa4400be9c0 msgr2=0x7fa4400bedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:49.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa444b05700 1 -- 172.21.15.27:0/920381517 shutdown_connections 2023-10-06T02:59:49.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.851+0000 7fa444b05700 1 -- 172.21.15.27:0/920381517 wait complete. 2023-10-06T02:59:49.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa444b05700 1 Processor -- start 2023-10-06T02:59:49.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa444b05700 1 -- start start 2023-10-06T02:59:49.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa444b05700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4400a43c0 0x7fa44014d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa444b05700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4400b7e20 0x7fa44014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa444b05700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400bc590 0x7fa44014e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa444b05700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44015c140 con 0x7fa4400a43c0 2023-10-06T02:59:49.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa444b05700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44014d7f0 con 0x7fa4400bc590 2023-10-06T02:59:49.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa444b05700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44014ee00 con 0x7fa4400b7e20 2023-10-06T02:59:49.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa43f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4400a43c0 0x7fa44014d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa43f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4400a43c0 0x7fa44014d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58948/0 (socket says 172.21.15.27:58948) 2023-10-06T02:59:49.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa43f7fe700 1 -- 172.21.15.27:0/2446166914 learned_addr learned my addr 172.21.15.27:0/2446166914 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:49.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa43ffff700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400bc590 0x7fa44014e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa437fff700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4400b7e20 0x7fa44014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa43f7fe700 1 -- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4400b7e20 msgr2=0x7fa44014e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa43f7fe700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4400b7e20 0x7fa44014e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa43f7fe700 1 -- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400bc590 msgr2=0x7fa44014e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa43f7fe700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400bc590 0x7fa44014e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa43f7fe700 1 -- 172.21.15.27:0/2446166914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa438009a20 con 0x7fa4400a43c0 2023-10-06T02:59:49.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa43f7fe700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4400a43c0 0x7fa44014d2b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa4300011e0 tx=0x7fa430007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:49.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa4377fe700 1 -- 172.21.15.27:0/2446166914 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430005b30 con 0x7fa4400a43c0 2023-10-06T02:59:49.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa4377fe700 1 -- 172.21.15.27:0/2446166914 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa430005c90 con 0x7fa4400a43c0 2023-10-06T02:59:49.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa444b05700 1 -- 172.21.15.27:0/2446166914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa428009420 con 0x7fa4400a43c0 2023-10-06T02:59:49.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa4377fe700 1 -- 172.21.15.27:0/2446166914 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430007320 con 0x7fa4400a43c0 2023-10-06T02:59:49.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.855+0000 7fa444b05700 1 -- 172.21.15.27:0/2446166914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44014f810 con 0x7fa4400a43c0 2023-10-06T02:59:49.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.859+0000 7fa4377fe700 1 -- 172.21.15.27:0/2446166914 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa430007690 con 0x7fa4400a43c0 2023-10-06T02:59:49.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.859+0000 7fa444b05700 1 -- 172.21.15.27:0/2446166914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa440087c00 con 0x7fa4400a43c0 2023-10-06T02:59:49.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.859+0000 7fa4377fe700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fa420060550 0x7fa420062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.859+0000 7fa4377fe700 1 -- 172.21.15.27:0/2446166914 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa43007b970 con 0x7fa4400a43c0 2023-10-06T02:59:49.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.859+0000 7fa437fff700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fa420060550 0x7fa420062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.859+0000 7fa437fff700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fa420060550 0x7fa420062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa4280098e0 tx=0x7fa428017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:49.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:49.863+0000 7fa4377fe700 1 -- 172.21.15.27:0/2446166914 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa43004c210 con 0x7fa4400a43c0 2023-10-06T02:59:50.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.027+0000 7fa444b05700 1 -- 172.21.15.27:0/2446166914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa4400be7a0 con 0x7fa4400a43c0 2023-10-06T02:59:50.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.027+0000 7fa4377fe700 1 -- 172.21.15.27:0/2446166914 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa4300170a0 con 0x7fa4400a43c0 2023-10-06T02:59:50.033 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-10-06T02:59:50.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.031+0000 7fa444b05700 1 -- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fa420060550 msgr2=0x7fa420062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.031+0000 7fa444b05700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fa420060550 0x7fa420062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa4280098e0 tx=0x7fa428017000 comp rx=0 tx=0).stop 2023-10-06T02:59:50.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.031+0000 7fa444b05700 1 -- 172.21.15.27:0/2446166914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4400a43c0 msgr2=0x7fa44014d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.031+0000 7fa444b05700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4400a43c0 0x7fa44014d2b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa4300011e0 tx=0x7fa430007df0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.031+0000 7fa444b05700 1 -- 172.21.15.27:0/2446166914 shutdown_connections 2023-10-06T02:59:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.031+0000 7fa444b05700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fa420060550 0x7fa420062a00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.031+0000 7fa444b05700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400bc590 0x7fa44014e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.031+0000 7fa444b05700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4400b7e20 0x7fa44014e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.031+0000 7fa444b05700 1 --2- 172.21.15.27:0/2446166914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4400a43c0 0x7fa44014d2b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.031+0000 7fa444b05700 1 -- 172.21.15.27:0/2446166914 >> 172.21.15.27:0/2446166914 conn(0x7fa4400be9c0 msgr2=0x7fa44006b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.031+0000 7fa444b05700 1 -- 172.21.15.27:0/2446166914 shutdown_connections 2023-10-06T02:59:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.031+0000 7fa444b05700 1 -- 172.21.15.27:0/2446166914 wait complete. 2023-10-06T02:59:50.053 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:59:50.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.155+0000 7fab48e78700 1 Processor -- start 2023-10-06T02:59:50.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.155+0000 7fab48e78700 1 -- start start 2023-10-06T02:59:50.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.155+0000 7fab48e78700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab440b4ae0 0x7fab441491a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.155+0000 7fab48e78700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4414ccf0 con 0x7fab4406c470 2023-10-06T02:59:50.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.155+0000 7fab48e78700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4406b900 con 0x7fab4406c0a0 2023-10-06T02:59:50.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.155+0000 7fab48e78700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4406bba0 con 0x7fab440b4ae0 2023-10-06T02:59:50.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.155+0000 7fab42ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fab4406c470 0x7fab44067a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52156/0 (socket says 172.21.15.27:52156) 2023-10-06T02:59:50.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.155+0000 7fab42ffd700 1 -- 172.21.15.27:0/1332160772 learned_addr learned my addr 172.21.15.27:0/1332160772 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:50.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.155+0000 7fab43fff700 1 --2- 172.21.15.27:0/1332160772 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab440b4ae0 0x7fab441491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.155+0000 7fab427fc700 1 -- 172.21.15.27:0/1332160772 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989257493 0 0) 0x7fab4406b900 con 0x7fab4406c0a0 2023-10-06T02:59:50.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.155+0000 7fab427fc700 1 -- 172.21.15.27:0/1332160772 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab2c003570 con 0x7fab4406c0a0 2023-10-06T02:59:50.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.155+0000 7fab427fc700 1 -- 172.21.15.27:0/1332160772 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16752090 0 0) 0x7fab4414ccf0 con 0x7fab4406c470 2023-10-06T02:59:50.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.155+0000 7fab427fc700 1 -- 172.21.15.27:0/1332160772 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab4406b900 con 0x7fab4406c470 2023-10-06T02:59:50.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab43fff700 1 -- 172.21.15.27:0/1332160772 >> v1:172.21.15.123:6789/0 conn(0x7fab4406c0a0 legacy=0x7fab4414d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab427fc700 1 -- 172.21.15.27:0/1332160772 <== mon.1 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2578131343 0 0) 0x7fab2c003570 con 0x7fab4406c0a0 2023-10-06T02:59:50.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab43fff700 1 -- 172.21.15.27:0/1332160772 >> v1:172.21.15.27:6789/0 conn(0x7fab4406c470 legacy=0x7fab44067a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab43fff700 1 -- 172.21.15.27:0/1332160772 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4414c980 con 0x7fab440b4ae0 2023-10-06T02:59:50.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab43fff700 1 --2- 172.21.15.27:0/1332160772 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab440b4ae0 0x7fab441491a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009e90 tx=0x7fab3c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=375443bb1d05011b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab427fc700 1 -- 172.21.15.27:0/1332160772 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c00e070 con 0x7fab440b4ae0 2023-10-06T02:59:50.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab427fc700 1 -- 172.21.15.27:0/1332160772 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c00b870 con 0x7fab440b4ae0 2023-10-06T02:59:50.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab427fc700 1 -- 172.21.15.27:0/1332160772 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab380013f0 con 0x7fab440b4ae0 2023-10-06T02:59:50.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab48e78700 1 -- 172.21.15.27:0/1332160772 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab440b4ae0 msgr2=0x7fab441491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab48e78700 1 --2- 172.21.15.27:0/1332160772 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab440b4ae0 0x7fab441491a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009e90 tx=0x7fab3c009780 comp rx=0 tx=0).stop 2023-10-06T02:59:50.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab48e78700 1 -- 172.21.15.27:0/1332160772 shutdown_connections 2023-10-06T02:59:50.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab48e78700 1 --2- 172.21.15.27:0/1332160772 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab440b4ae0 0x7fab441491a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab48e78700 1 -- 172.21.15.27:0/1332160772 >> 172.21.15.27:0/1332160772 conn(0x7fab440bfd40 msgr2=0x7fab440c0140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:50.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab48e78700 1 -- 172.21.15.27:0/1332160772 shutdown_connections 2023-10-06T02:59:50.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab48e78700 1 -- 172.21.15.27:0/1332160772 wait complete. 2023-10-06T02:59:50.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab48e78700 1 Processor -- start 2023-10-06T02:59:50.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.159+0000 7fab48e78700 1 -- start start 2023-10-06T02:59:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab48e78700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab4406c0a0 0x7fab440a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab48e78700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab4406c470 0x7fab440a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab48e78700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab440b4ae0 0x7fab440a4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab48e78700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4415bc40 con 0x7fab4406c470 2023-10-06T02:59:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab48e78700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4415bea0 con 0x7fab440b4ae0 2023-10-06T02:59:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab48e78700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4415c180 con 0x7fab4406c0a0 2023-10-06T02:59:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab42ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab4406c470 0x7fab440a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab42ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab4406c470 0x7fab440a4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58960/0 (socket says 172.21.15.27:58960) 2023-10-06T02:59:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab42ffd700 1 -- 172.21.15.27:0/1620352429 learned_addr learned my addr 172.21.15.27:0/1620352429 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:50.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab43fff700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab440b4ae0 0x7fab440a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab437fe700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab4406c0a0 0x7fab440a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab42ffd700 1 -- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab4406c0a0 msgr2=0x7fab440a32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab42ffd700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab4406c0a0 0x7fab440a32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab42ffd700 1 -- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab440b4ae0 msgr2=0x7fab440a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab42ffd700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab440b4ae0 0x7fab440a4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab42ffd700 1 -- 172.21.15.27:0/1620352429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c009a20 con 0x7fab4406c470 2023-10-06T02:59:50.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab437fe700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab4406c0a0 0x7fab440a32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:50.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab42ffd700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab4406c470 0x7fab440a4960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fab3800cb60 tx=0x7fab38001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab2b7fe700 1 -- 172.21.15.27:0/1620352429 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38007360 con 0x7fab4406c470 2023-10-06T02:59:50.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab2b7fe700 1 -- 172.21.15.27:0/1620352429 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab380074e0 con 0x7fab4406c470 2023-10-06T02:59:50.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab48e78700 1 -- 172.21.15.27:0/1620352429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab440a4590 con 0x7fab4406c470 2023-10-06T02:59:50.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab2b7fe700 1 -- 172.21.15.27:0/1620352429 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38004830 con 0x7fab4406c470 2023-10-06T02:59:50.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.163+0000 7fab48e78700 1 -- 172.21.15.27:0/1620352429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab440a52e0 con 0x7fab4406c470 2023-10-06T02:59:50.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.167+0000 7fab48e78700 1 -- 172.21.15.27:0/1620352429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab44069c80 con 0x7fab4406c470 2023-10-06T02:59:50.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.167+0000 7fab2b7fe700 1 -- 172.21.15.27:0/1620352429 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fab38004ba0 con 0x7fab4406c470 2023-10-06T02:59:50.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.167+0000 7fab2b7fe700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fab30060550 0x7fab30062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.167+0000 7fab2b7fe700 1 -- 172.21.15.27:0/1620352429 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fab3807bd60 con 0x7fab4406c470 2023-10-06T02:59:50.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.167+0000 7fab437fe700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fab30060550 0x7fab30062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.167+0000 7fab437fe700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fab30060550 0x7fab30062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fab34001380 tx=0x7fab340019a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.175+0000 7fab2b7fe700 1 -- 172.21.15.27:0/1620352429 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fab3804abe0 con 0x7fab4406c470 2023-10-06T02:59:50.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.371+0000 7fab48e78700 1 -- 172.21.15.27:0/1620352429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab440b6860 con 0x7fab4406c470 2023-10-06T02:59:50.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.371+0000 7fab2b7fe700 1 -- 172.21.15.27:0/1620352429 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2015 (secure 0 0 0) 0x7fab38018020 con 0x7fab4406c470 2023-10-06T02:59:50.377 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:50.377 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3318688789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3318688789},{"type":"v1","addr":"172.21.15.123:6835","nonce":3318688789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3144883581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3144883581},{"type":"v1","addr":"172.21.15.27:6833","nonce":3144883581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T02:59:50.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.375+0000 7fab48e78700 1 -- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fab30060550 msgr2=0x7fab30062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.375+0000 7fab48e78700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fab30060550 0x7fab30062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fab34001380 tx=0x7fab340019a0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.375+0000 7fab48e78700 1 -- 172.21.15.27:0/1620352429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab4406c470 msgr2=0x7fab440a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.375+0000 7fab48e78700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab4406c470 0x7fab440a4960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fab3800cb60 tx=0x7fab38001b30 comp rx=0 tx=0).stop 2023-10-06T02:59:50.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.375+0000 7fab48e78700 1 -- 172.21.15.27:0/1620352429 shutdown_connections 2023-10-06T02:59:50.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.375+0000 7fab48e78700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fab30060550 0x7fab30062a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.375+0000 7fab48e78700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab440b4ae0 0x7fab440a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.375+0000 7fab48e78700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab4406c470 0x7fab440a4960 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.375+0000 7fab48e78700 1 --2- 172.21.15.27:0/1620352429 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab4406c0a0 0x7fab440a32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.375+0000 7fab48e78700 1 -- 172.21.15.27:0/1620352429 >> 172.21.15.27:0/1620352429 conn(0x7fab440bfd40 msgr2=0x7fab440b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:50.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.375+0000 7fab48e78700 1 -- 172.21.15.27:0/1620352429 shutdown_connections 2023-10-06T02:59:50.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.375+0000 7fab48e78700 1 -- 172.21.15.27:0/1620352429 wait complete. 2023-10-06T02:59:50.381 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 3 2023-10-06T02:59:50.391 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:50.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b32d3700 1 Processor -- start 2023-10-06T02:59:50.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b32d3700 1 -- start start 2023-10-06T02:59:50.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b32d3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa2ac06a200 0x7fa2ac06c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b32d3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2ac0b87c0 0x7fa2ac14b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b32d3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac06b190 con 0x7fa2ac0b7540 2023-10-06T02:59:50.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b32d3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac06a6b0 con 0x7fa2ac06a200 2023-10-06T02:59:50.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b32d3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac06a990 con 0x7fa2ac0b87c0 2023-10-06T02:59:50.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b106f700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa2ac0b7540 0x7fa2ac06bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52160/0 (socket says 172.21.15.27:52160) 2023-10-06T02:59:50.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b106f700 1 -- 172.21.15.27:0/1433172099 learned_addr learned my addr 172.21.15.27:0/1433172099 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:50.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b086e700 1 --2- 172.21.15.27:0/1433172099 >> v2:172.21.15.123:3300/0 conn(0x7fa2ac06a200 0x7fa2ac06c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b1870700 1 --2- 172.21.15.27:0/1433172099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2ac0b87c0 0x7fa2ac14b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037099909 0 0) 0x7fa2ac06b190 con 0x7fa2ac0b7540 2023-10-06T02:59:50.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa298003570 con 0x7fa2ac0b7540 2023-10-06T02:59:50.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1746456785 0 0) 0x7fa298003570 con 0x7fa2ac0b7540 2023-10-06T02:59:50.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2ac0b87c0 msgr2=0x7fa2ac14b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:50.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 --2- 172.21.15.27:0/1433172099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2ac0b87c0 0x7fa2ac14b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 >> v2:172.21.15.123:3300/0 conn(0x7fa2ac06a200 msgr2=0x7fa2ac06c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:50.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 --2- 172.21.15.27:0/1433172099 >> v2:172.21.15.123:3300/0 conn(0x7fa2ac06a200 0x7fa2ac06c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac06ac70 con 0x7fa2ac0b7540 2023-10-06T02:59:50.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1323929577 0 0) 0x7fa2a80017f0 con 0x7fa2ac0b7540 2023-10-06T02:59:50.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 >> v1:172.21.15.27:6789/0 conn(0x7fa2ac0b7540 legacy=0x7fa2ac06bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 --2- 172.21.15.27:0/1433172099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa298003a60 0x7fa298003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 --2- 172.21.15.27:0/1433172099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa298004810 0x7fa298004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 --2- 172.21.15.27:0/1433172099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2980051c0 0x7fa29800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac06a6b0 con 0x7fa298003a60 2023-10-06T02:59:50.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac06a990 con 0x7fa2980051c0 2023-10-06T02:59:50.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29800bfa0 con 0x7fa298004810 2023-10-06T02:59:50.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b106f700 1 --2- 172.21.15.27:0/1433172099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa298003a60 0x7fa298003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b086e700 1 --2- 172.21.15.27:0/1433172099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa298004810 0x7fa298004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b1870700 1 --2- 172.21.15.27:0/1433172099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2980051c0 0x7fa29800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b106f700 1 -- 172.21.15.27:0/1433172099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa298004810 msgr2=0x7fa298004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:50.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b106f700 1 --2- 172.21.15.27:0/1433172099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa298004810 0x7fa298004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b106f700 1 -- 172.21.15.27:0/1433172099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2980051c0 msgr2=0x7fa29800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:50.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b106f700 1 --2- 172.21.15.27:0/1433172099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2980051c0 0x7fa29800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b106f700 1 -- 172.21.15.27:0/1433172099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298003570 con 0x7fa298003a60 2023-10-06T02:59:50.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2b106f700 1 --2- 172.21.15.27:0/1433172099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa298003a60 0x7fa298003e70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800a9a0 tx=0x7fa2a8002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd304bf486d77523 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80070d0 con 0x7fa298003a60 2023-10-06T02:59:50.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a8007230 con 0x7fa298003a60 2023-10-06T02:59:50.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.491+0000 7fa2a3fff700 1 -- 172.21.15.27:0/1433172099 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80075f0 con 0x7fa298003a60 2023-10-06T02:59:50.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.495+0000 7fa2b32d3700 1 -- 172.21.15.27:0/1433172099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa298003a60 msgr2=0x7fa298003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.495+0000 7fa2b32d3700 1 --2- 172.21.15.27:0/1433172099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa298003a60 0x7fa298003e70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800a9a0 tx=0x7fa2a8002210 comp rx=0 tx=0).stop 2023-10-06T02:59:50.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.495+0000 7fa2b1870700 1 -- 172.21.15.27:0/1433172099 reap_dead start 2023-10-06T02:59:50.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.495+0000 7fa2b32d3700 1 -- 172.21.15.27:0/1433172099 shutdown_connections 2023-10-06T02:59:50.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.495+0000 7fa2b32d3700 1 -- 172.21.15.27:0/1433172099 >> 172.21.15.27:0/1433172099 conn(0x7fa2ac0bde40 msgr2=0x7fa2ac0be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:50.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.495+0000 7fa2b32d3700 1 -- 172.21.15.27:0/1433172099 shutdown_connections 2023-10-06T02:59:50.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.495+0000 7fa2b32d3700 1 -- 172.21.15.27:0/1433172099 wait complete. 2023-10-06T02:59:50.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.495+0000 7fa2b32d3700 1 Processor -- start 2023-10-06T02:59:50.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.495+0000 7fa2b32d3700 1 -- start start 2023-10-06T02:59:50.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b32d3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa298003a60 0x7fa2ac117550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b32d3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2ac119840 0x7fa2ac0bbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b32d3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2ac0bbfe0 0x7fa2ac15e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b32d3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac118d00 con 0x7fa298003a60 2023-10-06T02:59:50.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b32d3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac119260 con 0x7fa2ac119840 2023-10-06T02:59:50.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b32d3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac15f1a0 con 0x7fa2ac0bbfe0 2023-10-06T02:59:50.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b106f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa298003a60 0x7fa2ac117550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b106f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa298003a60 0x7fa2ac117550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58968/0 (socket says 172.21.15.27:58968) 2023-10-06T02:59:50.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b106f700 1 -- 172.21.15.27:0/722821110 learned_addr learned my addr 172.21.15.27:0/722821110 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:50.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b086e700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2ac119840 0x7fa2ac0bbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b1870700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2ac0bbfe0 0x7fa2ac15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b106f700 1 -- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2ac0bbfe0 msgr2=0x7fa2ac15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b106f700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2ac0bbfe0 0x7fa2ac15e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b106f700 1 -- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2ac119840 msgr2=0x7fa2ac0bbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b106f700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2ac119840 0x7fa2ac0bbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b106f700 1 -- 172.21.15.27:0/722821110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac118ef0 con 0x7fa298003a60 2023-10-06T02:59:50.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b106f700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa298003a60 0x7fa2ac117550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa298004750 tx=0x7fa2a8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2a17fa700 1 -- 172.21.15.27:0/722821110 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8001f30 con 0x7fa298003a60 2023-10-06T02:59:50.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2a17fa700 1 -- 172.21.15.27:0/722821110 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a8027420 con 0x7fa298003a60 2023-10-06T02:59:50.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2a17fa700 1 -- 172.21.15.27:0/722821110 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80275d0 con 0x7fa298003a60 2023-10-06T02:59:50.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b32d3700 1 -- 172.21.15.27:0/722821110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac117a90 con 0x7fa298003a60 2023-10-06T02:59:50.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.499+0000 7fa2b32d3700 1 -- 172.21.15.27:0/722821110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac15e9c0 con 0x7fa298003a60 2023-10-06T02:59:50.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.503+0000 7fa2b32d3700 1 -- 172.21.15.27:0/722821110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac04be40 con 0x7fa298003a60 2023-10-06T02:59:50.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.503+0000 7fa2a17fa700 1 -- 172.21.15.27:0/722821110 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa2a8024020 con 0x7fa298003a60 2023-10-06T02:59:50.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.503+0000 7fa2a17fa700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fa290060550 0x7fa290062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.503+0000 7fa2a17fa700 1 -- 172.21.15.27:0/722821110 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa2a807e2a0 con 0x7fa298003a60 2023-10-06T02:59:50.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.503+0000 7fa2b086e700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fa290060550 0x7fa290062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.503+0000 7fa2b086e700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fa290060550 0x7fa290062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac119c50 tx=0x7fa29c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.511+0000 7fa2a17fa700 1 -- 172.21.15.27:0/722821110 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa2a804ea80 con 0x7fa298003a60 2023-10-06T02:59:50.618 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:50.620 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:50.622 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:50.624 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:50.627 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:50.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.671+0000 7fa2b32d3700 1 -- 172.21.15.27:0/722821110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2ac0b7910 con 0x7fa298003a60 2023-10-06T02:59:50.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.671+0000 7fa2a17fa700 1 -- 172.21.15.27:0/722821110 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13647 (secure 0 0 0) 0x7fa2a80520a0 con 0x7fa298003a60 2023-10-06T02:59:50.678 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:50.678 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:50.098834+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:59:47.570918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:50.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.675+0000 7fa2b32d3700 1 -- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fa290060550 msgr2=0x7fa290062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.675+0000 7fa2b32d3700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fa290060550 0x7fa290062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac119c50 tx=0x7fa29c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.675+0000 7fa2b32d3700 1 -- 172.21.15.27:0/722821110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa298003a60 msgr2=0x7fa2ac117550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.675+0000 7fa2b32d3700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa298003a60 0x7fa2ac117550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa298004750 tx=0x7fa2a8015000 comp rx=0 tx=0).stop 2023-10-06T02:59:50.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.675+0000 7fa2b32d3700 1 -- 172.21.15.27:0/722821110 shutdown_connections 2023-10-06T02:59:50.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.675+0000 7fa2b32d3700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fa290060550 0x7fa290062a00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.675+0000 7fa2b32d3700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2ac0bbfe0 0x7fa2ac15e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.675+0000 7fa2b32d3700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2ac119840 0x7fa2ac0bbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.675+0000 7fa2b32d3700 1 --2- 172.21.15.27:0/722821110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa298003a60 0x7fa2ac117550 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.675+0000 7fa2b32d3700 1 -- 172.21.15.27:0/722821110 >> 172.21.15.27:0/722821110 conn(0x7fa2ac0bde40 msgr2=0x7fa2ac147ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:50.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.675+0000 7fa2b32d3700 1 -- 172.21.15.27:0/722821110 shutdown_connections 2023-10-06T02:59:50.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.675+0000 7fa2b32d3700 1 -- 172.21.15.27:0/722821110 wait complete. 2023-10-06T02:59:50.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:59:43.021608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:59:47.570918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:59:50.692 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:59:50.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.799+0000 7f23dd9f1700 1 Processor -- start 2023-10-06T02:59:50.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.799+0000 7f23dd9f1700 1 -- start start 2023-10-06T02:59:50.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f23d80a2ea0 0x7f23d80ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23d80a3270 0x7f23d80a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f23d806c190 0x7f23d80b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d814c0a0 con 0x7f23d80a2ea0 2023-10-06T02:59:50.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d80a3680 con 0x7f23d806c190 2023-10-06T02:59:50.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d814bb70 con 0x7f23d80a3270 2023-10-06T02:59:50.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dc9ef700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f23d80a2ea0 0x7f23d80ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dc9ef700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f23d80a2ea0 0x7f23d80ba020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58972/0 (socket says 172.21.15.27:58972) 2023-10-06T02:59:50.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dc9ef700 1 -- 172.21.15.27:0/3685213232 learned_addr learned my addr 172.21.15.27:0/3685213232 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:50.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd1f0700 1 --2- 172.21.15.27:0/3685213232 >> v2:172.21.15.123:3300/0 conn(0x7f23d806c190 0x7f23d80b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23d7fff700 1 --2- 172.21.15.27:0/3685213232 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23d80a3270 0x7f23d80a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dc9ef700 1 -- 172.21.15.27:0/3685213232 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23d80a3270 msgr2=0x7f23d80a01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:50.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dc9ef700 1 --2- 172.21.15.27:0/3685213232 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23d80a3270 0x7f23d80a01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dc9ef700 1 -- 172.21.15.27:0/3685213232 >> v2:172.21.15.123:3300/0 conn(0x7f23d806c190 msgr2=0x7f23d80b80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:50.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dc9ef700 1 --2- 172.21.15.27:0/3685213232 >> v2:172.21.15.123:3300/0 conn(0x7f23d806c190 0x7f23d80b80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dc9ef700 1 -- 172.21.15.27:0/3685213232 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d80b9590 con 0x7f23d80a2ea0 2023-10-06T02:59:50.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dc9ef700 1 --2- 172.21.15.27:0/3685213232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d80a2ea0 0x7f23d80ba020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f23d80a3bd0 tx=0x7f23cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4aa7af4d65b10a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23d77fe700 1 -- 172.21.15.27:0/3685213232 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00b640 con 0x7f23d80a2ea0 2023-10-06T02:59:50.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23d77fe700 1 -- 172.21.15.27:0/3685213232 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc00b7a0 con 0x7f23d80a2ea0 2023-10-06T02:59:50.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23d77fe700 1 -- 172.21.15.27:0/3685213232 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00bb40 con 0x7f23d80a2ea0 2023-10-06T02:59:50.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 -- 172.21.15.27:0/3685213232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d80a2ea0 msgr2=0x7f23d80ba020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 --2- 172.21.15.27:0/3685213232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d80a2ea0 0x7f23d80ba020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f23d80a3bd0 tx=0x7f23cc009250 comp rx=0 tx=0).stop 2023-10-06T02:59:50.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 -- 172.21.15.27:0/3685213232 shutdown_connections 2023-10-06T02:59:50.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 --2- 172.21.15.27:0/3685213232 >> v2:172.21.15.123:3300/0 conn(0x7f23d806c190 0x7f23d80b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 --2- 172.21.15.27:0/3685213232 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23d80a3270 0x7f23d80a01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 --2- 172.21.15.27:0/3685213232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d80a2ea0 0x7f23d80ba020 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 -- 172.21.15.27:0/3685213232 >> 172.21.15.27:0/3685213232 conn(0x7f23d80bafb0 msgr2=0x7f23d806e060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:50.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 -- 172.21.15.27:0/3685213232 shutdown_connections 2023-10-06T02:59:50.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.803+0000 7f23dd9f1700 1 -- 172.21.15.27:0/3685213232 wait complete. 2023-10-06T02:59:50.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23dd9f1700 1 Processor -- start 2023-10-06T02:59:50.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23dd9f1700 1 -- start start 2023-10-06T02:59:50.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23dd9f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23d806c190 0x7f23d80a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23dd9f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d80a2ea0 0x7f23d815f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23dd9f1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23d80a3270 0x7f23d8150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23dd9f1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d814b670 con 0x7f23d80a2ea0 2023-10-06T02:59:50.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23dd9f1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d8068d80 con 0x7f23d806c190 2023-10-06T02:59:50.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23dd9f1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80a27f0 con 0x7f23d80a3270 2023-10-06T02:59:50.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23d7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d80a2ea0 0x7f23d815f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23d7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d80a2ea0 0x7f23d815f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58980/0 (socket says 172.21.15.27:58980) 2023-10-06T02:59:50.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23d7fff700 1 -- 172.21.15.27:0/2579634677 learned_addr learned my addr 172.21.15.27:0/2579634677 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:50.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23dd1f0700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23d80a3270 0x7f23d8150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23dc9ef700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23d806c190 0x7f23d80a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23d7fff700 1 -- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23d80a3270 msgr2=0x7f23d8150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23d7fff700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23d80a3270 0x7f23d8150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23d7fff700 1 -- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23d806c190 msgr2=0x7f23d80a22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23d7fff700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23d806c190 0x7f23d80a22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23d7fff700 1 -- 172.21.15.27:0/2579634677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc0094f0 con 0x7f23d80a2ea0 2023-10-06T02:59:50.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.807+0000 7f23d7fff700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d80a2ea0 0x7f23d815f660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23c800ecb0 tx=0x7f23c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.811+0000 7f23d4ff9700 1 -- 172.21.15.27:0/2579634677 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c800c920 con 0x7f23d80a2ea0 2023-10-06T02:59:50.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.811+0000 7f23d4ff9700 1 -- 172.21.15.27:0/2579634677 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c800caa0 con 0x7f23d80a2ea0 2023-10-06T02:59:50.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.811+0000 7f23dd9f1700 1 -- 172.21.15.27:0/2579634677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d8068450 con 0x7f23d80a2ea0 2023-10-06T02:59:50.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.811+0000 7f23d4ff9700 1 -- 172.21.15.27:0/2579634677 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c800ce60 con 0x7f23d80a2ea0 2023-10-06T02:59:50.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.811+0000 7f23dd9f1700 1 -- 172.21.15.27:0/2579634677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d815fba0 con 0x7f23d80a2ea0 2023-10-06T02:59:50.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.811+0000 7f23dd9f1700 1 -- 172.21.15.27:0/2579634677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d8067a70 con 0x7f23d80a2ea0 2023-10-06T02:59:50.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.811+0000 7f23d4ff9700 1 -- 172.21.15.27:0/2579634677 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f23c8013680 con 0x7f23d80a2ea0 2023-10-06T02:59:50.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.811+0000 7f23d4ff9700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f23c4060550 0x7f23c4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.811+0000 7f23d4ff9700 1 -- 172.21.15.27:0/2579634677 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f23c807c870 con 0x7f23d80a2ea0 2023-10-06T02:59:50.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.811+0000 7f23dc9ef700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f23c4060550 0x7f23c4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.815+0000 7f23dc9ef700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f23c4060550 0x7f23c4062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f23d80a3bd0 tx=0x7f23cc017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.823+0000 7f23d4ff9700 1 -- 172.21.15.27:0/2579634677 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f23c804d050 con 0x7f23d80a2ea0 2023-10-06T02:59:50.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23dd9f1700 1 -- 172.21.15.27:0/2579634677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23d8068640 con 0x7f23d80a2ea0 2023-10-06T02:59:50.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23d4ff9700 1 -- 172.21.15.27:0/2579634677 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23c8050670 con 0x7f23d80a2ea0 2023-10-06T02:59:50.988 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-10-06T02:59:50.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23dd9f1700 1 -- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f23c4060550 msgr2=0x7f23c4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23dd9f1700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f23c4060550 0x7f23c4062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f23d80a3bd0 tx=0x7f23cc017000 comp rx=0 tx=0).stop 2023-10-06T02:59:50.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23dd9f1700 1 -- 172.21.15.27:0/2579634677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d80a2ea0 msgr2=0x7f23d815f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23dd9f1700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d80a2ea0 0x7f23d815f660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23c800ecb0 tx=0x7f23c80091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23dd9f1700 1 -- 172.21.15.27:0/2579634677 shutdown_connections 2023-10-06T02:59:50.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23dd9f1700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f23c4060550 0x7f23c4062a00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23dd9f1700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23d80a3270 0x7f23d8150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23dd9f1700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d80a2ea0 0x7f23d815f660 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23dd9f1700 1 --2- 172.21.15.27:0/2579634677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23d806c190 0x7f23d80a22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23dd9f1700 1 -- 172.21.15.27:0/2579634677 >> 172.21.15.27:0/2579634677 conn(0x7f23d80bafb0 msgr2=0x7f23d806e060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:50.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23dd9f1700 1 -- 172.21.15.27:0/2579634677 shutdown_connections 2023-10-06T02:59:50.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:50.983+0000 7f23dd9f1700 1 -- 172.21.15.27:0/2579634677 wait complete. 2023-10-06T02:59:51.002 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:59:51.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.107+0000 7fca7f59e700 1 Processor -- start 2023-10-06T02:59:51.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.107+0000 7fca7f59e700 1 -- start start 2023-10-06T02:59:51.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7f59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80068e80 0x7fca8014d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7f59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fca80148370 0x7fca80148810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7f59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8006ad30 con 0x7fca8006d3d0 2023-10-06T02:59:51.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7f59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca80149420 con 0x7fca80148370 2023-10-06T02:59:51.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7f59e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8006aff0 con 0x7fca80068e80 2023-10-06T02:59:51.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7e59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fca8006d3d0 0x7fca8014ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52168/0 (socket says 172.21.15.27:52168) 2023-10-06T02:59:51.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7e59c700 1 -- 172.21.15.27:0/4123829754 learned_addr learned my addr 172.21.15.27:0/4123829754 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:51.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7ed9d700 1 --2- 172.21.15.27:0/4123829754 >> v2:172.21.15.27:3300/0 conn(0x7fca80148370 0x7fca80148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7dd9b700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80068e80 0x7fca8014d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654505315 0 0) 0x7fca8006ad30 con 0x7fca8006d3d0 2023-10-06T02:59:51.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca68003570 con 0x7fca8006d3d0 2023-10-06T02:59:51.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1076429042 0 0) 0x7fca68003570 con 0x7fca8006d3d0 2023-10-06T02:59:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80068e80 msgr2=0x7fca8014d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80068e80 0x7fca8014d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 >> v2:172.21.15.27:3300/0 conn(0x7fca80148370 msgr2=0x7fca80148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 --2- 172.21.15.27:0/4123829754 >> v2:172.21.15.27:3300/0 conn(0x7fca80148370 0x7fca80148810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800bbbe0 con 0x7fca8006d3d0 2023-10-06T02:59:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1323929577 0 0) 0x7fca70001470 con 0x7fca8006d3d0 2023-10-06T02:59:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7dd9b700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80068e80 0x7fca8014d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 >> v1:172.21.15.27:6789/0 conn(0x7fca8006d3d0 legacy=0x7fca8014ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca68003a60 0x7fca68003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca68004810 0x7fca68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80068e80 0x7fca680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8006aff0 con 0x7fca68004810 2023-10-06T02:59:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6800ba60 con 0x7fca68003a60 2023-10-06T02:59:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6800bbd0 con 0x7fca80068e80 2023-10-06T02:59:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7dd9b700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca68004810 0x7fca68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7ed9d700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80068e80 0x7fca680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7e59c700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca68003a60 0x7fca68003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7dd9b700 1 -- 172.21.15.27:0/4123829754 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80068e80 msgr2=0x7fca680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7dd9b700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80068e80 0x7fca680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7dd9b700 1 -- 172.21.15.27:0/4123829754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca68003a60 msgr2=0x7fca68003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7dd9b700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca68003a60 0x7fca68003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7dd9b700 1 -- 172.21.15.27:0/4123829754 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68003570 con 0x7fca68004810 2023-10-06T02:59:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7e59c700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca68003a60 0x7fca68003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7dd9b700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca68004810 0x7fca68004c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca80069290 tx=0x7fca74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a22eadecc491275 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7400c070 con 0x7fca68004810 2023-10-06T02:59:51.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7400e5e0 con 0x7fca68004810 2023-10-06T02:59:51.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.111+0000 7fca7d59a700 1 -- 172.21.15.27:0/4123829754 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74009510 con 0x7fca68004810 2023-10-06T02:59:51.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 -- 172.21.15.27:0/4123829754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca68004810 msgr2=0x7fca68004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 --2- 172.21.15.27:0/4123829754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca68004810 0x7fca68004c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca80069290 tx=0x7fca74008040 comp rx=0 tx=0).stop 2023-10-06T02:59:51.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7ed9d700 1 -- 172.21.15.27:0/4123829754 reap_dead start 2023-10-06T02:59:51.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 -- 172.21.15.27:0/4123829754 shutdown_connections 2023-10-06T02:59:51.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 -- 172.21.15.27:0/4123829754 >> 172.21.15.27:0/4123829754 conn(0x7fca800beed0 msgr2=0x7fca800bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:51.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 -- 172.21.15.27:0/4123829754 shutdown_connections 2023-10-06T02:59:51.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 -- 172.21.15.27:0/4123829754 wait complete. 2023-10-06T02:59:51.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 Processor -- start 2023-10-06T02:59:51.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 -- start start 2023-10-06T02:59:51.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca80147570 0x7fca80159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca800b6970 0x7fca80141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80141d90 0x7fca8014a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8014d520 con 0x7fca80147570 2023-10-06T02:59:51.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8015abb0 con 0x7fca80141d90 2023-10-06T02:59:51.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7f59e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca800b6da0 con 0x7fca800b6970 2023-10-06T02:59:51.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca80147570 0x7fca80159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca80147570 0x7fca80159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59008/0 (socket says 172.21.15.27:59008) 2023-10-06T02:59:51.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7e59c700 1 -- 172.21.15.27:0/1464194404 learned_addr learned my addr 172.21.15.27:0/1464194404 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:51.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7dd9b700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca800b6970 0x7fca80141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7ed9d700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80141d90 0x7fca8014a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7e59c700 1 -- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca800b6970 msgr2=0x7fca80141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7e59c700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca800b6970 0x7fca80141850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7e59c700 1 -- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80141d90 msgr2=0x7fca8014a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7e59c700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80141d90 0x7fca8014a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.115+0000 7fca7e59c700 1 -- 172.21.15.27:0/1464194404 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca80142200 con 0x7fca80147570 2023-10-06T02:59:51.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.119+0000 7fca7e59c700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca80147570 0x7fca80159f60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fca7000ebc0 tx=0x7fca8006be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:51.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.119+0000 7fca6e7fc700 1 -- 172.21.15.27:0/1464194404 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70005e80 con 0x7fca80147570 2023-10-06T02:59:51.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.119+0000 7fca7f59e700 1 -- 172.21.15.27:0/1464194404 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8015a560 con 0x7fca80147570 2023-10-06T02:59:51.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.119+0000 7fca6e7fc700 1 -- 172.21.15.27:0/1464194404 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca70000bc0 con 0x7fca80147570 2023-10-06T02:59:51.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.119+0000 7fca6e7fc700 1 -- 172.21.15.27:0/1464194404 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7000c9b0 con 0x7fca80147570 2023-10-06T02:59:51.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.119+0000 7fca7f59e700 1 -- 172.21.15.27:0/1464194404 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca80147940 con 0x7fca80147570 2023-10-06T02:59:51.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.119+0000 7fca6e7fc700 1 -- 172.21.15.27:0/1464194404 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fca7000cd20 con 0x7fca80147570 2023-10-06T02:59:51.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.119+0000 7fca7f59e700 1 -- 172.21.15.27:0/1464194404 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca80147b30 con 0x7fca80147570 2023-10-06T02:59:51.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.119+0000 7fca6e7fc700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fca60060580 0x7fca60062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.119+0000 7fca6e7fc700 1 -- 172.21.15.27:0/1464194404 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fca7007c450 con 0x7fca80147570 2023-10-06T02:59:51.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.119+0000 7fca7dd9b700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fca60060580 0x7fca60062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.123+0000 7fca7dd9b700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fca60060580 0x7fca60062a30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca740030c0 tx=0x7fca7401a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:51.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.131+0000 7fca6e7fc700 1 -- 172.21.15.27:0/1464194404 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fca80147b30 con 0x7fca80147570 2023-10-06T02:59:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca7f59e700 1 -- 172.21.15.27:0/1464194404 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fca80147b30 con 0x7fca80147570 2023-10-06T02:59:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca6e7fc700 1 -- 172.21.15.27:0/1464194404 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fca80147b30 con 0x7fca80147570 2023-10-06T02:59:51.300 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-10-06T02:59:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca7f59e700 1 -- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fca60060580 msgr2=0x7fca60062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca7f59e700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fca60060580 0x7fca60062a30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca740030c0 tx=0x7fca7401a000 comp rx=0 tx=0).stop 2023-10-06T02:59:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca7f59e700 1 -- 172.21.15.27:0/1464194404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca80147570 msgr2=0x7fca80159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca7f59e700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca80147570 0x7fca80159f60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fca7000ebc0 tx=0x7fca8006be30 comp rx=0 tx=0).stop 2023-10-06T02:59:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca7f59e700 1 -- 172.21.15.27:0/1464194404 shutdown_connections 2023-10-06T02:59:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca7f59e700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fca60060580 0x7fca60062a30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca7f59e700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80141d90 0x7fca8014a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca7f59e700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca800b6970 0x7fca80141850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca7f59e700 1 --2- 172.21.15.27:0/1464194404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca80147570 0x7fca80159f60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca7f59e700 1 -- 172.21.15.27:0/1464194404 >> 172.21.15.27:0/1464194404 conn(0x7fca800beed0 msgr2=0x7fca800bc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:51.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca7f59e700 1 -- 172.21.15.27:0/1464194404 shutdown_connections 2023-10-06T02:59:51.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.295+0000 7fca7f59e700 1 -- 172.21.15.27:0/1464194404 wait complete. 2023-10-06T02:59:51.314 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:59:51.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb474ae700 1 Processor -- start 2023-10-06T02:59:51.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb474ae700 1 -- start start 2023-10-06T02:59:51.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb474ae700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb40147bb0 0x7fcb40148de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb474ae700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb400b9ac0 0x7fcb4006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb474ae700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb400a03e0 con 0x7fcb4006ce50 2023-10-06T02:59:51.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb474ae700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4006b1d0 con 0x7fcb40147bb0 2023-10-06T02:59:51.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb474ae700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4009ce50 con 0x7fcb400b9ac0 2023-10-06T02:59:51.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb46cad700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fcb4006ce50 0x7fcb400a3140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52170/0 (socket says 172.21.15.27:52170) 2023-10-06T02:59:51.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb46cad700 1 -- 172.21.15.27:0/1439929181 learned_addr learned my addr 172.21.15.27:0/1439929181 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:51.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb45cab700 1 --2- 172.21.15.27:0/1439929181 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb400b9ac0 0x7fcb4006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb464ac700 1 --2- 172.21.15.27:0/1439929181 >> v2:172.21.15.123:3300/0 conn(0x7fcb40147bb0 0x7fcb40148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb454aa700 1 -- 172.21.15.27:0/1439929181 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180903471 0 0) 0x7fcb400a03e0 con 0x7fcb4006ce50 2023-10-06T02:59:51.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb454aa700 1 -- 172.21.15.27:0/1439929181 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb2c003570 con 0x7fcb4006ce50 2023-10-06T02:59:51.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb454aa700 1 -- 172.21.15.27:0/1439929181 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1866640421 0 0) 0x7fcb2c003570 con 0x7fcb4006ce50 2023-10-06T02:59:51.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb45cab700 1 -- 172.21.15.27:0/1439929181 >> v2:172.21.15.123:3300/0 conn(0x7fcb40147bb0 msgr2=0x7fcb40148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:51.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb45cab700 1 --2- 172.21.15.27:0/1439929181 >> v2:172.21.15.123:3300/0 conn(0x7fcb40147bb0 0x7fcb40148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb45cab700 1 -- 172.21.15.27:0/1439929181 >> v1:172.21.15.27:6789/0 conn(0x7fcb4006ce50 legacy=0x7fcb400a3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb45cab700 1 -- 172.21.15.27:0/1439929181 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4009d130 con 0x7fcb400b9ac0 2023-10-06T02:59:51.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb464ac700 1 --2- 172.21.15.27:0/1439929181 >> v2:172.21.15.123:3300/0 conn(0x7fcb40147bb0 0x7fcb40148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:51.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.411+0000 7fcb45cab700 1 --2- 172.21.15.27:0/1439929181 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb400b9ac0 0x7fcb4006c910 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009e60 tx=0x7fcb3c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1504baf9ff0c517a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:51.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.415+0000 7fcb454aa700 1 -- 172.21.15.27:0/1439929181 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00e070 con 0x7fcb400b9ac0 2023-10-06T02:59:51.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.415+0000 7fcb454aa700 1 -- 172.21.15.27:0/1439929181 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c00b7a0 con 0x7fcb400b9ac0 2023-10-06T02:59:51.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.415+0000 7fcb454aa700 1 -- 172.21.15.27:0/1439929181 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38001470 con 0x7fcb400b9ac0 2023-10-06T02:59:51.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.415+0000 7fcb474ae700 1 -- 172.21.15.27:0/1439929181 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb400b9ac0 msgr2=0x7fcb4006c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.415+0000 7fcb474ae700 1 --2- 172.21.15.27:0/1439929181 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb400b9ac0 0x7fcb4006c910 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009e60 tx=0x7fcb3c009780 comp rx=0 tx=0).stop 2023-10-06T02:59:51.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.415+0000 7fcb474ae700 1 -- 172.21.15.27:0/1439929181 shutdown_connections 2023-10-06T02:59:51.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.415+0000 7fcb474ae700 1 --2- 172.21.15.27:0/1439929181 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb400b9ac0 0x7fcb4006c910 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.415+0000 7fcb474ae700 1 --2- 172.21.15.27:0/1439929181 >> v2:172.21.15.123:3300/0 conn(0x7fcb40147bb0 0x7fcb40148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.415+0000 7fcb474ae700 1 -- 172.21.15.27:0/1439929181 >> 172.21.15.27:0/1439929181 conn(0x7fcb4006eb10 msgr2=0x7fcb400ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:51.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.415+0000 7fcb474ae700 1 -- 172.21.15.27:0/1439929181 shutdown_connections 2023-10-06T02:59:51.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.415+0000 7fcb474ae700 1 -- 172.21.15.27:0/1439929181 wait complete. 2023-10-06T02:59:51.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.415+0000 7fcb474ae700 1 Processor -- start 2023-10-06T02:59:51.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.415+0000 7fcb474ae700 1 -- start start 2023-10-06T02:59:51.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb474ae700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4006ce50 0x7fcb40144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb474ae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb400b9ac0 0x7fcb400b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb474ae700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb40147bb0 0x7fcb400b9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb474ae700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb400b70a0 con 0x7fcb4006ce50 2023-10-06T02:59:51.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb474ae700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb40144100 con 0x7fcb400b9ac0 2023-10-06T02:59:51.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb474ae700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb40144400 con 0x7fcb40147bb0 2023-10-06T02:59:51.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb464ac700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4006ce50 0x7fcb40144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb45cab700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb400b9ac0 0x7fcb400b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb464ac700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4006ce50 0x7fcb40144cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59022/0 (socket says 172.21.15.27:59022) 2023-10-06T02:59:51.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb464ac700 1 -- 172.21.15.27:0/2654987032 learned_addr learned my addr 172.21.15.27:0/2654987032 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:51.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb46cad700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb40147bb0 0x7fcb400b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb464ac700 1 -- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb40147bb0 msgr2=0x7fcb400b9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb464ac700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb40147bb0 0x7fcb400b9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb464ac700 1 -- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb400b9ac0 msgr2=0x7fcb400b8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb464ac700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb400b9ac0 0x7fcb400b8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb464ac700 1 -- 172.21.15.27:0/2654987032 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb30009420 con 0x7fcb4006ce50 2023-10-06T02:59:51.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb45cab700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb400b9ac0 0x7fcb400b8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:51.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb464ac700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4006ce50 0x7fcb40144cc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000ec80 tx=0x7fcb300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:51.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb367fc700 1 -- 172.21.15.27:0/2654987032 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000c850 con 0x7fcb4006ce50 2023-10-06T02:59:51.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb367fc700 1 -- 172.21.15.27:0/2654987032 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3000c9b0 con 0x7fcb4006ce50 2023-10-06T02:59:51.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb474ae700 1 -- 172.21.15.27:0/2654987032 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c009a20 con 0x7fcb4006ce50 2023-10-06T02:59:51.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb367fc700 1 -- 172.21.15.27:0/2654987032 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000cd30 con 0x7fcb4006ce50 2023-10-06T02:59:51.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.419+0000 7fcb474ae700 1 -- 172.21.15.27:0/2654987032 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb400b7530 con 0x7fcb4006ce50 2023-10-06T02:59:51.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.423+0000 7fcb367fc700 1 -- 172.21.15.27:0/2654987032 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcb30013680 con 0x7fcb4006ce50 2023-10-06T02:59:51.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.423+0000 7fcb367fc700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fcb24060550 0x7fcb24062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.423+0000 7fcb474ae700 1 -- 172.21.15.27:0/2654987032 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb400674b0 con 0x7fcb4006ce50 2023-10-06T02:59:51.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.423+0000 7fcb367fc700 1 -- 172.21.15.27:0/2654987032 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fcb3007cce0 con 0x7fcb4006ce50 2023-10-06T02:59:51.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.423+0000 7fcb45cab700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fcb24060550 0x7fcb24062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.423+0000 7fcb45cab700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fcb24060550 0x7fcb24062a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0099f0 tx=0x7fcb3c018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:51.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.431+0000 7fcb367fc700 1 -- 172.21.15.27:0/2654987032 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcb30017080 con 0x7fcb4006ce50 2023-10-06T02:59:51.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.591+0000 7fcb474ae700 1 -- 172.21.15.27:0/2654987032 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcb4004b600 con 0x7fcb4006ce50 2023-10-06T02:59:51.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.595+0000 7fcb367fc700 1 -- 172.21.15.27:0/2654987032 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7fcb30021090 con 0x7fcb4006ce50 2023-10-06T02:59:51.599 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:51.599 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-10-06T02:59:51.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-10-06T02:59:51.599 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2023-10-06T02:59:51.599 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": ".mgr" 2023-10-06T02:59:51.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-06T02:59:51.599 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-10-06T02:59:51.600 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 2, 2023-10-06T02:59:51.600 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "rbd" 2023-10-06T02:59:51.600 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-10-06T02:59:51.600 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-10-06T02:59:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.595+0000 7fcb474ae700 1 -- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fcb24060550 msgr2=0x7fcb24062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.595+0000 7fcb474ae700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fcb24060550 0x7fcb24062a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0099f0 tx=0x7fcb3c018000 comp rx=0 tx=0).stop 2023-10-06T02:59:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.595+0000 7fcb474ae700 1 -- 172.21.15.27:0/2654987032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4006ce50 msgr2=0x7fcb40144cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.595+0000 7fcb474ae700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4006ce50 0x7fcb40144cc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000ec80 tx=0x7fcb300091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.595+0000 7fcb474ae700 1 -- 172.21.15.27:0/2654987032 shutdown_connections 2023-10-06T02:59:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.595+0000 7fcb474ae700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fcb24060550 0x7fcb24062a00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.595+0000 7fcb474ae700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb40147bb0 0x7fcb400b9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.595+0000 7fcb474ae700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb400b9ac0 0x7fcb400b8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.595+0000 7fcb474ae700 1 --2- 172.21.15.27:0/2654987032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4006ce50 0x7fcb40144cc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.595+0000 7fcb474ae700 1 -- 172.21.15.27:0/2654987032 >> 172.21.15.27:0/2654987032 conn(0x7fcb4006eb10 msgr2=0x7fcb400bb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.595+0000 7fcb474ae700 1 -- 172.21.15.27:0/2654987032 shutdown_connections 2023-10-06T02:59:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.595+0000 7fcb474ae700 1 -- 172.21.15.27:0/2654987032 wait complete. 2023-10-06T02:59:51.613 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:59:51.613 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:59:51.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.723+0000 7f990bfff700 1 Processor -- start 2023-10-06T02:59:51.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.723+0000 7f990bfff700 1 -- start start 2023-10-06T02:59:51.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.723+0000 7f990bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f990c1430b0 0x7f990c149f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.723+0000 7f990bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f990c06ea20 0x7f990c143480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.723+0000 7f990bfff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c149ab0 con 0x7f990c06c810 2023-10-06T02:59:51.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.723+0000 7f990bfff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c1494a0 con 0x7f990c1430b0 2023-10-06T02:59:51.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.723+0000 7f990bfff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c149740 con 0x7f990c06ea20 2023-10-06T02:59:51.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f990c1430b0 0x7f990c149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f990c06c810 0x7f990c0bf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52184/0 (socket says 172.21.15.27:52184) 2023-10-06T02:59:51.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990b7fe700 1 -- 172.21.15.27:0/1675107596 learned_addr learned my addr 172.21.15.27:0/1675107596 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:51.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f9903fff700 1 --2- 172.21.15.27:0/1675107596 >> v2:172.21.15.123:3300/0 conn(0x7f990c06ea20 0x7f990c143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990a7fc700 1 -- 172.21.15.27:0/1675107596 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088670199 0 0) 0x7f990c149ab0 con 0x7f990c06c810 2023-10-06T02:59:51.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990a7fc700 1 -- 172.21.15.27:0/1675107596 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98ec003570 con 0x7f990c06c810 2023-10-06T02:59:51.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990affd700 1 -- 172.21.15.27:0/1675107596 >> v2:172.21.15.123:3300/0 conn(0x7f990c06ea20 msgr2=0x7f990c143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:51.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990affd700 1 --2- 172.21.15.27:0/1675107596 >> v2:172.21.15.123:3300/0 conn(0x7f990c06ea20 0x7f990c143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990affd700 1 -- 172.21.15.27:0/1675107596 >> v1:172.21.15.27:6789/0 conn(0x7f990c06c810 legacy=0x7f990c0bf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990affd700 1 -- 172.21.15.27:0/1675107596 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c0bfa30 con 0x7f990c1430b0 2023-10-06T02:59:51.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990affd700 1 --2- 172.21.15.27:0/1675107596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c1430b0 0x7f990c149f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f990c0702c0 tx=0x7f98fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4a6a0877c87162 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:51.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990a7fc700 1 -- 172.21.15.27:0/1675107596 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc011630 con 0x7f990c1430b0 2023-10-06T02:59:51.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990a7fc700 1 -- 172.21.15.27:0/1675107596 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc0117b0 con 0x7f990c1430b0 2023-10-06T02:59:51.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990a7fc700 1 -- 172.21.15.27:0/1675107596 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc011b70 con 0x7f990c1430b0 2023-10-06T02:59:51.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990bfff700 1 -- 172.21.15.27:0/1675107596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c1430b0 msgr2=0x7f990c149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990bfff700 1 --2- 172.21.15.27:0/1675107596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c1430b0 0x7f990c149f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f990c0702c0 tx=0x7f98fc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990bfff700 1 -- 172.21.15.27:0/1675107596 shutdown_connections 2023-10-06T02:59:51.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990bfff700 1 --2- 172.21.15.27:0/1675107596 >> v2:172.21.15.123:3300/0 conn(0x7f990c06ea20 0x7f990c143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990bfff700 1 --2- 172.21.15.27:0/1675107596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c1430b0 0x7f990c149f40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990bfff700 1 -- 172.21.15.27:0/1675107596 >> 172.21.15.27:0/1675107596 conn(0x7f990c067b30 msgr2=0x7f990c0bec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:51.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990bfff700 1 -- 172.21.15.27:0/1675107596 shutdown_connections 2023-10-06T02:59:51.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.727+0000 7f990bfff700 1 -- 172.21.15.27:0/1675107596 wait complete. 2023-10-06T02:59:51.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.731+0000 7f990bfff700 1 Processor -- start 2023-10-06T02:59:51.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.731+0000 7f990bfff700 1 -- start start 2023-10-06T02:59:51.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.731+0000 7f990bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f990c06c810 0x7f990c142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.731+0000 7f990bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990c1430b0 0x7f990c143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.731+0000 7f990bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c144010 0x7f990c144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.731+0000 7f990bfff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c142630 con 0x7f990c144010 2023-10-06T02:59:51.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.731+0000 7f990bfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c146c00 con 0x7f990c1430b0 2023-10-06T02:59:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.731+0000 7f990bfff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c145b10 con 0x7f990c06c810 2023-10-06T02:59:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c144010 0x7f990c144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f9903fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990c1430b0 0x7f990c143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f9903fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990c1430b0 0x7f990c143ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:44230/0 (socket says 172.21.15.27:44230) 2023-10-06T02:59:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f9903fff700 1 -- 172.21.15.27:0/2691431850 learned_addr learned my addr 172.21.15.27:0/2691431850 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f990affd700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f990c06c810 0x7f990c142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c144010 0x7f990c144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59026/0 (socket says 172.21.15.27:59026) 2023-10-06T02:59:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f990b7fe700 1 -- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f990c06c810 msgr2=0x7f990c142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f990b7fe700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f990c06c810 0x7f990c142910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f990b7fe700 1 -- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990c1430b0 msgr2=0x7f990c143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f990b7fe700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990c1430b0 0x7f990c143ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f990b7fe700 1 -- 172.21.15.27:0/2691431850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc009420 con 0x7f990c144010 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f9903fff700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990c1430b0 0x7f990c143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f990b7fe700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c144010 0x7f990c144a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f990400efd0 tx=0x7f9904001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f9902ffd700 1 -- 172.21.15.27:0/2691431850 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904013070 con 0x7f990c144010 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f9902ffd700 1 -- 172.21.15.27:0/2691431850 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990400e2e0 con 0x7f990c144010 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f990bfff700 1 -- 172.21.15.27:0/2691431850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990c144f50 con 0x7f990c144010 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f9902ffd700 1 -- 172.21.15.27:0/2691431850 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904010b80 con 0x7f990c144010 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f990bfff700 1 -- 172.21.15.27:0/2691431850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c1453d0 con 0x7f990c144010 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f990bfff700 1 -- 172.21.15.27:0/2691431850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990c15d640 con 0x7f990c144010 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f9902ffd700 1 -- 172.21.15.27:0/2691431850 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f990400c450 con 0x7f990c144010 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f9902ffd700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f98f0060550 0x7f98f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.735+0000 7f9902ffd700 1 -- 172.21.15.27:0/2691431850 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9904080760 con 0x7f990c144010 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.739+0000 7f990affd700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f98f0060550 0x7f98f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.739+0000 7f990affd700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f98f0060550 0x7f98f0062a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f990c0702c0 tx=0x7f98fc017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:51.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.747+0000 7f9902ffd700 1 -- 172.21.15.27:0/2691431850 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9904050f40 con 0x7f990c144010 2023-10-06T02:59:51.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:51.903+0000 7f990bfff700 1 -- 172.21.15.27:0/2691431850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f990c142770 con 0x7f990c144010 2023-10-06T02:59:52.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.255+0000 7f9902ffd700 1 -- 172.21.15.27:0/2691431850 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f990c142770 con 0x7f990c144010 2023-10-06T02:59:52.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.263+0000 7f990bfff700 1 -- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f98f0060550 msgr2=0x7f98f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.263+0000 7f990bfff700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f98f0060550 0x7f98f0062a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f990c0702c0 tx=0x7f98fc017000 comp rx=0 tx=0).stop 2023-10-06T02:59:52.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.263+0000 7f990bfff700 1 -- 172.21.15.27:0/2691431850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c144010 msgr2=0x7f990c144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.263+0000 7f990bfff700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c144010 0x7f990c144a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f990400efd0 tx=0x7f9904001ab0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.263+0000 7f990bfff700 1 -- 172.21.15.27:0/2691431850 shutdown_connections 2023-10-06T02:59:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.263+0000 7f990bfff700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f98f0060550 0x7f98f0062a00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.263+0000 7f990bfff700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c144010 0x7f990c144a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.263+0000 7f990bfff700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990c1430b0 0x7f990c143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.263+0000 7f990bfff700 1 --2- 172.21.15.27:0/2691431850 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f990c06c810 0x7f990c142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.263+0000 7f990bfff700 1 -- 172.21.15.27:0/2691431850 >> 172.21.15.27:0/2691431850 conn(0x7f990c067b30 msgr2=0x7f990c06dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:52.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.263+0000 7f990bfff700 1 -- 172.21.15.27:0/2691431850 shutdown_connections 2023-10-06T02:59:52.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.263+0000 7f990bfff700 1 -- 172.21.15.27:0/2691431850 wait complete. 2023-10-06T02:59:52.272 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2023-10-06T02:59:52.284 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:59:52.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.399+0000 7ff4733fa700 1 Processor -- start 2023-10-06T02:59:52.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.399+0000 7ff4733fa700 1 -- start start 2023-10-06T02:59:52.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.399+0000 7ff4733fa700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff46c0a22a0 0x7ff46c067ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.399+0000 7ff4733fa700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff46c0681e0 0x7ff46c0b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.399+0000 7ff4733fa700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46c06c2c0 con 0x7ff46c0a2670 2023-10-06T02:59:52.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.399+0000 7ff4733fa700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46c0ba980 con 0x7ff46c0a22a0 2023-10-06T02:59:52.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.399+0000 7ff4733fa700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0b63f0 con 0x7ff46c0681e0 2023-10-06T02:59:52.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.399+0000 7ff471196700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff46c0a22a0 0x7ff46c067ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.399+0000 7ff471196700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff46c0a22a0 0x7ff46c067ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59032/0 (socket says 172.21.15.27:59032) 2023-10-06T02:59:52.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.399+0000 7ff471196700 1 -- 172.21.15.27:0/3436523616 learned_addr learned my addr 172.21.15.27:0/3436523616 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:52.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff470995700 1 --2- 172.21.15.27:0/3436523616 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff46c0681e0 0x7ff46c0b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff45ffff700 1 -- 172.21.15.27:0/3436523616 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611652503 0 0) 0x7ff46c06c2c0 con 0x7ff46c0a2670 2023-10-06T02:59:52.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff45ffff700 1 -- 172.21.15.27:0/3436523616 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff458003570 con 0x7ff46c0a2670 2023-10-06T02:59:52.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff471196700 1 -- 172.21.15.27:0/3436523616 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff46c0681e0 msgr2=0x7ff46c0b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:52.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff471196700 1 --2- 172.21.15.27:0/3436523616 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff46c0681e0 0x7ff46c0b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff471196700 1 -- 172.21.15.27:0/3436523616 >> v1:172.21.15.123:6789/0 conn(0x7ff46c0a2670 legacy=0x7ff46c0b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff471196700 1 -- 172.21.15.27:0/3436523616 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c06bc70 con 0x7ff46c0a22a0 2023-10-06T02:59:52.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff470995700 1 --2- 172.21.15.27:0/3436523616 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff46c0681e0 0x7ff46c0b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:52.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff471196700 1 --2- 172.21.15.27:0/3436523616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff46c0a22a0 0x7ff46c067ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff4600099b0 tx=0x7ff460009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b741f797be873f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:52.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff45ffff700 1 -- 172.21.15.27:0/3436523616 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46000b680 con 0x7ff46c0a22a0 2023-10-06T02:59:52.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff45ffff700 1 -- 172.21.15.27:0/3436523616 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46000b7e0 con 0x7ff46c0a22a0 2023-10-06T02:59:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff45ffff700 1 -- 172.21.15.27:0/3436523616 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46000bb60 con 0x7ff46c0a22a0 2023-10-06T02:59:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff4733fa700 1 -- 172.21.15.27:0/3436523616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff46c0a22a0 msgr2=0x7ff46c067ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff4733fa700 1 --2- 172.21.15.27:0/3436523616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff46c0a22a0 0x7ff46c067ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff4600099b0 tx=0x7ff460009250 comp rx=0 tx=0).stop 2023-10-06T02:59:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff4733fa700 1 -- 172.21.15.27:0/3436523616 shutdown_connections 2023-10-06T02:59:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff4733fa700 1 --2- 172.21.15.27:0/3436523616 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff46c0681e0 0x7ff46c0b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff4733fa700 1 --2- 172.21.15.27:0/3436523616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff46c0a22a0 0x7ff46c067ca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff4733fa700 1 -- 172.21.15.27:0/3436523616 >> 172.21.15.27:0/3436523616 conn(0x7ff46c0bfec0 msgr2=0x7ff46c0c02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff4733fa700 1 -- 172.21.15.27:0/3436523616 shutdown_connections 2023-10-06T02:59:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.403+0000 7ff4733fa700 1 -- 172.21.15.27:0/3436523616 wait complete. 2023-10-06T02:59:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.407+0000 7ff4733fa700 1 Processor -- start 2023-10-06T02:59:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.407+0000 7ff4733fa700 1 -- start start 2023-10-06T02:59:52.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.407+0000 7ff4733fa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff46c0681e0 0x7ff46c0b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.407+0000 7ff4733fa700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff46c0a22a0 0x7ff46c14beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.407+0000 7ff4733fa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff46c0a2670 0x7ff46c0a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.407+0000 7ff4733fa700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0b8550 con 0x7ff46c0681e0 2023-10-06T02:59:52.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.407+0000 7ff4733fa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0a4f80 con 0x7ff46c0a2670 2023-10-06T02:59:52.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.407+0000 7ff4733fa700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0a1090 con 0x7ff46c0a22a0 2023-10-06T02:59:52.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.407+0000 7ff471196700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff46c0681e0 0x7ff46c0b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.407+0000 7ff471997700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff46c0a2670 0x7ff46c0a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.407+0000 7ff471196700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff46c0681e0 0x7ff46c0b6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59040/0 (socket says 172.21.15.27:59040) 2023-10-06T02:59:52.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.407+0000 7ff471196700 1 -- 172.21.15.27:0/3789107797 learned_addr learned my addr 172.21.15.27:0/3789107797 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:52.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.407+0000 7ff470995700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff46c0a22a0 0x7ff46c14beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff470995700 1 -- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff46c0a2670 msgr2=0x7ff46c0a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff470995700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff46c0a2670 0x7ff46c0a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff470995700 1 -- 172.21.15.27:0/3789107797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff46c0681e0 msgr2=0x7ff46c0b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff470995700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff46c0681e0 0x7ff46c0b6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff470995700 1 -- 172.21.15.27:0/3789107797 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468009420 con 0x7ff46c0a22a0 2023-10-06T02:59:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff471196700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff46c0681e0 0x7ff46c0b6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff471997700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff46c0a2670 0x7ff46c0a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff470995700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff46c0a22a0 0x7ff46c14beb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff46800ecb0 tx=0x7ff4680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff45d7fa700 1 -- 172.21.15.27:0/3789107797 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800c850 con 0x7ff46c0a22a0 2023-10-06T02:59:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff45d7fa700 1 -- 172.21.15.27:0/3789107797 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46800c9b0 con 0x7ff46c0a22a0 2023-10-06T02:59:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff45d7fa700 1 -- 172.21.15.27:0/3789107797 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800cd50 con 0x7ff46c0a22a0 2023-10-06T02:59:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff4733fa700 1 -- 172.21.15.27:0/3789107797 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4600094f0 con 0x7ff46c0a22a0 2023-10-06T02:59:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff4733fa700 1 -- 172.21.15.27:0/3789107797 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c0ba160 con 0x7ff46c0a22a0 2023-10-06T02:59:52.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.411+0000 7ff4733fa700 1 -- 172.21.15.27:0/3789107797 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c04be40 con 0x7ff46c0a22a0 2023-10-06T02:59:52.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.415+0000 7ff45d7fa700 1 -- 172.21.15.27:0/3789107797 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff468013680 con 0x7ff46c0a22a0 2023-10-06T02:59:52.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.415+0000 7ff45d7fa700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ff450060550 0x7ff450062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.415+0000 7ff45d7fa700 1 -- 172.21.15.27:0/3789107797 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5576+0+0 (secure 0 0 0) 0x7ff46807ccb0 con 0x7ff46c0a22a0 2023-10-06T02:59:52.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.415+0000 7ff471196700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ff450060550 0x7ff450062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.415+0000 7ff471196700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ff450060550 0x7ff450062a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0b90d0 tx=0x7ff460017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:52.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.427+0000 7ff45d7fa700 1 -- 172.21.15.27:0/3789107797 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff46804d320 con 0x7ff46c0a22a0 2023-10-06T02:59:52.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:52.591+0000 7ff4733fa700 1 -- 172.21.15.27:0/3789107797 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff46c06bf50 con 0x7ff46c0a22a0 2023-10-06T02:59:53.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.275+0000 7ff45d7fa700 1 -- 172.21.15.27:0/3789107797 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff468050940 con 0x7ff46c0a22a0 2023-10-06T02:59:53.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.291+0000 7ff4733fa700 1 -- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ff450060550 msgr2=0x7ff450062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.291+0000 7ff4733fa700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ff450060550 0x7ff450062a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0b90d0 tx=0x7ff460017000 comp rx=0 tx=0).stop 2023-10-06T02:59:53.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.291+0000 7ff4733fa700 1 -- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff46c0a22a0 msgr2=0x7ff46c14beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.291+0000 7ff4733fa700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff46c0a22a0 0x7ff46c14beb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff46800ecb0 tx=0x7ff4680091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.295+0000 7ff4733fa700 1 -- 172.21.15.27:0/3789107797 shutdown_connections 2023-10-06T02:59:53.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.295+0000 7ff4733fa700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ff450060550 0x7ff450062a00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.295+0000 7ff4733fa700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff46c0a2670 0x7ff46c0a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.295+0000 7ff4733fa700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff46c0a22a0 0x7ff46c14beb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.295+0000 7ff4733fa700 1 --2- 172.21.15.27:0/3789107797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff46c0681e0 0x7ff46c0b6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.295+0000 7ff4733fa700 1 -- 172.21.15.27:0/3789107797 >> 172.21.15.27:0/3789107797 conn(0x7ff46c0bfec0 msgr2=0x7ff46c148480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:53.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.295+0000 7ff4733fa700 1 -- 172.21.15.27:0/3789107797 shutdown_connections 2023-10-06T02:59:53.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.295+0000 7ff4733fa700 1 -- 172.21.15.27:0/3789107797 wait complete. 2023-10-06T02:59:53.302 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2023-10-06T02:59:53.314 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:59:53.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.411+0000 7fea9ffff700 1 Processor -- start 2023-10-06T02:59:53.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.411+0000 7fea9ffff700 1 -- start start 2023-10-06T02:59:53.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feaa006ea30 0x7feaa006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9ffff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa00be150 con 0x7feaa00a1890 2023-10-06T02:59:53.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9ffff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa00a2300 con 0x7feaa00b8f40 2023-10-06T02:59:53.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9ffff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa00be650 con 0x7feaa006ea30 2023-10-06T02:59:53.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9e7fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7feaa00a1890 0x7feaa00bd1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52190/0 (socket says 172.21.15.27:52190) 2023-10-06T02:59:53.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9e7fc700 1 -- 172.21.15.27:0/3710623116 learned_addr learned my addr 172.21.15.27:0/3710623116 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:53.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9effd700 1 --2- 172.21.15.27:0/3710623116 >> v2:172.21.15.123:3300/0 conn(0x7feaa006ea30 0x7feaa006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9dffb700 1 -- 172.21.15.27:0/3710623116 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777034584 0 0) 0x7feaa00be150 con 0x7feaa00a1890 2023-10-06T02:59:53.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9dffb700 1 -- 172.21.15.27:0/3710623116 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea88003570 con 0x7feaa00a1890 2023-10-06T02:59:53.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9effd700 1 -- 172.21.15.27:0/3710623116 >> v1:172.21.15.123:6789/0 conn(0x7feaa00b8f40 legacy=0x7feaa0155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9effd700 1 -- 172.21.15.27:0/3710623116 >> v1:172.21.15.27:6789/0 conn(0x7feaa00a1890 legacy=0x7feaa00bd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9dffb700 1 -- 172.21.15.27:0/3710623116 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741651112 0 0) 0x7feaa00a2300 con 0x7feaa00b8f40 2023-10-06T02:59:53.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9effd700 1 -- 172.21.15.27:0/3710623116 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa00bd8d0 con 0x7feaa006ea30 2023-10-06T02:59:53.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9effd700 1 --2- 172.21.15.27:0/3710623116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa006ea30 0x7feaa006ee00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fea940098d0 tx=0x7fea94009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f21cd1a9bba263a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:53.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9dffb700 1 -- 172.21.15.27:0/3710623116 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94005c10 con 0x7feaa006ea30 2023-10-06T02:59:53.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9dffb700 1 -- 172.21.15.27:0/3710623116 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea94005d70 con 0x7feaa006ea30 2023-10-06T02:59:53.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9dffb700 1 -- 172.21.15.27:0/3710623116 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94006280 con 0x7feaa006ea30 2023-10-06T02:59:53.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9ffff700 1 -- 172.21.15.27:0/3710623116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa006ea30 msgr2=0x7feaa006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9ffff700 1 --2- 172.21.15.27:0/3710623116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa006ea30 0x7feaa006ee00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fea940098d0 tx=0x7fea94009120 comp rx=0 tx=0).stop 2023-10-06T02:59:53.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9ffff700 1 -- 172.21.15.27:0/3710623116 shutdown_connections 2023-10-06T02:59:53.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9ffff700 1 --2- 172.21.15.27:0/3710623116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa006ea30 0x7feaa006ee00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9ffff700 1 -- 172.21.15.27:0/3710623116 >> 172.21.15.27:0/3710623116 conn(0x7feaa006df20 msgr2=0x7feaa006e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:53.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9ffff700 1 -- 172.21.15.27:0/3710623116 shutdown_connections 2023-10-06T02:59:53.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.415+0000 7fea9ffff700 1 -- 172.21.15.27:0/3710623116 wait complete. 2023-10-06T02:59:53.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9ffff700 1 Processor -- start 2023-10-06T02:59:53.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9ffff700 1 -- start start 2023-10-06T02:59:53.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa006ea30 0x7feaa00b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9ffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa00a1890 0x7feaa00baa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa00b8f40 0x7feaa00a72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9ffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00bafc0 con 0x7feaa00b8f40 2023-10-06T02:59:53.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9ffff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00b8480 con 0x7feaa006ea30 2023-10-06T02:59:53.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9ffff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00b8760 con 0x7feaa00a1890 2023-10-06T02:59:53.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa00b8f40 0x7feaa00a72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa00b8f40 0x7feaa00a72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59044/0 (socket says 172.21.15.27:59044) 2023-10-06T02:59:53.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9f7fe700 1 -- 172.21.15.27:0/3957172820 learned_addr learned my addr 172.21.15.27:0/3957172820 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:53.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9e7fc700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa00a1890 0x7feaa00baa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9effd700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa006ea30 0x7feaa00b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9e7fc700 1 -- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa006ea30 msgr2=0x7feaa00b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9e7fc700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa006ea30 0x7feaa00b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9e7fc700 1 -- 172.21.15.27:0/3957172820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa00b8f40 msgr2=0x7feaa00a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9e7fc700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa00b8f40 0x7feaa00a72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9e7fc700 1 -- 172.21.15.27:0/3957172820 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea940093c0 con 0x7feaa00a1890 2023-10-06T02:59:53.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9e7fc700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa00a1890 0x7feaa00baa80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fea900058d0 tx=0x7fea90007d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:53.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea86ffd700 1 -- 172.21.15.27:0/3957172820 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90005b30 con 0x7feaa00a1890 2023-10-06T02:59:53.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea86ffd700 1 -- 172.21.15.27:0/3957172820 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea90005cd0 con 0x7feaa00a1890 2023-10-06T02:59:53.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9ffff700 1 -- 172.21.15.27:0/3957172820 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa00a58f0 con 0x7feaa00a1890 2023-10-06T02:59:53.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea86ffd700 1 -- 172.21.15.27:0/3957172820 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90007320 con 0x7feaa00a1890 2023-10-06T02:59:53.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.419+0000 7fea9ffff700 1 -- 172.21.15.27:0/3957172820 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa00b7110 con 0x7feaa00a1890 2023-10-06T02:59:53.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.423+0000 7fea9ffff700 1 -- 172.21.15.27:0/3957172820 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa004b600 con 0x7feaa00a1890 2023-10-06T02:59:53.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.423+0000 7fea86ffd700 1 -- 172.21.15.27:0/3957172820 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fea90007690 con 0x7feaa00a1890 2023-10-06T02:59:53.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.423+0000 7fea86ffd700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fea8c060550 0x7fea8c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.423+0000 7fea86ffd700 1 -- 172.21.15.27:0/3957172820 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fea9007ba90 con 0x7feaa00a1890 2023-10-06T02:59:53.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.423+0000 7fea9effd700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fea8c060550 0x7fea8c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.427+0000 7fea9effd700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fea8c060550 0x7fea8c062a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea94009390 tx=0x7fea94016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:53.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.435+0000 7fea86ffd700 1 -- 172.21.15.27:0/3957172820 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fea90049be0 con 0x7feaa00a1890 2023-10-06T02:59:53.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:53.631+0000 7fea9ffff700 1 -- 172.21.15.27:0/3957172820 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7feaa0151710 con 0x7feaa00a1890 2023-10-06T02:59:54.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.275+0000 7fea86ffd700 1 -- 172.21.15.27:0/3957172820 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fea90017020 con 0x7feaa00a1890 2023-10-06T02:59:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.279+0000 7fea9ffff700 1 -- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fea8c060550 msgr2=0x7fea8c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.279+0000 7fea9ffff700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fea8c060550 0x7fea8c062a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea94009390 tx=0x7fea94016000 comp rx=0 tx=0).stop 2023-10-06T02:59:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.279+0000 7fea9ffff700 1 -- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa00a1890 msgr2=0x7feaa00baa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.279+0000 7fea9ffff700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa00a1890 0x7feaa00baa80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fea900058d0 tx=0x7fea90007d10 comp rx=0 tx=0).stop 2023-10-06T02:59:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.279+0000 7fea9ffff700 1 -- 172.21.15.27:0/3957172820 shutdown_connections 2023-10-06T02:59:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.279+0000 7fea9ffff700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fea8c060550 0x7fea8c062a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.279+0000 7fea9ffff700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa00b8f40 0x7feaa00a72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.279+0000 7fea9ffff700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa00a1890 0x7feaa00baa80 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fea900058d0 tx=0x7fea90007d10 comp rx=0 tx=0).stop 2023-10-06T02:59:54.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.279+0000 7fea9ffff700 1 --2- 172.21.15.27:0/3957172820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa006ea30 0x7feaa00b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.279+0000 7fea9ffff700 1 -- 172.21.15.27:0/3957172820 >> 172.21.15.27:0/3957172820 conn(0x7feaa006df20 msgr2=0x7feaa014deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:54.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.279+0000 7fea9ffff700 1 -- 172.21.15.27:0/3957172820 shutdown_connections 2023-10-06T02:59:54.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.279+0000 7fea9ffff700 1 -- 172.21.15.27:0/3957172820 wait complete. 2023-10-06T02:59:54.287 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T02:59:54.300 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:54.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.395+0000 7f355b22d700 1 Processor -- start 2023-10-06T02:59:54.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.395+0000 7f355b22d700 1 -- start start 2023-10-06T02:59:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355b22d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35540be150 0x7f355406cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355b22d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f355414eef0 0x7f355414f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355b22d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35540a2310 con 0x7f35540b5520 2023-10-06T02:59:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355b22d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355406d0f0 con 0x7f355414eef0 2023-10-06T02:59:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355b22d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35540a2680 con 0x7f35540be150 2023-10-06T02:59:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f3559a2a700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f35540b5520 0x7f35540b5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52196/0 (socket says 172.21.15.27:52196) 2023-10-06T02:59:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f3559a2a700 1 -- 172.21.15.27:0/4251733731 learned_addr learned my addr 172.21.15.27:0/4251733731 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355aa2c700 1 --2- 172.21.15.27:0/4251733731 >> v2:172.21.15.123:3300/0 conn(0x7f355414eef0 0x7f355414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355a22b700 1 --2- 172.21.15.27:0/4251733731 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35540be150 0x7f355406cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f3559229700 1 -- 172.21.15.27:0/4251733731 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998485463 0 0) 0x7f35540a2310 con 0x7f35540b5520 2023-10-06T02:59:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f3559229700 1 -- 172.21.15.27:0/4251733731 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3540003570 con 0x7f35540b5520 2023-10-06T02:59:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355a22b700 1 -- 172.21.15.27:0/4251733731 >> v2:172.21.15.123:3300/0 conn(0x7f355414eef0 msgr2=0x7f355414f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355a22b700 1 --2- 172.21.15.27:0/4251733731 >> v2:172.21.15.123:3300/0 conn(0x7f355414eef0 0x7f355414f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355a22b700 1 -- 172.21.15.27:0/4251733731 >> v1:172.21.15.27:6789/0 conn(0x7f35540b5520 legacy=0x7f35540b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355a22b700 1 -- 172.21.15.27:0/4251733731 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35540bd1d0 con 0x7f35540be150 2023-10-06T02:59:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355aa2c700 1 --2- 172.21.15.27:0/4251733731 >> v2:172.21.15.123:3300/0 conn(0x7f355414eef0 0x7f355414f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355a22b700 1 --2- 172.21.15.27:0/4251733731 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35540be150 0x7f355406cbb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f35500098e0 tx=0x7f35500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baf24ff208f6bee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:54.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f3559229700 1 -- 172.21.15.27:0/4251733731 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550011630 con 0x7f35540be150 2023-10-06T02:59:54.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f3559229700 1 -- 172.21.15.27:0/4251733731 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3550011790 con 0x7f35540be150 2023-10-06T02:59:54.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f3559229700 1 -- 172.21.15.27:0/4251733731 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550011b10 con 0x7f35540be150 2023-10-06T02:59:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355b22d700 1 -- 172.21.15.27:0/4251733731 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35540be150 msgr2=0x7f355406cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355b22d700 1 --2- 172.21.15.27:0/4251733731 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35540be150 0x7f355406cbb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f35500098e0 tx=0x7f35500091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355b22d700 1 -- 172.21.15.27:0/4251733731 shutdown_connections 2023-10-06T02:59:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355b22d700 1 --2- 172.21.15.27:0/4251733731 >> v2:172.21.15.123:3300/0 conn(0x7f355414eef0 0x7f355414f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355b22d700 1 --2- 172.21.15.27:0/4251733731 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35540be150 0x7f355406cbb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355b22d700 1 -- 172.21.15.27:0/4251733731 >> 172.21.15.27:0/4251733731 conn(0x7f35540bf440 msgr2=0x7f355406df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355b22d700 1 -- 172.21.15.27:0/4251733731 shutdown_connections 2023-10-06T02:59:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.399+0000 7f355b22d700 1 -- 172.21.15.27:0/4251733731 wait complete. 2023-10-06T02:59:54.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355b22d700 1 Processor -- start 2023-10-06T02:59:54.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355b22d700 1 -- start start 2023-10-06T02:59:54.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355b22d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540b5520 0x7f35540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355b22d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35540be150 0x7f35540a72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355b22d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f355414eef0 0x7f3554150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355b22d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355415c490 con 0x7f35540b5520 2023-10-06T02:59:54.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355b22d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35540a6e20 con 0x7f355414eef0 2023-10-06T02:59:54.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355b22d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35540a56f0 con 0x7f35540be150 2023-10-06T02:59:54.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355a22b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540b5520 0x7f35540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355a22b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540b5520 0x7f35540a50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59060/0 (socket says 172.21.15.27:59060) 2023-10-06T02:59:54.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355a22b700 1 -- 172.21.15.27:0/1310095117 learned_addr learned my addr 172.21.15.27:0/1310095117 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:54.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f3559a2a700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35540be150 0x7f35540a72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355aa2c700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f355414eef0 0x7f3554150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355a22b700 1 -- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35540be150 msgr2=0x7f35540a72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355a22b700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35540be150 0x7f35540a72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355a22b700 1 -- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f355414eef0 msgr2=0x7f3554150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355a22b700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f355414eef0 0x7f3554150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355a22b700 1 -- 172.21.15.27:0/1310095117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c009a20 con 0x7f35540b5520 2023-10-06T02:59:54.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.403+0000 7f355a22b700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540b5520 0x7f35540a50d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f35540a27c0 tx=0x7f3550017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:54.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.407+0000 7f354a7fc700 1 -- 172.21.15.27:0/1310095117 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550011b10 con 0x7f35540b5520 2023-10-06T02:59:54.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.407+0000 7f354a7fc700 1 -- 172.21.15.27:0/1310095117 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3550000c90 con 0x7f35540b5520 2023-10-06T02:59:54.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.407+0000 7f355b22d700 1 -- 172.21.15.27:0/1310095117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3550009420 con 0x7f35540b5520 2023-10-06T02:59:54.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.407+0000 7f354a7fc700 1 -- 172.21.15.27:0/1310095117 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355001a660 con 0x7f35540b5520 2023-10-06T02:59:54.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.407+0000 7f355b22d700 1 -- 172.21.15.27:0/1310095117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35540a6a50 con 0x7f35540b5520 2023-10-06T02:59:54.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.407+0000 7f355b22d700 1 -- 172.21.15.27:0/1310095117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355404be40 con 0x7f35540b5520 2023-10-06T02:59:54.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.407+0000 7f354a7fc700 1 -- 172.21.15.27:0/1310095117 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f355001aa50 con 0x7f35540b5520 2023-10-06T02:59:54.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.407+0000 7f354a7fc700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3538060550 0x7f3538062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.407+0000 7f354a7fc700 1 -- 172.21.15.27:0/1310095117 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f355007e520 con 0x7f35540b5520 2023-10-06T02:59:54.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.407+0000 7f3559a2a700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3538060550 0x7f3538062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.411+0000 7f3559a2a700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3538060550 0x7f3538062a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f355414b6e0 tx=0x7f3544009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:54.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.415+0000 7f354a7fc700 1 -- 172.21.15.27:0/1310095117 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f355004e9b0 con 0x7f35540b5520 2023-10-06T02:59:54.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.579+0000 7f355b22d700 1 -- 172.21.15.27:0/1310095117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f355404b600 con 0x7f35540b5520 2023-10-06T02:59:54.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.579+0000 7f354a7fc700 1 -- 172.21.15.27:0/1310095117 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f3550051fd0 con 0x7f35540b5520 2023-10-06T02:59:54.586 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:54.586 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":23,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:53.637891+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:59:47.570918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:51.949130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:52.638817+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:54.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.583+0000 7f355b22d700 1 -- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3538060550 msgr2=0x7f3538062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.583+0000 7f355b22d700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3538060550 0x7f3538062a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f355414b6e0 tx=0x7f3544009040 comp rx=0 tx=0).stop 2023-10-06T02:59:54.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.583+0000 7f355b22d700 1 -- 172.21.15.27:0/1310095117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540b5520 msgr2=0x7f35540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.583+0000 7f355b22d700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540b5520 0x7f35540a50d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f35540a27c0 tx=0x7f3550017000 comp rx=0 tx=0).stop 2023-10-06T02:59:54.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.583+0000 7f355b22d700 1 -- 172.21.15.27:0/1310095117 shutdown_connections 2023-10-06T02:59:54.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.583+0000 7f355b22d700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3538060550 0x7f3538062a00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.583+0000 7f355b22d700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f355414eef0 0x7f3554150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.583+0000 7f355b22d700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35540be150 0x7f35540a72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.583+0000 7f355b22d700 1 --2- 172.21.15.27:0/1310095117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540b5520 0x7f35540a50d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.583+0000 7f355b22d700 1 -- 172.21.15.27:0/1310095117 >> 172.21.15.27:0/1310095117 conn(0x7f35540bf440 msgr2=0x7f35540b8400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:54.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.583+0000 7f355b22d700 1 -- 172.21.15.27:0/1310095117 shutdown_connections 2023-10-06T02:59:54.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.583+0000 7f355b22d700 1 -- 172.21.15.27:0/1310095117 wait complete. 2023-10-06T02:59:54.602 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:54.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b81881700 1 Processor -- start 2023-10-06T02:59:54.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b81881700 1 -- start start 2023-10-06T02:59:54.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b81881700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8b7c0b9c50 0x7f8b7c0ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b81881700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8b7c0a3550 0x7f8b7c09f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b81881700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7c09ef80 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b81881700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7c0a0f20 con 0x7f8b7c0b9c50 2023-10-06T02:59:54.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b81881700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c0a39d0 con 0x7f8b7c0a3550 2023-10-06T02:59:54.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b8087f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8b7c0b9c50 0x7f8b7c0ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b8087f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8b7c0b9c50 0x7f8b7c0ba020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59072/0 (socket says 172.21.15.27:59072) 2023-10-06T02:59:54.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b8087f700 1 -- 172.21.15.27:0/1325888117 learned_addr learned my addr 172.21.15.27:0/1325888117 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:54.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b7bfff700 1 --1- 172.21.15.27:0/1325888117 >> v1:172.21.15.27:6789/0 conn(0x7f8b7c0bb2c0 0x7f8b7c06c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52208/0 (socket says 172.21.15.27:52208) 2023-10-06T02:59:54.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b81080700 1 --2- 172.21.15.27:0/1325888117 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8b7c0a3550 0x7f8b7c09f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b8087f700 1 -- 172.21.15.27:0/1325888117 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8b7c0a3550 msgr2=0x7f8b7c09f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:54.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b8087f700 1 --2- 172.21.15.27:0/1325888117 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8b7c0a3550 0x7f8b7c09f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b8087f700 1 -- 172.21.15.27:0/1325888117 >> v1:172.21.15.27:6789/0 conn(0x7f8b7c0bb2c0 legacy=0x7f8b7c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b8087f700 1 -- 172.21.15.27:0/1325888117 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c0a2c50 con 0x7f8b7c0b9c50 2023-10-06T02:59:54.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b8087f700 1 --2- 172.21.15.27:0/1325888117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b7c0b9c50 0x7f8b7c0ba020 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8b640099b0 tx=0x7f8b64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7235ca620a1e63b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:54.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b7b7fe700 1 -- 172.21.15.27:0/1325888117 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6400b860 con 0x7f8b7c0b9c50 2023-10-06T02:59:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b7b7fe700 1 -- 172.21.15.27:0/1325888117 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6400b9c0 con 0x7f8b7c0b9c50 2023-10-06T02:59:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.707+0000 7f8b7b7fe700 1 -- 172.21.15.27:0/1325888117 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6400bd60 con 0x7f8b7c0b9c50 2023-10-06T02:59:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.711+0000 7f8b81881700 1 -- 172.21.15.27:0/1325888117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b7c0b9c50 msgr2=0x7f8b7c0ba020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.711+0000 7f8b81881700 1 --2- 172.21.15.27:0/1325888117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b7c0b9c50 0x7f8b7c0ba020 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8b640099b0 tx=0x7f8b64009250 comp rx=0 tx=0).stop 2023-10-06T02:59:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.711+0000 7f8b81881700 1 -- 172.21.15.27:0/1325888117 shutdown_connections 2023-10-06T02:59:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.711+0000 7f8b81881700 1 --2- 172.21.15.27:0/1325888117 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8b7c0a3550 0x7f8b7c09f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.711+0000 7f8b81881700 1 --2- 172.21.15.27:0/1325888117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b7c0b9c50 0x7f8b7c0ba020 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.711+0000 7f8b81881700 1 -- 172.21.15.27:0/1325888117 >> 172.21.15.27:0/1325888117 conn(0x7f8b7c06eb10 msgr2=0x7f8b7c0ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.711+0000 7f8b81881700 1 -- 172.21.15.27:0/1325888117 shutdown_connections 2023-10-06T02:59:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.711+0000 7f8b81881700 1 -- 172.21.15.27:0/1325888117 wait complete. 2023-10-06T02:59:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.711+0000 7f8b81881700 1 Processor -- start 2023-10-06T02:59:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.711+0000 7f8b81881700 1 -- start start 2023-10-06T02:59:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81881700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8b7c0a3550 0x7f8b7c1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81881700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b7c0b9c50 0x7f8b7c0b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81881700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b7c0bb2c0 0x7f8b7c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81881700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c0b66d0 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81881700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c0b2b50 con 0x7f8b7c0b9c50 2023-10-06T02:59:54.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81881700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c0b39f0 con 0x7f8b7c0a3550 2023-10-06T02:59:54.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81080700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b7c0bb2c0 0x7f8b7c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81080700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b7c0bb2c0 0x7f8b7c0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59086/0 (socket says 172.21.15.27:59086) 2023-10-06T02:59:54.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81080700 1 -- 172.21.15.27:0/2709858940 learned_addr learned my addr 172.21.15.27:0/2709858940 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:54.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b8087f700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8b7c0a3550 0x7f8b7c1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b7bfff700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b7c0b9c50 0x7f8b7c0b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81080700 1 -- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8b7c0a3550 msgr2=0x7f8b7c1530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81080700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8b7c0a3550 0x7f8b7c1530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81080700 1 -- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b7c0b9c50 msgr2=0x7f8b7c0b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81080700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b7c0b9c50 0x7f8b7c0b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81080700 1 -- 172.21.15.27:0/2709858940 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b640094f0 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81080700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b7c0bb2c0 0x7f8b7c0b34b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00d890 tx=0x7f8b6c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:54.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b78ff9700 1 -- 172.21.15.27:0/2709858940 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0125f0 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b78ff9700 1 -- 172.21.15.27:0/2709858940 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c012770 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81881700 1 -- 172.21.15.27:0/2709858940 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7c153600 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b78ff9700 1 -- 172.21.15.27:0/2709858940 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c012b30 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81881700 1 -- 172.21.15.27:0/2709858940 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7c0b5500 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b81881700 1 -- 172.21.15.27:0/2709858940 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7c0702a0 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.715+0000 7f8b78ff9700 1 -- 172.21.15.27:0/2709858940 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8b6c01e460 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.719+0000 7f8b78ff9700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8b5c060580 0x7f8b5c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.719+0000 7f8b78ff9700 1 -- 172.21.15.27:0/2709858940 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8b6c07ce50 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.719+0000 7f8b8087f700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8b5c060580 0x7f8b5c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.719+0000 7f8b8087f700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8b5c060580 0x7f8b5c062a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b640099b0 tx=0x7f8b64017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:54.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.723+0000 7f8b78ff9700 1 -- 172.21.15.27:0/2709858940 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8b7c0702a0 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.891+0000 7f8b81881700 1 -- 172.21.15.27:0/2709858940 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b7c0b2c90 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.891+0000 7f8b78ff9700 1 -- 172.21.15.27:0/2709858940 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f8b7c0b2c90 con 0x7f8b7c0bb2c0 2023-10-06T02:59:54.898 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:54.899 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":24,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:54.652472+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:59:47.570918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:51.949130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:52.638817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.895+0000 7f8b81881700 1 -- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8b5c060580 msgr2=0x7f8b5c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.895+0000 7f8b81881700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8b5c060580 0x7f8b5c062a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b640099b0 tx=0x7f8b64017000 comp rx=0 tx=0).stop 2023-10-06T02:59:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.895+0000 7f8b81881700 1 -- 172.21.15.27:0/2709858940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b7c0bb2c0 msgr2=0x7f8b7c0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.895+0000 7f8b81881700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b7c0bb2c0 0x7f8b7c0b34b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00d890 tx=0x7f8b6c008040 comp rx=0 tx=0).stop 2023-10-06T02:59:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.895+0000 7f8b81881700 1 -- 172.21.15.27:0/2709858940 shutdown_connections 2023-10-06T02:59:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.895+0000 7f8b81881700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8b5c060580 0x7f8b5c062a30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.895+0000 7f8b81881700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b7c0bb2c0 0x7f8b7c0b34b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.895+0000 7f8b81881700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b7c0b9c50 0x7f8b7c0b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.895+0000 7f8b81881700 1 --2- 172.21.15.27:0/2709858940 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8b7c0a3550 0x7f8b7c1530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.895+0000 7f8b81881700 1 -- 172.21.15.27:0/2709858940 >> 172.21.15.27:0/2709858940 conn(0x7f8b7c06eb10 msgr2=0x7f8b7c14ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:54.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.895+0000 7f8b81881700 1 -- 172.21.15.27:0/2709858940 shutdown_connections 2023-10-06T02:59:54.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:54.895+0000 7f8b81881700 1 -- 172.21.15.27:0/2709858940 wait complete. 2023-10-06T02:59:54.912 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:59:55.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.023+0000 7f36d7102700 1 Processor -- start 2023-10-06T02:59:55.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.023+0000 7f36d7102700 1 -- start start 2023-10-06T02:59:55.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.023+0000 7f36d7102700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36d00b7e20 0x7f36d00b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.023+0000 7f36d7102700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f36d00a43c0 0x7f36d014adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.023+0000 7f36d7102700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d00a17e0 con 0x7f36d00bc590 2023-10-06T02:59:55.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.023+0000 7f36d7102700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d014c870 con 0x7f36d00a43c0 2023-10-06T02:59:55.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.023+0000 7f36d7102700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00bd590 con 0x7f36d00b7e20 2023-10-06T02:59:55.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d6901700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f36d00a43c0 0x7f36d014adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d6100700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36d00b7e20 0x7f36d00b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d58ff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f36d00bc590 0x7f36d00a3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.27:56754/0 (socket says 172.21.15.27:56754) 2023-10-06T02:59:55.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d58ff700 1 -- 172.21.15.27:0/2945529609 learned_addr learned my addr 172.21.15.27:0/2945529609 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:55.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d6100700 1 -- 172.21.15.27:0/2945529609 >> v2:172.21.15.123:3300/0 conn(0x7f36d00a43c0 msgr2=0x7f36d014adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:55.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d6100700 1 --2- 172.21.15.27:0/2945529609 >> v2:172.21.15.123:3300/0 conn(0x7f36d00a43c0 0x7f36d014adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d6100700 1 -- 172.21.15.27:0/2945529609 >> v1:172.21.15.123:6789/0 conn(0x7f36d00bc590 legacy=0x7f36d00a3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d6100700 1 -- 172.21.15.27:0/2945529609 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d014bd90 con 0x7f36d00b7e20 2023-10-06T02:59:55.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d6901700 1 --2- 172.21.15.27:0/2945529609 >> v2:172.21.15.123:3300/0 conn(0x7f36d00a43c0 0x7f36d014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:55.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d6100700 1 --2- 172.21.15.27:0/2945529609 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36d00b7e20 0x7f36d00b81f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f36c00098e0 tx=0x7f36c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1c891f066abb91b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:55.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d50fe700 1 -- 172.21.15.27:0/2945529609 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c000b640 con 0x7f36d00b7e20 2023-10-06T02:59:55.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d50fe700 1 -- 172.21.15.27:0/2945529609 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c000b7a0 con 0x7f36d00b7e20 2023-10-06T02:59:55.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d50fe700 1 -- 172.21.15.27:0/2945529609 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c000bb40 con 0x7f36d00b7e20 2023-10-06T02:59:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d7102700 1 -- 172.21.15.27:0/2945529609 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36d00b7e20 msgr2=0x7f36d00b81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d7102700 1 --2- 172.21.15.27:0/2945529609 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36d00b7e20 0x7f36d00b81f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f36c00098e0 tx=0x7f36c00091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d7102700 1 -- 172.21.15.27:0/2945529609 shutdown_connections 2023-10-06T02:59:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d7102700 1 --2- 172.21.15.27:0/2945529609 >> v2:172.21.15.123:3300/0 conn(0x7f36d00a43c0 0x7f36d014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d7102700 1 --2- 172.21.15.27:0/2945529609 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36d00b7e20 0x7f36d00b81f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d7102700 1 -- 172.21.15.27:0/2945529609 >> 172.21.15.27:0/2945529609 conn(0x7f36d00be9c0 msgr2=0x7f36d00bedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d7102700 1 -- 172.21.15.27:0/2945529609 shutdown_connections 2023-10-06T02:59:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.027+0000 7f36d7102700 1 -- 172.21.15.27:0/2945529609 wait complete. 2023-10-06T02:59:55.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d7102700 1 Processor -- start 2023-10-06T02:59:55.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d7102700 1 -- start start 2023-10-06T02:59:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d7102700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36d00a43c0 0x7f36d014dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d7102700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36d00b7e20 0x7f36d00b95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d7102700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d00bc590 0x7f36d015f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d7102700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d015ff10 con 0x7f36d00bc590 2023-10-06T02:59:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d7102700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00bb2c0 con 0x7f36d00b7e20 2023-10-06T02:59:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d7102700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d014e100 con 0x7f36d00a43c0 2023-10-06T02:59:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d6901700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d00bc590 0x7f36d015f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d6901700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d00bc590 0x7f36d015f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59100/0 (socket says 172.21.15.27:59100) 2023-10-06T02:59:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d6901700 1 -- 172.21.15.27:0/1952868825 learned_addr learned my addr 172.21.15.27:0/1952868825 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d6100700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36d00a43c0 0x7f36d014dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d58ff700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36d00b7e20 0x7f36d00b95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d6100700 1 -- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36d00b7e20 msgr2=0x7f36d00b95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d6100700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36d00b7e20 0x7f36d00b95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d6100700 1 -- 172.21.15.27:0/1952868825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d00bc590 msgr2=0x7f36d015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d6100700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d00bc590 0x7f36d015f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d6100700 1 -- 172.21.15.27:0/1952868825 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c8009a20 con 0x7f36d00a43c0 2023-10-06T02:59:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d6901700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d00bc590 0x7f36d015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d6100700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36d00a43c0 0x7f36d014dbc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f36c0016000 tx=0x7f36c0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36c67fc700 1 -- 172.21.15.27:0/1952868825 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c001bc40 con 0x7f36d00a43c0 2023-10-06T02:59:55.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36c67fc700 1 -- 172.21.15.27:0/1952868825 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c001bdc0 con 0x7f36d00a43c0 2023-10-06T02:59:55.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36c67fc700 1 -- 172.21.15.27:0/1952868825 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0011670 con 0x7f36d00a43c0 2023-10-06T02:59:55.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d7102700 1 -- 172.21.15.27:0/1952868825 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c0009420 con 0x7f36d00a43c0 2023-10-06T02:59:55.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.031+0000 7f36d7102700 1 -- 172.21.15.27:0/1952868825 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d00b9ca0 con 0x7f36d00a43c0 2023-10-06T02:59:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.035+0000 7f36d7102700 1 -- 172.21.15.27:0/1952868825 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d0087c00 con 0x7f36d00a43c0 2023-10-06T02:59:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.035+0000 7f36c67fc700 1 -- 172.21.15.27:0/1952868825 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f36c0011a20 con 0x7f36d00a43c0 2023-10-06T02:59:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.035+0000 7f36c67fc700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f36b4060550 0x7f36b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.035+0000 7f36c67fc700 1 -- 172.21.15.27:0/1952868825 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f36c007dff0 con 0x7f36d00a43c0 2023-10-06T02:59:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.035+0000 7f36d58ff700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f36b4060550 0x7f36b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.035+0000 7f36d58ff700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f36b4060550 0x7f36b4062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36cc007130 tx=0x7f36cc007eb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:55.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.043+0000 7f36c67fc700 1 -- 172.21.15.27:0/1952868825 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f36c004e400 con 0x7f36d00a43c0 2023-10-06T02:59:55.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.243+0000 7f36d7102700 1 -- 172.21.15.27:0/1952868825 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f36d00bcea0 con 0x7f36d00a43c0 2023-10-06T02:59:55.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.283+0000 7f36c67fc700 1 -- 172.21.15.27:0/1952868825 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f36c0051a20 con 0x7f36d00a43c0 2023-10-06T02:59:55.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.287+0000 7f36d7102700 1 -- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f36b4060550 msgr2=0x7f36b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.287+0000 7f36d7102700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f36b4060550 0x7f36b4062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36cc007130 tx=0x7f36cc007eb0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.287+0000 7f36d7102700 1 -- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36d00a43c0 msgr2=0x7f36d014dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.287+0000 7f36d7102700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36d00a43c0 0x7f36d014dbc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f36c0016000 tx=0x7f36c0017000 comp rx=0 tx=0).stop 2023-10-06T02:59:55.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.287+0000 7f36d7102700 1 -- 172.21.15.27:0/1952868825 shutdown_connections 2023-10-06T02:59:55.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.287+0000 7f36d7102700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f36b4060550 0x7f36b4062a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.287+0000 7f36d7102700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d00bc590 0x7f36d015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.287+0000 7f36d7102700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36d00b7e20 0x7f36d00b95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.287+0000 7f36d7102700 1 --2- 172.21.15.27:0/1952868825 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36d00a43c0 0x7f36d014dbc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.287+0000 7f36d7102700 1 -- 172.21.15.27:0/1952868825 >> 172.21.15.27:0/1952868825 conn(0x7f36d00be9c0 msgr2=0x7f36d006b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:55.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.287+0000 7f36d7102700 1 -- 172.21.15.27:0/1952868825 shutdown_connections 2023-10-06T02:59:55.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.287+0000 7f36d7102700 1 -- 172.21.15.27:0/1952868825 wait complete. 2023-10-06T02:59:55.308 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:59:55.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.415+0000 7f2b2f59e700 1 Processor -- start 2023-10-06T02:59:55.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.415+0000 7f2b2f59e700 1 -- start start 2023-10-06T02:59:55.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.415+0000 7f2b2f59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b300b8b10 0x7f2b300bcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.415+0000 7f2b2f59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2b300bd120 0x7f2b300a2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.415+0000 7f2b2f59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b300a4450 con 0x7f2b300bc810 2023-10-06T02:59:55.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.415+0000 7f2b2f59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b300b7b10 con 0x7f2b300b8b10 2023-10-06T02:59:55.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.415+0000 7f2b2f59e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300b7db0 con 0x7f2b300bd120 2023-10-06T02:59:55.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.415+0000 7f2b2dd9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b300b8b10 0x7f2b300bcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2ed9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2b300bd120 0x7f2b300a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2dd9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b300b8b10 0x7f2b300bcbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:44298/0 (socket says 172.21.15.27:44298) 2023-10-06T02:59:55.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2dd9b700 1 -- 172.21.15.27:0/3771425689 learned_addr learned my addr 172.21.15.27:0/3771425689 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:55.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2ed9d700 1 -- 172.21.15.27:0/3771425689 >> v2:172.21.15.123:3300/0 conn(0x7f2b300b8b10 msgr2=0x7f2b300bcbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:55.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2ed9d700 1 --2- 172.21.15.27:0/3771425689 >> v2:172.21.15.123:3300/0 conn(0x7f2b300b8b10 0x7f2b300bcbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2ed9d700 1 -- 172.21.15.27:0/3771425689 >> v1:172.21.15.123:6789/0 conn(0x7f2b300bc810 legacy=0x7f2b3006cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2ed9d700 1 -- 172.21.15.27:0/3771425689 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b300b8090 con 0x7f2b300bd120 2023-10-06T02:59:55.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2d59a700 1 -- 172.21.15.27:0/3771425689 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615277943 0 0) 0x7f2b300a4450 con 0x7f2b300bc810 2023-10-06T02:59:55.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2dd9b700 1 --2- 172.21.15.27:0/3771425689 >> v2:172.21.15.123:3300/0 conn(0x7f2b300b8b10 0x7f2b300bcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:55.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2ed9d700 1 --2- 172.21.15.27:0/3771425689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2b300bd120 0x7f2b300a2460 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b28009e90 tx=0x7f2b28009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d6eea2e43e7e9f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2d59a700 1 -- 172.21.15.27:0/3771425689 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2800e070 con 0x7f2b300bd120 2023-10-06T02:59:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2d59a700 1 -- 172.21.15.27:0/3771425689 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2800bbf0 con 0x7f2b300bd120 2023-10-06T02:59:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2d59a700 1 -- 172.21.15.27:0/3771425689 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b28012430 con 0x7f2b300bd120 2023-10-06T02:59:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2f59e700 1 -- 172.21.15.27:0/3771425689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2b300bd120 msgr2=0x7f2b300a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2f59e700 1 --2- 172.21.15.27:0/3771425689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2b300bd120 0x7f2b300a2460 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b28009e90 tx=0x7f2b28009780 comp rx=0 tx=0).stop 2023-10-06T02:59:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2f59e700 1 -- 172.21.15.27:0/3771425689 shutdown_connections 2023-10-06T02:59:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2f59e700 1 --2- 172.21.15.27:0/3771425689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2b300bd120 0x7f2b300a2460 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2f59e700 1 --2- 172.21.15.27:0/3771425689 >> v2:172.21.15.123:3300/0 conn(0x7f2b300b8b10 0x7f2b300bcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2f59e700 1 -- 172.21.15.27:0/3771425689 >> 172.21.15.27:0/3771425689 conn(0x7f2b300bea10 msgr2=0x7f2b300bee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2f59e700 1 -- 172.21.15.27:0/3771425689 shutdown_connections 2023-10-06T02:59:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.419+0000 7f2b2f59e700 1 -- 172.21.15.27:0/3771425689 wait complete. 2023-10-06T02:59:55.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2f59e700 1 Processor -- start 2023-10-06T02:59:55.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2f59e700 1 -- start start 2023-10-06T02:59:55.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2f59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b300b8b10 0x7f2b3015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b300bc810 0x7f2b30150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2f59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2b300bd120 0x7f2b300a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2f59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3015f0f0 con 0x7f2b300b8b10 2023-10-06T02:59:55.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2f59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300a5b50 con 0x7f2b300bc810 2023-10-06T02:59:55.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2f59e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b30150e90 con 0x7f2b300bd120 2023-10-06T02:59:55.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b300b8b10 0x7f2b3015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b300b8b10 0x7f2b3015ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59114/0 (socket says 172.21.15.27:59114) 2023-10-06T02:59:55.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2e59c700 1 -- 172.21.15.27:0/1154036992 learned_addr learned my addr 172.21.15.27:0/1154036992 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:55.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2dd9b700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b300bc810 0x7f2b30150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2ed9d700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2b300bd120 0x7f2b300a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2e59c700 1 -- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2b300bd120 msgr2=0x7f2b300a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2e59c700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2b300bd120 0x7f2b300a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2e59c700 1 -- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b300bc810 msgr2=0x7f2b30150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2e59c700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b300bc810 0x7f2b30150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2e59c700 1 -- 172.21.15.27:0/1154036992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b200094f0 con 0x7f2b300b8b10 2023-10-06T02:59:55.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2ed9d700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2b300bd120 0x7f2b300a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:55.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2e59c700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b300b8b10 0x7f2b3015ebb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c810 tx=0x7f2b24007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:55.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b1e7fc700 1 -- 172.21.15.27:0/1154036992 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24012700 con 0x7f2b300b8b10 2023-10-06T02:59:55.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b1e7fc700 1 -- 172.21.15.27:0/1154036992 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b240128a0 con 0x7f2b300b8b10 2023-10-06T02:59:55.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2f59e700 1 -- 172.21.15.27:0/1154036992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b28009a20 con 0x7f2b300b8b10 2023-10-06T02:59:55.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b1e7fc700 1 -- 172.21.15.27:0/1154036992 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24012c60 con 0x7f2b300b8b10 2023-10-06T02:59:55.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2f59e700 1 -- 172.21.15.27:0/1154036992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b300a57e0 con 0x7f2b300b8b10 2023-10-06T02:59:55.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b2f59e700 1 -- 172.21.15.27:0/1154036992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b300876c0 con 0x7f2b300b8b10 2023-10-06T02:59:55.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.423+0000 7f2b1e7fc700 1 -- 172.21.15.27:0/1154036992 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2b2401b400 con 0x7f2b300b8b10 2023-10-06T02:59:55.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.427+0000 7f2b1e7fc700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2b10060550 0x7f2b10062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.427+0000 7f2b1e7fc700 1 -- 172.21.15.27:0/1154036992 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2b2407c560 con 0x7f2b300b8b10 2023-10-06T02:59:55.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.427+0000 7f2b2dd9b700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2b10060550 0x7f2b10062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.427+0000 7f2b2dd9b700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2b10060550 0x7f2b10062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b300a52d0 tx=0x7f2b20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:55.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.435+0000 7f2b1e7fc700 1 -- 172.21.15.27:0/1154036992 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2b2404c990 con 0x7f2b300b8b10 2023-10-06T02:59:55.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:55.631+0000 7f2b2f59e700 1 -- 172.21.15.27:0/1154036992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2b300a29a0 con 0x7f2b300b8b10 2023-10-06T02:59:56.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.303+0000 7f2b1e7fc700 1 -- 172.21.15.27:0/1154036992 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2b2404ffb0 con 0x7f2b300b8b10 2023-10-06T02:59:56.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.307+0000 7f2b2f59e700 1 -- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2b10060550 msgr2=0x7f2b10062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.307+0000 7f2b2f59e700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2b10060550 0x7f2b10062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b300a52d0 tx=0x7f2b20008040 comp rx=0 tx=0).stop 2023-10-06T02:59:56.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.307+0000 7f2b2f59e700 1 -- 172.21.15.27:0/1154036992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b300b8b10 msgr2=0x7f2b3015ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.307+0000 7f2b2f59e700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b300b8b10 0x7f2b3015ebb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c810 tx=0x7f2b24007df0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.307+0000 7f2b2f59e700 1 -- 172.21.15.27:0/1154036992 shutdown_connections 2023-10-06T02:59:56.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.307+0000 7f2b2f59e700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2b10060550 0x7f2b10062a00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.307+0000 7f2b2f59e700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2b300bd120 0x7f2b300a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.307+0000 7f2b2f59e700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b300bc810 0x7f2b30150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.307+0000 7f2b2f59e700 1 --2- 172.21.15.27:0/1154036992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b300b8b10 0x7f2b3015ebb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.307+0000 7f2b2f59e700 1 -- 172.21.15.27:0/1154036992 >> 172.21.15.27:0/1154036992 conn(0x7f2b300bea10 msgr2=0x7f2b300a1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:56.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.307+0000 7f2b2f59e700 1 -- 172.21.15.27:0/1154036992 shutdown_connections 2023-10-06T02:59:56.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.307+0000 7f2b2f59e700 1 -- 172.21.15.27:0/1154036992 wait complete. 2023-10-06T02:59:56.329 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:59:56.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.435+0000 7fb97f59e700 1 Processor -- start 2023-10-06T02:59:56.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.435+0000 7fb97f59e700 1 -- start start 2023-10-06T02:59:56.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.435+0000 7fb97f59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb98009da20 0x7fb9801487e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.435+0000 7fb97f59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb980147a80 con 0x7fb9800a0a30 2023-10-06T02:59:56.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.435+0000 7fb97f59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb980147d00 con 0x7fb9800baec0 2023-10-06T02:59:56.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.435+0000 7fb97f59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb980148d20 con 0x7fb98009da20 2023-10-06T02:59:56.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.435+0000 7fb97ed9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb9800a0a30 0x7fb9800a2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52224/0 (socket says 172.21.15.27:52224) 2023-10-06T02:59:56.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.435+0000 7fb97ed9d700 1 -- 172.21.15.27:0/1168968485 learned_addr learned my addr 172.21.15.27:0/1168968485 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:56.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.435+0000 7fb97dd9b700 1 --2- 172.21.15.27:0/1168968485 >> v2:172.21.15.123:3300/0 conn(0x7fb98009da20 0x7fb9801487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.435+0000 7fb97d59a700 1 -- 172.21.15.27:0/1168968485 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300818552 0 0) 0x7fb980147a80 con 0x7fb9800a0a30 2023-10-06T02:59:56.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.435+0000 7fb97d59a700 1 -- 172.21.15.27:0/1168968485 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb968003570 con 0x7fb9800a0a30 2023-10-06T02:59:56.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97dd9b700 1 -- 172.21.15.27:0/1168968485 >> v1:172.21.15.123:6789/0 conn(0x7fb9800baec0 legacy=0x7fb98009d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97dd9b700 1 -- 172.21.15.27:0/1168968485 >> v1:172.21.15.27:6789/0 conn(0x7fb9800a0a30 legacy=0x7fb9800a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97dd9b700 1 -- 172.21.15.27:0/1168968485 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb980147fe0 con 0x7fb98009da20 2023-10-06T02:59:56.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97dd9b700 1 --2- 172.21.15.27:0/1168968485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb98009da20 0x7fb9801487e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb970009e60 tx=0x7fb970009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c222ca2beb8bf0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:56.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97d59a700 1 -- 172.21.15.27:0/1168968485 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97000e070 con 0x7fb98009da20 2023-10-06T02:59:56.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97d59a700 1 -- 172.21.15.27:0/1168968485 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97000bb60 con 0x7fb98009da20 2023-10-06T02:59:56.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97d59a700 1 -- 172.21.15.27:0/1168968485 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970012430 con 0x7fb98009da20 2023-10-06T02:59:56.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 -- 172.21.15.27:0/1168968485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb98009da20 msgr2=0x7fb9801487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 --2- 172.21.15.27:0/1168968485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb98009da20 0x7fb9801487e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb970009e60 tx=0x7fb970009780 comp rx=0 tx=0).stop 2023-10-06T02:59:56.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 -- 172.21.15.27:0/1168968485 shutdown_connections 2023-10-06T02:59:56.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 --2- 172.21.15.27:0/1168968485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb98009da20 0x7fb9801487e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 -- 172.21.15.27:0/1168968485 >> 172.21.15.27:0/1168968485 conn(0x7fb98006eb10 msgr2=0x7fb9800ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:56.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 -- 172.21.15.27:0/1168968485 shutdown_connections 2023-10-06T02:59:56.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 -- 172.21.15.27:0/1168968485 wait complete. 2023-10-06T02:59:56.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 Processor -- start 2023-10-06T02:59:56.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 -- start start 2023-10-06T02:59:56.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb98009da20 0x7fb980068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9800a0a30 0x7fb98006c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9800baec0 0x7fb9801571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98006b5d0 con 0x7fb9800a0a30 2023-10-06T02:59:56.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb980069450 con 0x7fb9800baec0 2023-10-06T02:59:56.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97f59e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98006c680 con 0x7fb98009da20 2023-10-06T02:59:56.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9800a0a30 0x7fb98006c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9800a0a30 0x7fb98006c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59124/0 (socket says 172.21.15.27:59124) 2023-10-06T02:59:56.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97dd9b700 1 -- 172.21.15.27:0/1527940177 learned_addr learned my addr 172.21.15.27:0/1527940177 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:56.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.439+0000 7fb97ed9d700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9800baec0 0x7fb9801571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb97e59c700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb98009da20 0x7fb980068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb97dd9b700 1 -- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb98009da20 msgr2=0x7fb980068f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb97dd9b700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb98009da20 0x7fb980068f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb97dd9b700 1 -- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9800baec0 msgr2=0x7fb9801571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb97dd9b700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9800baec0 0x7fb9801571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb97dd9b700 1 -- 172.21.15.27:0/1527940177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb970009a20 con 0x7fb9800a0a30 2023-10-06T02:59:56.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb97dd9b700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9800a0a30 0x7fb98006c140 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9700097c0 tx=0x7fb970019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:56.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb96e7fc700 1 -- 172.21.15.27:0/1527940177 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970012c90 con 0x7fb9800a0a30 2023-10-06T02:59:56.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb96e7fc700 1 -- 172.21.15.27:0/1527940177 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb970012e10 con 0x7fb9800a0a30 2023-10-06T02:59:56.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb96e7fc700 1 -- 172.21.15.27:0/1527940177 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9700276c0 con 0x7fb9800a0a30 2023-10-06T02:59:56.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb97f59e700 1 -- 172.21.15.27:0/1527940177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98006a510 con 0x7fb9800a0a30 2023-10-06T02:59:56.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb97f59e700 1 -- 172.21.15.27:0/1527940177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98006a080 con 0x7fb9800a0a30 2023-10-06T02:59:56.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb97f59e700 1 -- 172.21.15.27:0/1527940177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9800674b0 con 0x7fb9800a0a30 2023-10-06T02:59:56.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.443+0000 7fb96e7fc700 1 -- 172.21.15.27:0/1527940177 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb970024070 con 0x7fb9800a0a30 2023-10-06T02:59:56.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.447+0000 7fb96e7fc700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb960060550 0x7fb960062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.447+0000 7fb96e7fc700 1 -- 172.21.15.27:0/1527940177 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb97007ee10 con 0x7fb9800a0a30 2023-10-06T02:59:56.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.447+0000 7fb97e59c700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb960060550 0x7fb960062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.447+0000 7fb97e59c700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb960060550 0x7fb960062a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb974003950 tx=0x7fb974007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:56.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.455+0000 7fb96e7fc700 1 -- 172.21.15.27:0/1527940177 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb97004f2a0 con 0x7fb9800a0a30 2023-10-06T02:59:56.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.647+0000 7fb97f59e700 1 -- 172.21.15.27:0/1527940177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9800b9920 con 0x7fb9800a0a30 2023-10-06T02:59:56.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.651+0000 7fb96e7fc700 1 -- 172.21.15.27:0/1527940177 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3082 (secure 0 0 0) 0x7fb97002cc20 con 0x7fb9800a0a30 2023-10-06T02:59:56.655 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:56.655 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3318688789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3318688789},{"type":"v1","addr":"172.21.15.123:6835","nonce":3318688789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:53.638660+0000","modified":"2023-10-06T02:59:56.293208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6833/3144883581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3144883581},{"type":"v1","addr":"172.21.15.27:6833","nonce":3144883581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:59:56.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.651+0000 7fb97f59e700 1 -- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb960060550 msgr2=0x7fb960062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.651+0000 7fb97f59e700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb960060550 0x7fb960062a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb974003950 tx=0x7fb974007ec0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.651+0000 7fb97f59e700 1 -- 172.21.15.27:0/1527940177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9800a0a30 msgr2=0x7fb98006c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.651+0000 7fb97f59e700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9800a0a30 0x7fb98006c140 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9700097c0 tx=0x7fb970019000 comp rx=0 tx=0).stop 2023-10-06T02:59:56.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.651+0000 7fb97f59e700 1 -- 172.21.15.27:0/1527940177 shutdown_connections 2023-10-06T02:59:56.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.651+0000 7fb97f59e700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb960060550 0x7fb960062a00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.651+0000 7fb97f59e700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9800baec0 0x7fb9801571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.651+0000 7fb97f59e700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9800a0a30 0x7fb98006c140 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.651+0000 7fb97f59e700 1 --2- 172.21.15.27:0/1527940177 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb98009da20 0x7fb980068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.651+0000 7fb97f59e700 1 -- 172.21.15.27:0/1527940177 >> 172.21.15.27:0/1527940177 conn(0x7fb98006eb10 msgr2=0x7fb980145f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:56.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.651+0000 7fb97f59e700 1 -- 172.21.15.27:0/1527940177 shutdown_connections 2023-10-06T02:59:56.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.651+0000 7fb97f59e700 1 -- 172.21.15.27:0/1527940177 wait complete. 2023-10-06T02:59:56.659 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 6 2023-10-06T02:59:56.670 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:56.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.775+0000 7fc8562fc700 1 Processor -- start 2023-10-06T02:59:56.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.775+0000 7fc8562fc700 1 -- start start 2023-10-06T02:59:56.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.775+0000 7fc8562fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc85006d3d0 0x7fc85006afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.775+0000 7fc8562fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc85014eb60 0x7fc85014ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.775+0000 7fc8562fc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc850069550 con 0x7fc85014f4d0 2023-10-06T02:59:56.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.775+0000 7fc8562fc700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8500bacd0 con 0x7fc85006d3d0 2023-10-06T02:59:56.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.775+0000 7fc8562fc700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85014f950 con 0x7fc85014eb60 2023-10-06T02:59:56.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.775+0000 7fc8552fa700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc85006d3d0 0x7fc85006afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.775+0000 7fc8552fa700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc85006d3d0 0x7fc85006afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59132/0 (socket says 172.21.15.27:59132) 2023-10-06T02:59:56.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.775+0000 7fc8552fa700 1 -- 172.21.15.27:0/2243139928 learned_addr learned my addr 172.21.15.27:0/2243139928 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:56.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.775+0000 7fc854af9700 1 --2- 172.21.15.27:0/2243139928 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc85014eb60 0x7fc85014ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc8552fa700 1 -- 172.21.15.27:0/2243139928 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc85014eb60 msgr2=0x7fc85014ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:56.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc8552fa700 1 --2- 172.21.15.27:0/2243139928 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc85014eb60 0x7fc85014ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc8552fa700 1 -- 172.21.15.27:0/2243139928 >> v1:172.21.15.123:6789/0 conn(0x7fc85014f4d0 legacy=0x7fc85014aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc8552fa700 1 -- 172.21.15.27:0/2243139928 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85006b4f0 con 0x7fc85006d3d0 2023-10-06T02:59:56.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc8552fa700 1 --2- 172.21.15.27:0/2243139928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc85006d3d0 0x7fc85006afb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8400099b0 tx=0x7fc840009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e539721527ff7655 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:56.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc847fff700 1 -- 172.21.15.27:0/2243139928 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840009ea0 con 0x7fc85006d3d0 2023-10-06T02:59:56.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc847fff700 1 -- 172.21.15.27:0/2243139928 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84000b860 con 0x7fc85006d3d0 2023-10-06T02:59:56.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc847fff700 1 -- 172.21.15.27:0/2243139928 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84000bc00 con 0x7fc85006d3d0 2023-10-06T02:59:56.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc8562fc700 1 -- 172.21.15.27:0/2243139928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc85006d3d0 msgr2=0x7fc85006afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc8562fc700 1 --2- 172.21.15.27:0/2243139928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc85006d3d0 0x7fc85006afb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8400099b0 tx=0x7fc840009250 comp rx=0 tx=0).stop 2023-10-06T02:59:56.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc8562fc700 1 -- 172.21.15.27:0/2243139928 shutdown_connections 2023-10-06T02:59:56.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc8562fc700 1 --2- 172.21.15.27:0/2243139928 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc85014eb60 0x7fc85014ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc8562fc700 1 --2- 172.21.15.27:0/2243139928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc85006d3d0 0x7fc85006afb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc8562fc700 1 -- 172.21.15.27:0/2243139928 >> 172.21.15.27:0/2243139928 conn(0x7fc8500bee60 msgr2=0x7fc8500bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:56.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc8562fc700 1 -- 172.21.15.27:0/2243139928 shutdown_connections 2023-10-06T02:59:56.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.779+0000 7fc8562fc700 1 -- 172.21.15.27:0/2243139928 wait complete. 2023-10-06T02:59:56.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8562fc700 1 Processor -- start 2023-10-06T02:59:56.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8562fc700 1 -- start start 2023-10-06T02:59:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8562fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc85006d3d0 0x7fc8500b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8562fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85014eb60 0x7fc8500b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8562fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc85014f4d0 0x7fc85015e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8562fc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500b74e0 con 0x7fc85006d3d0 2023-10-06T02:59:56.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8562fc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85015f630 con 0x7fc85014eb60 2023-10-06T02:59:56.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8562fc700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500b8360 con 0x7fc85014f4d0 2023-10-06T02:59:56.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8552fa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc85006d3d0 0x7fc8500b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8552fa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc85006d3d0 0x7fc8500b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59148/0 (socket says 172.21.15.27:59148) 2023-10-06T02:59:56.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8552fa700 1 -- 172.21.15.27:0/519304075 learned_addr learned my addr 172.21.15.27:0/519304075 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:56.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc854af9700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85014eb60 0x7fc8500b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc855afb700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc85014f4d0 0x7fc85015e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8552fa700 1 -- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc85014f4d0 msgr2=0x7fc85015e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8552fa700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc85014f4d0 0x7fc85015e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8552fa700 1 -- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85014eb60 msgr2=0x7fc8500b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8552fa700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85014eb60 0x7fc8500b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8552fa700 1 -- 172.21.15.27:0/519304075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8400094f0 con 0x7fc85006d3d0 2023-10-06T02:59:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc855afb700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc85014f4d0 0x7fc85015e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8552fa700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc85006d3d0 0x7fc8500b4200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc840009290 tx=0x7fc840017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8457fa700 1 -- 172.21.15.27:0/519304075 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840011420 con 0x7fc85006d3d0 2023-10-06T02:59:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8457fa700 1 -- 172.21.15.27:0/519304075 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc840011580 con 0x7fc85006d3d0 2023-10-06T02:59:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8457fa700 1 -- 172.21.15.27:0/519304075 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840011920 con 0x7fc85006d3d0 2023-10-06T02:59:56.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8562fc700 1 -- 172.21.15.27:0/519304075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8500b8640 con 0x7fc85006d3d0 2023-10-06T02:59:56.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.783+0000 7fc8562fc700 1 -- 172.21.15.27:0/519304075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85014c600 con 0x7fc85006d3d0 2023-10-06T02:59:56.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.787+0000 7fc8457fa700 1 -- 172.21.15.27:0/519304075 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc840011d10 con 0x7fc85006d3d0 2023-10-06T02:59:56.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.787+0000 7fc8562fc700 1 -- 172.21.15.27:0/519304075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85014c850 con 0x7fc85006d3d0 2023-10-06T02:59:56.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.787+0000 7fc8457fa700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc834060550 0x7fc834062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.787+0000 7fc8457fa700 1 -- 172.21.15.27:0/519304075 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc84007e210 con 0x7fc85006d3d0 2023-10-06T02:59:56.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.787+0000 7fc854af9700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc834060550 0x7fc834062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.787+0000 7fc854af9700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc834060550 0x7fc834062a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8500b3d30 tx=0x7fc84c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:56.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.795+0000 7fc8457fa700 1 -- 172.21.15.27:0/519304075 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc84004e600 con 0x7fc85006d3d0 2023-10-06T02:59:56.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.951+0000 7fc8562fc700 1 -- 172.21.15.27:0/519304075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8500bbf90 con 0x7fc85006d3d0 2023-10-06T02:59:56.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.951+0000 7fc8457fa700 1 -- 172.21.15.27:0/519304075 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fc840051c20 con 0x7fc85006d3d0 2023-10-06T02:59:56.958 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:56.959 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":24,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:54.652472+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:59:47.570918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:51.949130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:52.638817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.955+0000 7fc8562fc700 1 -- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc834060550 msgr2=0x7fc834062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.955+0000 7fc8562fc700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc834060550 0x7fc834062a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8500b3d30 tx=0x7fc84c00b040 comp rx=0 tx=0).stop 2023-10-06T02:59:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.955+0000 7fc8562fc700 1 -- 172.21.15.27:0/519304075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc85006d3d0 msgr2=0x7fc8500b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.955+0000 7fc8562fc700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc85006d3d0 0x7fc8500b4200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc840009290 tx=0x7fc840017000 comp rx=0 tx=0).stop 2023-10-06T02:59:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.955+0000 7fc8562fc700 1 -- 172.21.15.27:0/519304075 shutdown_connections 2023-10-06T02:59:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.955+0000 7fc8562fc700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc834060550 0x7fc834062a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.955+0000 7fc8562fc700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc85014f4d0 0x7fc85015e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.955+0000 7fc8562fc700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85014eb60 0x7fc8500b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.955+0000 7fc8562fc700 1 --2- 172.21.15.27:0/519304075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc85006d3d0 0x7fc8500b4200 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.955+0000 7fc8562fc700 1 -- 172.21.15.27:0/519304075 >> 172.21.15.27:0/519304075 conn(0x7fc8500bee60 msgr2=0x7fc8500bd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:56.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.955+0000 7fc8562fc700 1 -- 172.21.15.27:0/519304075 shutdown_connections 2023-10-06T02:59:56.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:56.955+0000 7fc8562fc700 1 -- 172.21.15.27:0/519304075 wait complete. 2023-10-06T02:59:56.973 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:59:56.973 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:59:57.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5a46c700 1 Processor -- start 2023-10-06T02:59:57.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5a46c700 1 -- start start 2023-10-06T02:59:57.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5a46c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdb540be150 0x7fdb5406cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5a46c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb540a2310 con 0x7fdb540b5520 2023-10-06T02:59:57.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5a46c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb540a2680 con 0x7fdb5414eef0 2023-10-06T02:59:57.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5a46c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5406d0f0 con 0x7fdb540be150 2023-10-06T02:59:57.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb58c69700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdb540b5520 0x7fdb540b5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52232/0 (socket says 172.21.15.27:52232) 2023-10-06T02:59:57.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb58c69700 1 -- 172.21.15.27:0/2978379649 learned_addr learned my addr 172.21.15.27:0/2978379649 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:57.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5946a700 1 --2- 172.21.15.27:0/2978379649 >> v2:172.21.15.123:3300/0 conn(0x7fdb540be150 0x7fdb5406cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb4bfff700 1 -- 172.21.15.27:0/2978379649 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377643713 0 0) 0x7fdb540a2310 con 0x7fdb540b5520 2023-10-06T02:59:57.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb4bfff700 1 -- 172.21.15.27:0/2978379649 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb40003570 con 0x7fdb540b5520 2023-10-06T02:59:57.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb4bfff700 1 -- 172.21.15.27:0/2978379649 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304823793 0 0) 0x7fdb540a2680 con 0x7fdb5414eef0 2023-10-06T02:59:57.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb4bfff700 1 -- 172.21.15.27:0/2978379649 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb540a2310 con 0x7fdb5414eef0 2023-10-06T02:59:57.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5946a700 1 -- 172.21.15.27:0/2978379649 >> v1:172.21.15.123:6789/0 conn(0x7fdb5414eef0 legacy=0x7fdb5414f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5946a700 1 -- 172.21.15.27:0/2978379649 >> v1:172.21.15.27:6789/0 conn(0x7fdb540b5520 legacy=0x7fdb540b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5946a700 1 -- 172.21.15.27:0/2978379649 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb540bd1d0 con 0x7fdb540be150 2023-10-06T02:59:57.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5946a700 1 --2- 172.21.15.27:0/2978379649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb540be150 0x7fdb5406cbb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdb500098e0 tx=0x7fdb500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce57ac34827a08d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb4bfff700 1 -- 172.21.15.27:0/2978379649 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50011630 con 0x7fdb540be150 2023-10-06T02:59:57.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb4bfff700 1 -- 172.21.15.27:0/2978379649 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50011790 con 0x7fdb540be150 2023-10-06T02:59:57.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb4bfff700 1 -- 172.21.15.27:0/2978379649 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50011b10 con 0x7fdb540be150 2023-10-06T02:59:57.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5a46c700 1 -- 172.21.15.27:0/2978379649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb540be150 msgr2=0x7fdb5406cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5a46c700 1 --2- 172.21.15.27:0/2978379649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb540be150 0x7fdb5406cbb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdb500098e0 tx=0x7fdb500091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5a46c700 1 -- 172.21.15.27:0/2978379649 shutdown_connections 2023-10-06T02:59:57.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5a46c700 1 --2- 172.21.15.27:0/2978379649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb540be150 0x7fdb5406cbb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5a46c700 1 -- 172.21.15.27:0/2978379649 >> 172.21.15.27:0/2978379649 conn(0x7fdb540bf440 msgr2=0x7fdb5406df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:57.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5a46c700 1 -- 172.21.15.27:0/2978379649 shutdown_connections 2023-10-06T02:59:57.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.079+0000 7fdb5a46c700 1 -- 172.21.15.27:0/2978379649 wait complete. 2023-10-06T02:59:57.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5a46c700 1 Processor -- start 2023-10-06T02:59:57.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5a46c700 1 -- start start 2023-10-06T02:59:57.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5a46c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb540b5520 0x7fdb541517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5a46c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb540be150 0x7fdb5415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5a46c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdb5414eef0 0x7fdb54152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5a46c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb54150340 con 0x7fdb540b5520 2023-10-06T02:59:57.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5a46c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5415bf30 con 0x7fdb540be150 2023-10-06T02:59:57.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5a46c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb54153270 con 0x7fdb5414eef0 2023-10-06T02:59:57.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5946a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb540b5520 0x7fdb541517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5946a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb540b5520 0x7fdb541517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59150/0 (socket says 172.21.15.27:59150) 2023-10-06T02:59:57.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5946a700 1 -- 172.21.15.27:0/4273742498 learned_addr learned my addr 172.21.15.27:0/4273742498 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:57.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb58c69700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb540be150 0x7fdb5415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb59c6b700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdb5414eef0 0x7fdb54152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5946a700 1 -- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdb5414eef0 msgr2=0x7fdb54152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5946a700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdb5414eef0 0x7fdb54152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5946a700 1 -- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb540be150 msgr2=0x7fdb5415b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5946a700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb540be150 0x7fdb5415b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5946a700 1 -- 172.21.15.27:0/4273742498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50009420 con 0x7fdb540b5520 2023-10-06T02:59:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb58c69700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb540be150 0x7fdb5415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb59c6b700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdb5414eef0 0x7fdb54152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5946a700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb540b5520 0x7fdb541517b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009ed0 tx=0x7fdb50016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb497fa700 1 -- 172.21.15.27:0/4273742498 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50011b10 con 0x7fdb540b5520 2023-10-06T02:59:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb497fa700 1 -- 172.21.15.27:0/4273742498 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50000d10 con 0x7fdb540b5520 2023-10-06T02:59:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5a46c700 1 -- 172.21.15.27:0/4273742498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5415b8e0 con 0x7fdb540b5520 2023-10-06T02:59:57.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb497fa700 1 -- 172.21.15.27:0/4273742498 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5001a6a0 con 0x7fdb540b5520 2023-10-06T02:59:57.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.083+0000 7fdb5a46c700 1 -- 172.21.15.27:0/4273742498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5414abd0 con 0x7fdb540b5520 2023-10-06T02:59:57.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.087+0000 7fdb5a46c700 1 -- 172.21.15.27:0/4273742498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5415b750 con 0x7fdb540b5520 2023-10-06T02:59:57.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.087+0000 7fdb497fa700 1 -- 172.21.15.27:0/4273742498 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdb5001aa50 con 0x7fdb540b5520 2023-10-06T02:59:57.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.087+0000 7fdb497fa700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fdb38060550 0x7fdb38062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.087+0000 7fdb497fa700 1 -- 172.21.15.27:0/4273742498 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdb5007e540 con 0x7fdb540b5520 2023-10-06T02:59:57.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.087+0000 7fdb58c69700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fdb38060550 0x7fdb38062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.087+0000 7fdb58c69700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fdb38060550 0x7fdb38062a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdb5414cdf0 tx=0x7fdb44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.095+0000 7fdb497fa700 1 -- 172.21.15.27:0/4273742498 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdb5004ea90 con 0x7fdb540b5520 2023-10-06T02:59:57.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.251+0000 7fdb5a46c700 1 -- 172.21.15.27:0/4273742498 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb5415c070 con 0x7fdb38060550 2023-10-06T02:59:57.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.271+0000 7fdb497fa700 1 -- 172.21.15.27:0/4273742498 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286564 (secure 0 0 0) 0x7fdb4400f990 con 0x7fdb38060550 2023-10-06T02:59:57.279 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:57.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.275+0000 7fdb5a46c700 1 -- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fdb38060550 msgr2=0x7fdb38062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.275+0000 7fdb5a46c700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fdb38060550 0x7fdb38062a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdb5414cdf0 tx=0x7fdb44009040 comp rx=0 tx=0).stop 2023-10-06T02:59:57.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.275+0000 7fdb5a46c700 1 -- 172.21.15.27:0/4273742498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb540b5520 msgr2=0x7fdb541517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.275+0000 7fdb5a46c700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb540b5520 0x7fdb541517b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009ed0 tx=0x7fdb50016000 comp rx=0 tx=0).stop 2023-10-06T02:59:57.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.275+0000 7fdb5a46c700 1 -- 172.21.15.27:0/4273742498 shutdown_connections 2023-10-06T02:59:57.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.275+0000 7fdb5a46c700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fdb38060550 0x7fdb38062a00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.275+0000 7fdb5a46c700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdb5414eef0 0x7fdb54152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.275+0000 7fdb5a46c700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb540be150 0x7fdb5415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.275+0000 7fdb5a46c700 1 --2- 172.21.15.27:0/4273742498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb540b5520 0x7fdb541517b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.275+0000 7fdb5a46c700 1 -- 172.21.15.27:0/4273742498 >> 172.21.15.27:0/4273742498 conn(0x7fdb540bf440 msgr2=0x7fdb540b83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:57.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.275+0000 7fdb5a46c700 1 -- 172.21.15.27:0/4273742498 shutdown_connections 2023-10-06T02:59:57.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.275+0000 7fdb5a46c700 1 -- 172.21.15.27:0/4273742498 wait complete. 2023-10-06T02:59:57.283 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-10-06T02:59:57.295 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-06T02:59:56.961458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":198,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381512,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593208,"statfs":{"total":773094113280,"available":770655444992,"internally_reserved":0,"allocated":3284992,"data_stored":1937172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.703183"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684810+0000","last_change":"2023-10-06T02:59:53.681789+0000","last_active":"2023-10-06T02:59:53.684810+0000","last_peered":"2023-10-06T02:59:53.684810+0000","last_clean":"2023-10-06T02:59:53.684810+0000","last_became_active":"2023-10-06T02:59:53.681495+0000","last_became_peered":"2023-10-06T02:59:53.681495+0000","last_unstale":"2023-10-06T02:59:53.684810+0000","last_undegraded":"2023-10-06T02:59:53.684810+0000","last_fullsized":"2023-10-06T02:59:53.684810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:19.626429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.685709+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T02:59:53.685709+0000","last_peered":"2023-10-06T02:59:53.685709+0000","last_clean":"2023-10-06T02:59:53.685709+0000","last_became_active":"2023-10-06T02:59:53.681849+0000","last_became_peered":"2023-10-06T02:59:53.681849+0000","last_unstale":"2023-10-06T02:59:53.685709+0000","last_undegraded":"2023-10-06T02:59:53.685709+0000","last_fullsized":"2023-10-06T02:59:53.685709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684784+0000","last_change":"2023-10-06T02:59:53.679536+0000","last_active":"2023-10-06T02:59:53.684784+0000","last_peered":"2023-10-06T02:59:53.684784+0000","last_clean":"2023-10-06T02:59:53.684784+0000","last_became_active":"2023-10-06T02:59:53.678264+0000","last_became_peered":"2023-10-06T02:59:53.678264+0000","last_unstale":"2023-10-06T02:59:53.684784+0000","last_undegraded":"2023-10-06T02:59:53.684784+0000","last_fullsized":"2023-10-06T02:59:53.684784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:18.566933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.678088+0000","last_change":"2023-10-06T02:59:53.671821+0000","last_active":"2023-10-06T02:59:53.678088+0000","last_peered":"2023-10-06T02:59:53.678088+0000","last_clean":"2023-10-06T02:59:53.678088+0000","last_became_active":"2023-10-06T02:59:53.671555+0000","last_became_peered":"2023-10-06T02:59:53.671555+0000","last_unstale":"2023-10-06T02:59:53.678088+0000","last_undegraded":"2023-10-06T02:59:53.678088+0000","last_fullsized":"2023-10-06T02:59:53.678088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:36:28.006545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684527+0000","last_change":"2023-10-06T02:59:53.682691+0000","last_active":"2023-10-06T02:59:53.684527+0000","last_peered":"2023-10-06T02:59:53.684527+0000","last_clean":"2023-10-06T02:59:53.684527+0000","last_became_active":"2023-10-06T02:59:53.682399+0000","last_became_peered":"2023-10-06T02:59:53.682399+0000","last_unstale":"2023-10-06T02:59:53.684527+0000","last_undegraded":"2023-10-06T02:59:53.684527+0000","last_fullsized":"2023-10-06T02:59:53.684527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683184+0000","last_change":"2023-10-06T02:59:53.678208+0000","last_active":"2023-10-06T02:59:53.683184+0000","last_peered":"2023-10-06T02:59:53.683184+0000","last_clean":"2023-10-06T02:59:53.683184+0000","last_became_active":"2023-10-06T02:59:53.676481+0000","last_became_peered":"2023-10-06T02:59:53.676481+0000","last_unstale":"2023-10-06T02:59:53.683184+0000","last_undegraded":"2023-10-06T02:59:53.683184+0000","last_fullsized":"2023-10-06T02:59:53.683184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:42.767531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688401+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T02:59:53.688401+0000","last_peered":"2023-10-06T02:59:53.688401+0000","last_clean":"2023-10-06T02:59:53.688401+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T02:59:53.688401+0000","last_undegraded":"2023-10-06T02:59:53.688401+0000","last_fullsized":"2023-10-06T02:59:53.688401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688329+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T02:59:53.688329+0000","last_peered":"2023-10-06T02:59:53.688329+0000","last_clean":"2023-10-06T02:59:53.688329+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T02:59:53.688329+0000","last_undegraded":"2023-10-06T02:59:53.688329+0000","last_fullsized":"2023-10-06T02:59:53.688329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682066+0000","last_change":"2023-10-06T02:59:53.680395+0000","last_active":"2023-10-06T02:59:53.682066+0000","last_peered":"2023-10-06T02:59:53.682066+0000","last_clean":"2023-10-06T02:59:53.682066+0000","last_became_active":"2023-10-06T02:59:53.680086+0000","last_became_peered":"2023-10-06T02:59:53.680086+0000","last_unstale":"2023-10-06T02:59:53.682066+0000","last_undegraded":"2023-10-06T02:59:53.682066+0000","last_fullsized":"2023-10-06T02:59:53.682066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.680410+0000","last_change":"2023-10-06T02:59:53.675582+0000","last_active":"2023-10-06T02:59:53.680410+0000","last_peered":"2023-10-06T02:59:53.680410+0000","last_clean":"2023-10-06T02:59:53.680410+0000","last_became_active":"2023-10-06T02:59:53.675243+0000","last_became_peered":"2023-10-06T02:59:53.675243+0000","last_unstale":"2023-10-06T02:59:53.680410+0000","last_undegraded":"2023-10-06T02:59:53.680410+0000","last_fullsized":"2023-10-06T02:59:53.680410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684759+0000","last_change":"2023-10-06T02:59:53.679489+0000","last_active":"2023-10-06T02:59:53.684759+0000","last_peered":"2023-10-06T02:59:53.684759+0000","last_clean":"2023-10-06T02:59:53.684759+0000","last_became_active":"2023-10-06T02:59:53.678985+0000","last_became_peered":"2023-10-06T02:59:53.678985+0000","last_unstale":"2023-10-06T02:59:53.684759+0000","last_undegraded":"2023-10-06T02:59:53.684759+0000","last_fullsized":"2023-10-06T02:59:53.684759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:12.576010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684951+0000","last_change":"2023-10-06T02:59:53.682799+0000","last_active":"2023-10-06T02:59:53.684951+0000","last_peered":"2023-10-06T02:59:53.684951+0000","last_clean":"2023-10-06T02:59:53.684951+0000","last_became_active":"2023-10-06T02:59:53.682464+0000","last_became_peered":"2023-10-06T02:59:53.682464+0000","last_unstale":"2023-10-06T02:59:53.684951+0000","last_undegraded":"2023-10-06T02:59:53.684951+0000","last_fullsized":"2023-10-06T02:59:53.684951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:06.403449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683827+0000","last_change":"2023-10-06T02:59:53.678968+0000","last_active":"2023-10-06T02:59:53.683827+0000","last_peered":"2023-10-06T02:59:53.683827+0000","last_clean":"2023-10-06T02:59:53.683827+0000","last_became_active":"2023-10-06T02:59:53.678562+0000","last_became_peered":"2023-10-06T02:59:53.678562+0000","last_unstale":"2023-10-06T02:59:53.683827+0000","last_undegraded":"2023-10-06T02:59:53.683827+0000","last_fullsized":"2023-10-06T02:59:53.683827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:46.305158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.674814+0000","last_change":"2023-10-06T02:59:53.673321+0000","last_active":"2023-10-06T02:59:53.674814+0000","last_peered":"2023-10-06T02:59:53.674814+0000","last_clean":"2023-10-06T02:59:53.674814+0000","last_became_active":"2023-10-06T02:59:53.672957+0000","last_became_peered":"2023-10-06T02:59:53.672957+0000","last_unstale":"2023-10-06T02:59:53.674814+0000","last_undegraded":"2023-10-06T02:59:53.674814+0000","last_fullsized":"2023-10-06T02:59:53.674814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.689370+0000","last_change":"2023-10-06T02:59:53.686669+0000","last_active":"2023-10-06T02:59:53.689370+0000","last_peered":"2023-10-06T02:59:53.689370+0000","last_clean":"2023-10-06T02:59:53.689370+0000","last_became_active":"2023-10-06T02:59:53.686352+0000","last_became_peered":"2023-10-06T02:59:53.686352+0000","last_unstale":"2023-10-06T02:59:53.689370+0000","last_undegraded":"2023-10-06T02:59:53.689370+0000","last_fullsized":"2023-10-06T02:59:53.689370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684827+0000","last_change":"2023-10-06T02:59:53.680975+0000","last_active":"2023-10-06T02:59:53.684827+0000","last_peered":"2023-10-06T02:59:53.684827+0000","last_clean":"2023-10-06T02:59:53.684827+0000","last_became_active":"2023-10-06T02:59:53.678449+0000","last_became_peered":"2023-10-06T02:59:53.678449+0000","last_unstale":"2023-10-06T02:59:53.684827+0000","last_undegraded":"2023-10-06T02:59:53.684827+0000","last_fullsized":"2023-10-06T02:59:53.684827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:18.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682046+0000","last_change":"2023-10-06T02:59:53.680344+0000","last_active":"2023-10-06T02:59:53.682046+0000","last_peered":"2023-10-06T02:59:53.682046+0000","last_clean":"2023-10-06T02:59:53.682046+0000","last_became_active":"2023-10-06T02:59:53.680028+0000","last_became_peered":"2023-10-06T02:59:53.680028+0000","last_unstale":"2023-10-06T02:59:53.682046+0000","last_undegraded":"2023-10-06T02:59:53.682046+0000","last_fullsized":"2023-10-06T02:59:53.682046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682183+0000","last_change":"2023-10-06T02:59:53.678143+0000","last_active":"2023-10-06T02:59:53.682183+0000","last_peered":"2023-10-06T02:59:53.682183+0000","last_clean":"2023-10-06T02:59:53.682183+0000","last_became_active":"2023-10-06T02:59:53.676602+0000","last_became_peered":"2023-10-06T02:59:53.676602+0000","last_unstale":"2023-10-06T02:59:53.682183+0000","last_undegraded":"2023-10-06T02:59:53.682183+0000","last_fullsized":"2023-10-06T02:59:53.682183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:29.621147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.677525+0000","last_change":"2023-10-06T02:59:53.675935+0000","last_active":"2023-10-06T02:59:53.677525+0000","last_peered":"2023-10-06T02:59:53.677525+0000","last_clean":"2023-10-06T02:59:53.677525+0000","last_became_active":"2023-10-06T02:59:53.675657+0000","last_became_peered":"2023-10-06T02:59:53.675657+0000","last_unstale":"2023-10-06T02:59:53.677525+0000","last_undegraded":"2023-10-06T02:59:53.677525+0000","last_fullsized":"2023-10-06T02:59:53.677525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:56.862647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681975+0000","last_change":"2023-10-06T02:59:53.673043+0000","last_active":"2023-10-06T02:59:53.681975+0000","last_peered":"2023-10-06T02:59:53.681975+0000","last_clean":"2023-10-06T02:59:53.681975+0000","last_became_active":"2023-10-06T02:59:53.672690+0000","last_became_peered":"2023-10-06T02:59:53.672690+0000","last_unstale":"2023-10-06T02:59:53.681975+0000","last_undegraded":"2023-10-06T02:59:53.681975+0000","last_fullsized":"2023-10-06T02:59:53.681975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688445+0000","last_change":"2023-10-06T02:59:53.684492+0000","last_active":"2023-10-06T02:59:53.688445+0000","last_peered":"2023-10-06T02:59:53.688445+0000","last_clean":"2023-10-06T02:59:53.688445+0000","last_became_active":"2023-10-06T02:59:53.684145+0000","last_became_peered":"2023-10-06T02:59:53.684145+0000","last_unstale":"2023-10-06T02:59:53.688445+0000","last_undegraded":"2023-10-06T02:59:53.688445+0000","last_fullsized":"2023-10-06T02:59:53.688445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687097+0000","last_change":"2023-10-06T02:59:53.683256+0000","last_active":"2023-10-06T02:59:53.687097+0000","last_peered":"2023-10-06T02:59:53.687097+0000","last_clean":"2023-10-06T02:59:53.687097+0000","last_became_active":"2023-10-06T02:59:53.682948+0000","last_became_peered":"2023-10-06T02:59:53.682948+0000","last_unstale":"2023-10-06T02:59:53.687097+0000","last_undegraded":"2023-10-06T02:59:53.687097+0000","last_fullsized":"2023-10-06T02:59:53.687097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681303+0000","last_change":"2023-10-06T02:59:53.675936+0000","last_active":"2023-10-06T02:59:53.681303+0000","last_peered":"2023-10-06T02:59:53.681303+0000","last_clean":"2023-10-06T02:59:53.681303+0000","last_became_active":"2023-10-06T02:59:53.675319+0000","last_became_peered":"2023-10-06T02:59:53.675319+0000","last_unstale":"2023-10-06T02:59:53.681303+0000","last_undegraded":"2023-10-06T02:59:53.681303+0000","last_fullsized":"2023-10-06T02:59:53.681303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.689381+0000","last_change":"2023-10-06T02:59:53.686758+0000","last_active":"2023-10-06T02:59:53.689381+0000","last_peered":"2023-10-06T02:59:53.689381+0000","last_clean":"2023-10-06T02:59:53.689381+0000","last_became_active":"2023-10-06T02:59:53.686007+0000","last_became_peered":"2023-10-06T02:59:53.686007+0000","last_unstale":"2023-10-06T02:59:53.689381+0000","last_undegraded":"2023-10-06T02:59:53.689381+0000","last_fullsized":"2023-10-06T02:59:53.689381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.686023+0000","last_change":"2023-10-06T02:59:53.682853+0000","last_active":"2023-10-06T02:59:53.686023+0000","last_peered":"2023-10-06T02:59:53.686023+0000","last_clean":"2023-10-06T02:59:53.686023+0000","last_became_active":"2023-10-06T02:59:53.682511+0000","last_became_peered":"2023-10-06T02:59:53.682511+0000","last_unstale":"2023-10-06T02:59:53.686023+0000","last_undegraded":"2023-10-06T02:59:53.686023+0000","last_fullsized":"2023-10-06T02:59:53.686023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.685842+0000","last_change":"2023-10-06T02:59:53.682001+0000","last_active":"2023-10-06T02:59:53.685842+0000","last_peered":"2023-10-06T02:59:53.685842+0000","last_clean":"2023-10-06T02:59:53.685842+0000","last_became_active":"2023-10-06T02:59:53.681732+0000","last_became_peered":"2023-10-06T02:59:53.681732+0000","last_unstale":"2023-10-06T02:59:53.685842+0000","last_undegraded":"2023-10-06T02:59:53.685842+0000","last_fullsized":"2023-10-06T02:59:53.685842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.680523+0000","last_change":"2023-10-06T02:59:53.676598+0000","last_active":"2023-10-06T02:59:53.680523+0000","last_peered":"2023-10-06T02:59:53.680523+0000","last_clean":"2023-10-06T02:59:53.680523+0000","last_became_active":"2023-10-06T02:59:53.676284+0000","last_became_peered":"2023-10-06T02:59:53.676284+0000","last_unstale":"2023-10-06T02:59:53.680523+0000","last_undegraded":"2023-10-06T02:59:53.680523+0000","last_fullsized":"2023-10-06T02:59:53.680523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.690178+0000","last_change":"2023-10-06T02:59:53.687275+0000","last_active":"2023-10-06T02:59:53.690178+0000","last_peered":"2023-10-06T02:59:53.690178+0000","last_clean":"2023-10-06T02:59:53.690178+0000","last_became_active":"2023-10-06T02:59:53.686912+0000","last_became_peered":"2023-10-06T02:59:53.686912+0000","last_unstale":"2023-10-06T02:59:53.690178+0000","last_undegraded":"2023-10-06T02:59:53.690178+0000","last_fullsized":"2023-10-06T02:59:53.690178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687065+0000","last_change":"2023-10-06T02:59:53.685421+0000","last_active":"2023-10-06T02:59:53.687065+0000","last_peered":"2023-10-06T02:59:53.687065+0000","last_clean":"2023-10-06T02:59:53.687065+0000","last_became_active":"2023-10-06T02:59:53.684806+0000","last_became_peered":"2023-10-06T02:59:53.684806+0000","last_unstale":"2023-10-06T02:59:53.687065+0000","last_undegraded":"2023-10-06T02:59:53.687065+0000","last_fullsized":"2023-10-06T02:59:53.687065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682303+0000","last_change":"2023-10-06T02:59:53.676085+0000","last_active":"2023-10-06T02:59:53.682303+0000","last_peered":"2023-10-06T02:59:53.682303+0000","last_clean":"2023-10-06T02:59:53.682303+0000","last_became_active":"2023-10-06T02:59:53.675718+0000","last_became_peered":"2023-10-06T02:59:53.675718+0000","last_unstale":"2023-10-06T02:59:53.682303+0000","last_undegraded":"2023-10-06T02:59:53.682303+0000","last_fullsized":"2023-10-06T02:59:53.682303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:00.548441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681322+0000","last_change":"2023-10-06T02:59:53.676118+0000","last_active":"2023-10-06T02:59:53.681322+0000","last_peered":"2023-10-06T02:59:53.681322+0000","last_clean":"2023-10-06T02:59:53.681322+0000","last_became_active":"2023-10-06T02:59:53.675682+0000","last_became_peered":"2023-10-06T02:59:53.675682+0000","last_unstale":"2023-10-06T02:59:53.681322+0000","last_undegraded":"2023-10-06T02:59:53.681322+0000","last_fullsized":"2023-10-06T02:59:53.681322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.678043+0000","last_change":"2023-10-06T02:59:53.673225+0000","last_active":"2023-10-06T02:59:53.678043+0000","last_peered":"2023-10-06T02:59:53.678043+0000","last_clean":"2023-10-06T02:59:53.678043+0000","last_became_active":"2023-10-06T02:59:53.672930+0000","last_became_peered":"2023-10-06T02:59:53.672930+0000","last_unstale":"2023-10-06T02:59:53.678043+0000","last_undegraded":"2023-10-06T02:59:53.678043+0000","last_fullsized":"2023-10-06T02:59:53.678043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:02.845187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683926+0000","last_change":"2023-10-06T02:59:53.678742+0000","last_active":"2023-10-06T02:59:53.683926+0000","last_peered":"2023-10-06T02:59:53.683926+0000","last_clean":"2023-10-06T02:59:53.683926+0000","last_became_active":"2023-10-06T02:59:53.678471+0000","last_became_peered":"2023-10-06T02:59:53.678471+0000","last_unstale":"2023-10-06T02:59:53.683926+0000","last_undegraded":"2023-10-06T02:59:53.683926+0000","last_fullsized":"2023-10-06T02:59:53.683926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292803+0000","last_change":"2023-10-06T02:59:53.297136+0000","last_active":"2023-10-06T02:59:54.292803+0000","last_peered":"2023-10-06T02:59:54.292803+0000","last_clean":"2023-10-06T02:59:54.292803+0000","last_became_active":"2023-10-06T02:59:53.296816+0000","last_became_peered":"2023-10-06T02:59:53.296816+0000","last_unstale":"2023-10-06T02:59:54.292803+0000","last_undegraded":"2023-10-06T02:59:54.292803+0000","last_fullsized":"2023-10-06T02:59:54.292803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:58.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688369+0000","last_change":"2023-10-06T02:59:53.684876+0000","last_active":"2023-10-06T02:59:53.688369+0000","last_peered":"2023-10-06T02:59:53.688369+0000","last_clean":"2023-10-06T02:59:53.688369+0000","last_became_active":"2023-10-06T02:59:53.684522+0000","last_became_peered":"2023-10-06T02:59:53.684522+0000","last_unstale":"2023-10-06T02:59:53.688369+0000","last_undegraded":"2023-10-06T02:59:53.688369+0000","last_fullsized":"2023-10-06T02:59:53.688369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668295+0000","last_change":"2023-10-06T02:59:53.292700+0000","last_active":"2023-10-06T02:59:53.668295+0000","last_peered":"2023-10-06T02:59:53.668295+0000","last_clean":"2023-10-06T02:59:53.668295+0000","last_became_active":"2023-10-06T02:59:53.292378+0000","last_became_peered":"2023-10-06T02:59:53.292378+0000","last_unstale":"2023-10-06T02:59:53.668295+0000","last_undegraded":"2023-10-06T02:59:53.668295+0000","last_fullsized":"2023-10-06T02:59:53.668295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.677456+0000","last_change":"2023-10-06T02:59:53.675542+0000","last_active":"2023-10-06T02:59:53.677456+0000","last_peered":"2023-10-06T02:59:53.677456+0000","last_clean":"2023-10-06T02:59:53.677456+0000","last_became_active":"2023-10-06T02:59:53.675219+0000","last_became_peered":"2023-10-06T02:59:53.675219+0000","last_unstale":"2023-10-06T02:59:53.677456+0000","last_undegraded":"2023-10-06T02:59:53.677456+0000","last_fullsized":"2023-10-06T02:59:53.677456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.670933+0000","last_change":"2023-10-06T02:59:53.302122+0000","last_active":"2023-10-06T02:59:53.670933+0000","last_peered":"2023-10-06T02:59:53.670933+0000","last_clean":"2023-10-06T02:59:53.670933+0000","last_became_active":"2023-10-06T02:59:53.301737+0000","last_became_peered":"2023-10-06T02:59:53.301737+0000","last_unstale":"2023-10-06T02:59:53.670933+0000","last_undegraded":"2023-10-06T02:59:53.670933+0000","last_fullsized":"2023-10-06T02:59:53.670933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.686222+0000","last_change":"2023-10-06T02:59:53.684854+0000","last_active":"2023-10-06T02:59:53.686222+0000","last_peered":"2023-10-06T02:59:53.686222+0000","last_clean":"2023-10-06T02:59:53.686222+0000","last_became_active":"2023-10-06T02:59:53.684527+0000","last_became_peered":"2023-10-06T02:59:53.684527+0000","last_unstale":"2023-10-06T02:59:53.686222+0000","last_undegraded":"2023-10-06T02:59:53.686222+0000","last_fullsized":"2023-10-06T02:59:53.686222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.295747+0000","last_change":"2023-10-06T02:59:53.294103+0000","last_active":"2023-10-06T02:59:54.295747+0000","last_peered":"2023-10-06T02:59:54.295747+0000","last_clean":"2023-10-06T02:59:54.295747+0000","last_became_active":"2023-10-06T02:59:53.293707+0000","last_became_peered":"2023-10-06T02:59:53.293707+0000","last_unstale":"2023-10-06T02:59:54.295747+0000","last_undegraded":"2023-10-06T02:59:54.295747+0000","last_fullsized":"2023-10-06T02:59:54.295747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292846+0000","last_change":"2023-10-06T02:59:53.296507+0000","last_active":"2023-10-06T02:59:54.292846+0000","last_peered":"2023-10-06T02:59:54.292846+0000","last_clean":"2023-10-06T02:59:54.292846+0000","last_became_active":"2023-10-06T02:59:53.296230+0000","last_became_peered":"2023-10-06T02:59:53.296230+0000","last_unstale":"2023-10-06T02:59:54.292846+0000","last_undegraded":"2023-10-06T02:59:54.292846+0000","last_fullsized":"2023-10-06T02:59:54.292846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688349+0000","last_change":"2023-10-06T02:59:53.684046+0000","last_active":"2023-10-06T02:59:53.688349+0000","last_peered":"2023-10-06T02:59:53.688349+0000","last_clean":"2023-10-06T02:59:53.688349+0000","last_became_active":"2023-10-06T02:59:53.683705+0000","last_became_peered":"2023-10-06T02:59:53.683705+0000","last_unstale":"2023-10-06T02:59:53.688349+0000","last_undegraded":"2023-10-06T02:59:53.688349+0000","last_fullsized":"2023-10-06T02:59:53.688349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292725+0000","last_change":"2023-10-06T02:59:53.296465+0000","last_active":"2023-10-06T02:59:54.292725+0000","last_peered":"2023-10-06T02:59:54.292725+0000","last_clean":"2023-10-06T02:59:54.292725+0000","last_became_active":"2023-10-06T02:59:53.296225+0000","last_became_peered":"2023-10-06T02:59:53.296225+0000","last_unstale":"2023-10-06T02:59:54.292725+0000","last_undegraded":"2023-10-06T02:59:54.292725+0000","last_fullsized":"2023-10-06T02:59:54.292725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688679+0000","last_change":"2023-10-06T02:59:53.683216+0000","last_active":"2023-10-06T02:59:53.688679+0000","last_peered":"2023-10-06T02:59:53.688679+0000","last_clean":"2023-10-06T02:59:53.688679+0000","last_became_active":"2023-10-06T02:59:53.682938+0000","last_became_peered":"2023-10-06T02:59:53.682938+0000","last_unstale":"2023-10-06T02:59:53.688679+0000","last_undegraded":"2023-10-06T02:59:53.688679+0000","last_fullsized":"2023-10-06T02:59:53.688679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292905+0000","last_change":"2023-10-06T02:59:53.293929+0000","last_active":"2023-10-06T02:59:54.292905+0000","last_peered":"2023-10-06T02:59:54.292905+0000","last_clean":"2023-10-06T02:59:54.292905+0000","last_became_active":"2023-10-06T02:59:53.293602+0000","last_became_peered":"2023-10-06T02:59:53.293602+0000","last_unstale":"2023-10-06T02:59:54.292905+0000","last_undegraded":"2023-10-06T02:59:54.292905+0000","last_fullsized":"2023-10-06T02:59:54.292905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.677911+0000","last_change":"2023-10-06T02:59:53.672111+0000","last_active":"2023-10-06T02:59:53.677911+0000","last_peered":"2023-10-06T02:59:53.677911+0000","last_clean":"2023-10-06T02:59:53.677911+0000","last_became_active":"2023-10-06T02:59:53.671511+0000","last_became_peered":"2023-10-06T02:59:53.671511+0000","last_unstale":"2023-10-06T02:59:53.677911+0000","last_undegraded":"2023-10-06T02:59:53.677911+0000","last_fullsized":"2023-10-06T02:59:53.677911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668804+0000","last_change":"2023-10-06T02:59:53.300059+0000","last_active":"2023-10-06T02:59:53.668804+0000","last_peered":"2023-10-06T02:59:53.668804+0000","last_clean":"2023-10-06T02:59:53.668804+0000","last_became_active":"2023-10-06T02:59:53.299715+0000","last_became_peered":"2023-10-06T02:59:53.299715+0000","last_unstale":"2023-10-06T02:59:53.668804+0000","last_undegraded":"2023-10-06T02:59:53.668804+0000","last_fullsized":"2023-10-06T02:59:53.668804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687172+0000","last_change":"2023-10-06T02:59:53.683331+0000","last_active":"2023-10-06T02:59:53.687172+0000","last_peered":"2023-10-06T02:59:53.687172+0000","last_clean":"2023-10-06T02:59:53.687172+0000","last_became_active":"2023-10-06T02:59:53.682994+0000","last_became_peered":"2023-10-06T02:59:53.682994+0000","last_unstale":"2023-10-06T02:59:53.687172+0000","last_undegraded":"2023-10-06T02:59:53.687172+0000","last_fullsized":"2023-10-06T02:59:53.687172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.288613+0000","last_change":"2023-10-06T02:59:53.301126+0000","last_active":"2023-10-06T02:59:54.288613+0000","last_peered":"2023-10-06T02:59:54.288613+0000","last_clean":"2023-10-06T02:59:54.288613+0000","last_became_active":"2023-10-06T02:59:53.300850+0000","last_became_peered":"2023-10-06T02:59:53.300850+0000","last_unstale":"2023-10-06T02:59:54.288613+0000","last_undegraded":"2023-10-06T02:59:54.288613+0000","last_fullsized":"2023-10-06T02:59:54.288613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684480+0000","last_change":"2023-10-06T02:59:53.678930+0000","last_active":"2023-10-06T02:59:53.684480+0000","last_peered":"2023-10-06T02:59:53.684480+0000","last_clean":"2023-10-06T02:59:53.684480+0000","last_became_active":"2023-10-06T02:59:53.678630+0000","last_became_peered":"2023-10-06T02:59:53.678630+0000","last_unstale":"2023-10-06T02:59:53.684480+0000","last_undegraded":"2023-10-06T02:59:53.684480+0000","last_fullsized":"2023-10-06T02:59:53.684480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:14.961350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.662824+0000","last_change":"2023-10-06T02:59:53.291521+0000","last_active":"2023-10-06T02:59:53.662824+0000","last_peered":"2023-10-06T02:59:53.662824+0000","last_clean":"2023-10-06T02:59:53.662824+0000","last_became_active":"2023-10-06T02:59:53.290773+0000","last_became_peered":"2023-10-06T02:59:53.290773+0000","last_unstale":"2023-10-06T02:59:53.662824+0000","last_undegraded":"2023-10-06T02:59:53.662824+0000","last_fullsized":"2023-10-06T02:59:53.662824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682164+0000","last_change":"2023-10-06T02:59:53.678188+0000","last_active":"2023-10-06T02:59:53.682164+0000","last_peered":"2023-10-06T02:59:53.682164+0000","last_clean":"2023-10-06T02:59:53.682164+0000","last_became_active":"2023-10-06T02:59:53.676507+0000","last_became_peered":"2023-10-06T02:59:53.676507+0000","last_unstale":"2023-10-06T02:59:53.682164+0000","last_undegraded":"2023-10-06T02:59:53.682164+0000","last_fullsized":"2023-10-06T02:59:53.682164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.672575+0000","last_change":"2023-10-06T02:59:53.289980+0000","last_active":"2023-10-06T02:59:53.672575+0000","last_peered":"2023-10-06T02:59:53.672575+0000","last_clean":"2023-10-06T02:59:53.672575+0000","last_became_active":"2023-10-06T02:59:53.288601+0000","last_became_peered":"2023-10-06T02:59:53.288601+0000","last_unstale":"2023-10-06T02:59:53.672575+0000","last_undegraded":"2023-10-06T02:59:53.672575+0000","last_fullsized":"2023-10-06T02:59:53.672575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:54.630392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681947+0000","last_change":"2023-10-06T02:59:53.675456+0000","last_active":"2023-10-06T02:59:53.681947+0000","last_peered":"2023-10-06T02:59:53.681947+0000","last_clean":"2023-10-06T02:59:53.681947+0000","last_became_active":"2023-10-06T02:59:53.673268+0000","last_became_peered":"2023-10-06T02:59:53.673268+0000","last_unstale":"2023-10-06T02:59:53.681947+0000","last_undegraded":"2023-10-06T02:59:53.681947+0000","last_fullsized":"2023-10-06T02:59:53.681947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.658166+0000","last_change":"2023-10-06T02:59:53.298398+0000","last_active":"2023-10-06T02:59:53.658166+0000","last_peered":"2023-10-06T02:59:53.658166+0000","last_clean":"2023-10-06T02:59:53.658166+0000","last_became_active":"2023-10-06T02:59:53.297896+0000","last_became_peered":"2023-10-06T02:59:53.297896+0000","last_unstale":"2023-10-06T02:59:53.658166+0000","last_undegraded":"2023-10-06T02:59:53.658166+0000","last_fullsized":"2023-10-06T02:59:53.658166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684745+0000","last_change":"2023-10-06T02:59:53.679712+0000","last_active":"2023-10-06T02:59:53.684745+0000","last_peered":"2023-10-06T02:59:53.684745+0000","last_clean":"2023-10-06T02:59:53.684745+0000","last_became_active":"2023-10-06T02:59:53.679390+0000","last_became_peered":"2023-10-06T02:59:53.679390+0000","last_unstale":"2023-10-06T02:59:53.684745+0000","last_undegraded":"2023-10-06T02:59:53.684745+0000","last_fullsized":"2023-10-06T02:59:53.684745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.674991+0000","last_change":"2023-10-06T02:59:44.074625+0000","last_active":"2023-10-06T02:59:53.674991+0000","last_peered":"2023-10-06T02:59:53.674991+0000","last_clean":"2023-10-06T02:59:53.674991+0000","last_became_active":"2023-10-06T02:59:44.072854+0000","last_became_peered":"2023-10-06T02:59:44.072854+0000","last_unstale":"2023-10-06T02:59:53.674991+0000","last_undegraded":"2023-10-06T02:59:53.674991+0000","last_fullsized":"2023-10-06T02:59:53.674991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_clean_scrub_stamp":"2023-10-06T02:59:43.039151+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:04.936706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668581+0000","last_change":"2023-10-06T02:59:49.107090+0000","last_active":"2023-10-06T02:59:53.668581+0000","last_peered":"2023-10-06T02:59:53.668581+0000","last_clean":"2023-10-06T02:59:53.668581+0000","last_became_active":"2023-10-06T02:59:49.106619+0000","last_became_peered":"2023-10-06T02:59:49.106619+0000","last_unstale":"2023-10-06T02:59:53.668581+0000","last_undegraded":"2023-10-06T02:59:53.668581+0000","last_fullsized":"2023-10-06T02:59:53.668581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.658030+0000","last_change":"2023-10-06T02:59:53.298769+0000","last_active":"2023-10-06T02:59:53.658030+0000","last_peered":"2023-10-06T02:59:53.658030+0000","last_clean":"2023-10-06T02:59:53.658030+0000","last_became_active":"2023-10-06T02:59:53.298012+0000","last_became_peered":"2023-10-06T02:59:53.298012+0000","last_unstale":"2023-10-06T02:59:53.658030+0000","last_undegraded":"2023-10-06T02:59:53.658030+0000","last_fullsized":"2023-10-06T02:59:53.658030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681729+0000","last_change":"2023-10-06T02:59:53.679625+0000","last_active":"2023-10-06T02:59:53.681729+0000","last_peered":"2023-10-06T02:59:53.681729+0000","last_clean":"2023-10-06T02:59:53.681729+0000","last_became_active":"2023-10-06T02:59:53.679200+0000","last_became_peered":"2023-10-06T02:59:53.679200+0000","last_unstale":"2023-10-06T02:59:53.681729+0000","last_undegraded":"2023-10-06T02:59:53.681729+0000","last_fullsized":"2023-10-06T02:59:53.681729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:59.309901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.671317+0000","last_change":"2023-10-06T02:59:49.107231+0000","last_active":"2023-10-06T02:59:53.671317+0000","last_peered":"2023-10-06T02:59:53.671317+0000","last_clean":"2023-10-06T02:59:53.671317+0000","last_became_active":"2023-10-06T02:59:49.106878+0000","last_became_peered":"2023-10-06T02:59:49.106878+0000","last_unstale":"2023-10-06T02:59:53.671317+0000","last_undegraded":"2023-10-06T02:59:53.671317+0000","last_fullsized":"2023-10-06T02:59:53.671317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668411+0000","last_change":"2023-10-06T02:59:53.296937+0000","last_active":"2023-10-06T02:59:53.668411+0000","last_peered":"2023-10-06T02:59:53.668411+0000","last_clean":"2023-10-06T02:59:53.668411+0000","last_became_active":"2023-10-06T02:59:53.296171+0000","last_became_peered":"2023-10-06T02:59:53.296171+0000","last_unstale":"2023-10-06T02:59:53.668411+0000","last_undegraded":"2023-10-06T02:59:53.668411+0000","last_fullsized":"2023-10-06T02:59:53.668411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684479+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T02:59:53.684479+0000","last_peered":"2023-10-06T02:59:53.684479+0000","last_clean":"2023-10-06T02:59:53.684479+0000","last_became_active":"2023-10-06T02:59:53.681786+0000","last_became_peered":"2023-10-06T02:59:53.681786+0000","last_unstale":"2023-10-06T02:59:53.684479+0000","last_undegraded":"2023-10-06T02:59:53.684479+0000","last_fullsized":"2023-10-06T02:59:53.684479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669847+0000","last_change":"2023-10-06T02:59:49.115200+0000","last_active":"2023-10-06T02:59:53.669847+0000","last_peered":"2023-10-06T02:59:53.669847+0000","last_clean":"2023-10-06T02:59:53.669847+0000","last_became_active":"2023-10-06T02:59:49.114769+0000","last_became_peered":"2023-10-06T02:59:49.114769+0000","last_unstale":"2023-10-06T02:59:53.669847+0000","last_undegraded":"2023-10-06T02:59:53.669847+0000","last_fullsized":"2023-10-06T02:59:53.669847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:37.773233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.665174+0000","last_change":"2023-10-06T02:59:53.298658+0000","last_active":"2023-10-06T02:59:53.665174+0000","last_peered":"2023-10-06T02:59:53.665174+0000","last_clean":"2023-10-06T02:59:53.665174+0000","last_became_active":"2023-10-06T02:59:53.298054+0000","last_became_peered":"2023-10-06T02:59:53.298054+0000","last_unstale":"2023-10-06T02:59:53.665174+0000","last_undegraded":"2023-10-06T02:59:53.665174+0000","last_fullsized":"2023-10-06T02:59:53.665174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681569+0000","last_change":"2023-10-06T02:59:53.673950+0000","last_active":"2023-10-06T02:59:53.681569+0000","last_peered":"2023-10-06T02:59:53.681569+0000","last_clean":"2023-10-06T02:59:53.681569+0000","last_became_active":"2023-10-06T02:59:53.673677+0000","last_became_peered":"2023-10-06T02:59:53.673677+0000","last_unstale":"2023-10-06T02:59:53.681569+0000","last_undegraded":"2023-10-06T02:59:53.681569+0000","last_fullsized":"2023-10-06T02:59:53.681569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668455+0000","last_change":"2023-10-06T02:59:49.107944+0000","last_active":"2023-10-06T02:59:53.668455+0000","last_peered":"2023-10-06T02:59:53.668455+0000","last_clean":"2023-10-06T02:59:53.668455+0000","last_became_active":"2023-10-06T02:59:49.107560+0000","last_became_peered":"2023-10-06T02:59:49.107560+0000","last_unstale":"2023-10-06T02:59:53.668455+0000","last_undegraded":"2023-10-06T02:59:53.668455+0000","last_fullsized":"2023-10-06T02:59:53.668455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.671674+0000","last_change":"2023-10-06T02:59:53.300945+0000","last_active":"2023-10-06T02:59:53.671674+0000","last_peered":"2023-10-06T02:59:53.671674+0000","last_clean":"2023-10-06T02:59:53.671674+0000","last_became_active":"2023-10-06T02:59:53.300609+0000","last_became_peered":"2023-10-06T02:59:53.300609+0000","last_unstale":"2023-10-06T02:59:53.671674+0000","last_undegraded":"2023-10-06T02:59:53.671674+0000","last_fullsized":"2023-10-06T02:59:53.671674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682292+0000","last_change":"2023-10-06T02:59:53.677554+0000","last_active":"2023-10-06T02:59:53.682292+0000","last_peered":"2023-10-06T02:59:53.682292+0000","last_clean":"2023-10-06T02:59:53.682292+0000","last_became_active":"2023-10-06T02:59:53.677245+0000","last_became_peered":"2023-10-06T02:59:53.677245+0000","last_unstale":"2023-10-06T02:59:53.682292+0000","last_undegraded":"2023-10-06T02:59:53.682292+0000","last_fullsized":"2023-10-06T02:59:53.682292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668605+0000","last_change":"2023-10-06T02:59:53.301191+0000","last_active":"2023-10-06T02:59:53.668605+0000","last_peered":"2023-10-06T02:59:53.668605+0000","last_clean":"2023-10-06T02:59:53.668605+0000","last_became_active":"2023-10-06T02:59:53.300919+0000","last_became_peered":"2023-10-06T02:59:53.300919+0000","last_unstale":"2023-10-06T02:59:53.668605+0000","last_undegraded":"2023-10-06T02:59:53.668605+0000","last_fullsized":"2023-10-06T02:59:53.668605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669826+0000","last_change":"2023-10-06T02:59:49.108499+0000","last_active":"2023-10-06T02:59:53.669826+0000","last_peered":"2023-10-06T02:59:53.669826+0000","last_clean":"2023-10-06T02:59:53.669826+0000","last_became_active":"2023-10-06T02:59:49.107967+0000","last_became_peered":"2023-10-06T02:59:49.107967+0000","last_unstale":"2023-10-06T02:59:53.669826+0000","last_undegraded":"2023-10-06T02:59:53.669826+0000","last_fullsized":"2023-10-06T02:59:53.669826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682251+0000","last_change":"2023-10-06T02:59:53.676753+0000","last_active":"2023-10-06T02:59:53.682251+0000","last_peered":"2023-10-06T02:59:53.682251+0000","last_clean":"2023-10-06T02:59:53.682251+0000","last_became_active":"2023-10-06T02:59:53.676385+0000","last_became_peered":"2023-10-06T02:59:53.676385+0000","last_unstale":"2023-10-06T02:59:53.682251+0000","last_undegraded":"2023-10-06T02:59:53.682251+0000","last_fullsized":"2023-10-06T02:59:53.682251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669538+0000","last_change":"2023-10-06T02:59:53.303221+0000","last_active":"2023-10-06T02:59:53.669538+0000","last_peered":"2023-10-06T02:59:53.669538+0000","last_clean":"2023-10-06T02:59:53.669538+0000","last_became_active":"2023-10-06T02:59:53.302890+0000","last_became_peered":"2023-10-06T02:59:53.302890+0000","last_unstale":"2023-10-06T02:59:53.669538+0000","last_undegraded":"2023-10-06T02:59:53.669538+0000","last_fullsized":"2023-10-06T02:59:53.669538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.670899+0000","last_change":"2023-10-06T02:59:49.102005+0000","last_active":"2023-10-06T02:59:53.670899+0000","last_peered":"2023-10-06T02:59:53.670899+0000","last_clean":"2023-10-06T02:59:53.670899+0000","last_became_active":"2023-10-06T02:59:49.101530+0000","last_became_peered":"2023-10-06T02:59:49.101530+0000","last_unstale":"2023-10-06T02:59:53.670899+0000","last_undegraded":"2023-10-06T02:59:53.670899+0000","last_fullsized":"2023-10-06T02:59:53.670899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.675026+0000","last_change":"2023-10-06T02:59:53.672581+0000","last_active":"2023-10-06T02:59:53.675026+0000","last_peered":"2023-10-06T02:59:53.675026+0000","last_clean":"2023-10-06T02:59:53.675026+0000","last_became_active":"2023-10-06T02:59:53.672299+0000","last_became_peered":"2023-10-06T02:59:53.672299+0000","last_unstale":"2023-10-06T02:59:53.675026+0000","last_undegraded":"2023-10-06T02:59:53.675026+0000","last_fullsized":"2023-10-06T02:59:53.675026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.293712+0000","last_change":"2023-10-06T02:59:53.300135+0000","last_active":"2023-10-06T02:59:54.293712+0000","last_peered":"2023-10-06T02:59:54.293712+0000","last_clean":"2023-10-06T02:59:54.293712+0000","last_became_active":"2023-10-06T02:59:53.299271+0000","last_became_peered":"2023-10-06T02:59:53.299271+0000","last_unstale":"2023-10-06T02:59:54.293712+0000","last_undegraded":"2023-10-06T02:59:54.293712+0000","last_fullsized":"2023-10-06T02:59:54.293712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.672088+0000","last_change":"2023-10-06T02:59:49.100171+0000","last_active":"2023-10-06T02:59:53.672088+0000","last_peered":"2023-10-06T02:59:53.672088+0000","last_clean":"2023-10-06T02:59:53.672088+0000","last_became_active":"2023-10-06T02:59:49.099689+0000","last_became_peered":"2023-10-06T02:59:49.099689+0000","last_unstale":"2023-10-06T02:59:53.672088+0000","last_undegraded":"2023-10-06T02:59:53.672088+0000","last_fullsized":"2023-10-06T02:59:53.672088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687100+0000","last_change":"2023-10-06T02:59:53.685270+0000","last_active":"2023-10-06T02:59:53.687100+0000","last_peered":"2023-10-06T02:59:53.687100+0000","last_clean":"2023-10-06T02:59:53.687100+0000","last_became_active":"2023-10-06T02:59:53.684983+0000","last_became_peered":"2023-10-06T02:59:53.684983+0000","last_unstale":"2023-10-06T02:59:53.687100+0000","last_undegraded":"2023-10-06T02:59:53.687100+0000","last_fullsized":"2023-10-06T02:59:53.687100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:49.904101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668939+0000","last_change":"2023-10-06T02:59:53.301048+0000","last_active":"2023-10-06T02:59:53.668939+0000","last_peered":"2023-10-06T02:59:53.668939+0000","last_clean":"2023-10-06T02:59:53.668939+0000","last_became_active":"2023-10-06T02:59:53.300086+0000","last_became_peered":"2023-10-06T02:59:53.300086+0000","last_unstale":"2023-10-06T02:59:53.668939+0000","last_undegraded":"2023-10-06T02:59:53.668939+0000","last_fullsized":"2023-10-06T02:59:53.668939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.663390+0000","last_change":"2023-10-06T02:59:49.102935+0000","last_active":"2023-10-06T02:59:53.663390+0000","last_peered":"2023-10-06T02:59:53.663390+0000","last_clean":"2023-10-06T02:59:53.663390+0000","last_became_active":"2023-10-06T02:59:49.102397+0000","last_became_peered":"2023-10-06T02:59:49.102397+0000","last_unstale":"2023-10-06T02:59:53.663390+0000","last_undegraded":"2023-10-06T02:59:53.663390+0000","last_fullsized":"2023-10-06T02:59:53.663390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683104+0000","last_change":"2023-10-06T02:59:53.676229+0000","last_active":"2023-10-06T02:59:53.683104+0000","last_peered":"2023-10-06T02:59:53.683104+0000","last_clean":"2023-10-06T02:59:53.683104+0000","last_became_active":"2023-10-06T02:59:53.675895+0000","last_became_peered":"2023-10-06T02:59:53.675895+0000","last_unstale":"2023-10-06T02:59:53.683104+0000","last_undegraded":"2023-10-06T02:59:53.683104+0000","last_fullsized":"2023-10-06T02:59:53.683104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:03.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682155+0000","last_change":"2023-10-06T02:59:53.676843+0000","last_active":"2023-10-06T02:59:53.682155+0000","last_peered":"2023-10-06T02:59:53.682155+0000","last_clean":"2023-10-06T02:59:53.682155+0000","last_became_active":"2023-10-06T02:59:53.676528+0000","last_became_peered":"2023-10-06T02:59:53.676528+0000","last_unstale":"2023-10-06T02:59:53.682155+0000","last_undegraded":"2023-10-06T02:59:53.682155+0000","last_fullsized":"2023-10-06T02:59:53.682155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.296186+0000","last_change":"2023-10-06T02:59:53.294557+0000","last_active":"2023-10-06T02:59:54.296186+0000","last_peered":"2023-10-06T02:59:54.296186+0000","last_clean":"2023-10-06T02:59:54.296186+0000","last_became_active":"2023-10-06T02:59:53.291434+0000","last_became_peered":"2023-10-06T02:59:53.291434+0000","last_unstale":"2023-10-06T02:59:54.296186+0000","last_undegraded":"2023-10-06T02:59:54.296186+0000","last_fullsized":"2023-10-06T02:59:54.296186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684770+0000","last_change":"2023-10-06T02:59:53.678204+0000","last_active":"2023-10-06T02:59:53.684770+0000","last_peered":"2023-10-06T02:59:53.684770+0000","last_clean":"2023-10-06T02:59:53.684770+0000","last_became_active":"2023-10-06T02:59:53.677924+0000","last_became_peered":"2023-10-06T02:59:53.677924+0000","last_unstale":"2023-10-06T02:59:53.684770+0000","last_undegraded":"2023-10-06T02:59:53.684770+0000","last_fullsized":"2023-10-06T02:59:53.684770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292832+0000","last_change":"2023-10-06T02:59:53.301253+0000","last_active":"2023-10-06T02:59:54.292832+0000","last_peered":"2023-10-06T02:59:54.292832+0000","last_clean":"2023-10-06T02:59:54.292832+0000","last_became_active":"2023-10-06T02:59:53.300926+0000","last_became_peered":"2023-10-06T02:59:53.300926+0000","last_unstale":"2023-10-06T02:59:54.292832+0000","last_undegraded":"2023-10-06T02:59:54.292832+0000","last_fullsized":"2023-10-06T02:59:54.292832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:21.432516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668818+0000","last_change":"2023-10-06T02:59:53.292844+0000","last_active":"2023-10-06T02:59:53.668818+0000","last_peered":"2023-10-06T02:59:53.668818+0000","last_clean":"2023-10-06T02:59:53.668818+0000","last_became_active":"2023-10-06T02:59:53.292493+0000","last_became_peered":"2023-10-06T02:59:53.292493+0000","last_unstale":"2023-10-06T02:59:53.668818+0000","last_undegraded":"2023-10-06T02:59:53.668818+0000","last_fullsized":"2023-10-06T02:59:53.668818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681376+0000","last_change":"2023-10-06T02:59:53.676684+0000","last_active":"2023-10-06T02:59:53.681376+0000","last_peered":"2023-10-06T02:59:53.681376+0000","last_clean":"2023-10-06T02:59:53.681376+0000","last_became_active":"2023-10-06T02:59:53.676410+0000","last_became_peered":"2023-10-06T02:59:53.676410+0000","last_unstale":"2023-10-06T02:59:53.681376+0000","last_undegraded":"2023-10-06T02:59:53.681376+0000","last_fullsized":"2023-10-06T02:59:53.681376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668711+0000","last_change":"2023-10-06T02:59:53.293924+0000","last_active":"2023-10-06T02:59:53.668711+0000","last_peered":"2023-10-06T02:59:53.668711+0000","last_clean":"2023-10-06T02:59:53.668711+0000","last_became_active":"2023-10-06T02:59:53.293596+0000","last_became_peered":"2023-10-06T02:59:53.293596+0000","last_unstale":"2023-10-06T02:59:53.668711+0000","last_undegraded":"2023-10-06T02:59:53.668711+0000","last_fullsized":"2023-10-06T02:59:53.668711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681521+0000","last_change":"2023-10-06T02:59:53.673847+0000","last_active":"2023-10-06T02:59:53.681521+0000","last_peered":"2023-10-06T02:59:53.681521+0000","last_clean":"2023-10-06T02:59:53.681521+0000","last_became_active":"2023-10-06T02:59:53.673559+0000","last_became_peered":"2023-10-06T02:59:53.673559+0000","last_unstale":"2023-10-06T02:59:53.681521+0000","last_undegraded":"2023-10-06T02:59:53.681521+0000","last_fullsized":"2023-10-06T02:59:53.681521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.678028+0000","last_change":"2023-10-06T02:59:53.674388+0000","last_active":"2023-10-06T02:59:53.678028+0000","last_peered":"2023-10-06T02:59:53.678028+0000","last_clean":"2023-10-06T02:59:53.678028+0000","last_became_active":"2023-10-06T02:59:53.674086+0000","last_became_peered":"2023-10-06T02:59:53.674086+0000","last_unstale":"2023-10-06T02:59:53.678028+0000","last_undegraded":"2023-10-06T02:59:53.678028+0000","last_fullsized":"2023-10-06T02:59:53.678028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.658043+0000","last_change":"2023-10-06T02:59:53.296871+0000","last_active":"2023-10-06T02:59:53.658043+0000","last_peered":"2023-10-06T02:59:53.658043+0000","last_clean":"2023-10-06T02:59:53.658043+0000","last_became_active":"2023-10-06T02:59:53.296550+0000","last_became_peered":"2023-10-06T02:59:53.296550+0000","last_unstale":"2023-10-06T02:59:53.658043+0000","last_undegraded":"2023-10-06T02:59:53.658043+0000","last_fullsized":"2023-10-06T02:59:53.658043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687227+0000","last_change":"2023-10-06T02:59:53.683771+0000","last_active":"2023-10-06T02:59:53.687227+0000","last_peered":"2023-10-06T02:59:53.687227+0000","last_clean":"2023-10-06T02:59:53.687227+0000","last_became_active":"2023-10-06T02:59:53.683458+0000","last_became_peered":"2023-10-06T02:59:53.683458+0000","last_unstale":"2023-10-06T02:59:53.687227+0000","last_undegraded":"2023-10-06T02:59:53.687227+0000","last_fullsized":"2023-10-06T02:59:53.687227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669694+0000","last_change":"2023-10-06T02:59:53.301158+0000","last_active":"2023-10-06T02:59:53.669694+0000","last_peered":"2023-10-06T02:59:53.669694+0000","last_clean":"2023-10-06T02:59:53.669694+0000","last_became_active":"2023-10-06T02:59:53.300797+0000","last_became_peered":"2023-10-06T02:59:53.300797+0000","last_unstale":"2023-10-06T02:59:53.669694+0000","last_undegraded":"2023-10-06T02:59:53.669694+0000","last_fullsized":"2023-10-06T02:59:53.669694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.686119+0000","last_change":"2023-10-06T02:59:53.683576+0000","last_active":"2023-10-06T02:59:53.686119+0000","last_peered":"2023-10-06T02:59:53.686119+0000","last_clean":"2023-10-06T02:59:53.686119+0000","last_became_active":"2023-10-06T02:59:53.683301+0000","last_became_peered":"2023-10-06T02:59:53.683301+0000","last_unstale":"2023-10-06T02:59:53.686119+0000","last_undegraded":"2023-10-06T02:59:53.686119+0000","last_fullsized":"2023-10-06T02:59:53.686119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.290397+0000","last_change":"2023-10-06T02:59:53.297975+0000","last_active":"2023-10-06T02:59:54.290397+0000","last_peered":"2023-10-06T02:59:54.290397+0000","last_clean":"2023-10-06T02:59:54.290397+0000","last_became_active":"2023-10-06T02:59:53.297724+0000","last_became_peered":"2023-10-06T02:59:53.297724+0000","last_unstale":"2023-10-06T02:59:54.290397+0000","last_undegraded":"2023-10-06T02:59:54.290397+0000","last_fullsized":"2023-10-06T02:59:54.290397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.689406+0000","last_change":"2023-10-06T02:59:53.684667+0000","last_active":"2023-10-06T02:59:53.689406+0000","last_peered":"2023-10-06T02:59:53.689406+0000","last_clean":"2023-10-06T02:59:53.689406+0000","last_became_active":"2023-10-06T02:59:53.684378+0000","last_became_peered":"2023-10-06T02:59:53.684378+0000","last_unstale":"2023-10-06T02:59:53.689406+0000","last_undegraded":"2023-10-06T02:59:53.689406+0000","last_fullsized":"2023-10-06T02:59:53.689406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:40.914600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.288809+0000","last_change":"2023-10-06T02:59:53.298276+0000","last_active":"2023-10-06T02:59:54.288809+0000","last_peered":"2023-10-06T02:59:54.288809+0000","last_clean":"2023-10-06T02:59:54.288809+0000","last_became_active":"2023-10-06T02:59:53.297471+0000","last_became_peered":"2023-10-06T02:59:53.297471+0000","last_unstale":"2023-10-06T02:59:54.288809+0000","last_undegraded":"2023-10-06T02:59:54.288809+0000","last_fullsized":"2023-10-06T02:59:54.288809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684717+0000","last_change":"2023-10-06T02:59:53.679138+0000","last_active":"2023-10-06T02:59:53.684717+0000","last_peered":"2023-10-06T02:59:53.684717+0000","last_clean":"2023-10-06T02:59:53.684717+0000","last_became_active":"2023-10-06T02:59:53.678831+0000","last_became_peered":"2023-10-06T02:59:53.678831+0000","last_unstale":"2023-10-06T02:59:53.684717+0000","last_undegraded":"2023-10-06T02:59:53.684717+0000","last_fullsized":"2023-10-06T02:59:53.684717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:25.273960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292430+0000","last_change":"2023-10-06T02:59:53.295949+0000","last_active":"2023-10-06T02:59:54.292430+0000","last_peered":"2023-10-06T02:59:54.292430+0000","last_clean":"2023-10-06T02:59:54.292430+0000","last_became_active":"2023-10-06T02:59:53.295697+0000","last_became_peered":"2023-10-06T02:59:53.295697+0000","last_unstale":"2023-10-06T02:59:54.292430+0000","last_undegraded":"2023-10-06T02:59:54.292430+0000","last_fullsized":"2023-10-06T02:59:54.292430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682283+0000","last_change":"2023-10-06T02:59:53.673079+0000","last_active":"2023-10-06T02:59:53.682283+0000","last_peered":"2023-10-06T02:59:53.682283+0000","last_clean":"2023-10-06T02:59:53.682283+0000","last_became_active":"2023-10-06T02:59:53.672629+0000","last_became_peered":"2023-10-06T02:59:53.672629+0000","last_unstale":"2023-10-06T02:59:53.682283+0000","last_undegraded":"2023-10-06T02:59:53.682283+0000","last_fullsized":"2023-10-06T02:59:53.682283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292559+0000","last_change":"2023-10-06T02:59:53.297170+0000","last_active":"2023-10-06T02:59:54.292559+0000","last_peered":"2023-10-06T02:59:54.292559+0000","last_clean":"2023-10-06T02:59:54.292559+0000","last_became_active":"2023-10-06T02:59:53.296843+0000","last_became_peered":"2023-10-06T02:59:53.296843+0000","last_unstale":"2023-10-06T02:59:54.292559+0000","last_undegraded":"2023-10-06T02:59:54.292559+0000","last_fullsized":"2023-10-06T02:59:54.292559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681280+0000","last_change":"2023-10-06T02:59:53.675030+0000","last_active":"2023-10-06T02:59:53.681280+0000","last_peered":"2023-10-06T02:59:53.681280+0000","last_clean":"2023-10-06T02:59:53.681280+0000","last_became_active":"2023-10-06T02:59:53.673662+0000","last_became_peered":"2023-10-06T02:59:53.673662+0000","last_unstale":"2023-10-06T02:59:53.681280+0000","last_undegraded":"2023-10-06T02:59:53.681280+0000","last_fullsized":"2023-10-06T02:59:53.681280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.294000+0000","last_change":"2023-10-06T02:59:53.299596+0000","last_active":"2023-10-06T02:59:54.294000+0000","last_peered":"2023-10-06T02:59:54.294000+0000","last_clean":"2023-10-06T02:59:54.294000+0000","last_became_active":"2023-10-06T02:59:53.298881+0000","last_became_peered":"2023-10-06T02:59:53.298881+0000","last_unstale":"2023-10-06T02:59:54.294000+0000","last_undegraded":"2023-10-06T02:59:54.294000+0000","last_fullsized":"2023-10-06T02:59:54.294000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681995+0000","last_change":"2023-10-06T02:59:53.675391+0000","last_active":"2023-10-06T02:59:53.681995+0000","last_peered":"2023-10-06T02:59:53.681995+0000","last_clean":"2023-10-06T02:59:53.681995+0000","last_became_active":"2023-10-06T02:59:53.675092+0000","last_became_peered":"2023-10-06T02:59:53.675092+0000","last_unstale":"2023-10-06T02:59:53.681995+0000","last_undegraded":"2023-10-06T02:59:53.681995+0000","last_fullsized":"2023-10-06T02:59:53.681995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292391+0000","last_change":"2023-10-06T02:59:53.294074+0000","last_active":"2023-10-06T02:59:54.292391+0000","last_peered":"2023-10-06T02:59:54.292391+0000","last_clean":"2023-10-06T02:59:54.292391+0000","last_became_active":"2023-10-06T02:59:53.293752+0000","last_became_peered":"2023-10-06T02:59:53.293752+0000","last_unstale":"2023-10-06T02:59:54.292391+0000","last_undegraded":"2023-10-06T02:59:54.292391+0000","last_fullsized":"2023-10-06T02:59:54.292391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":686098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":94602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":95570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":94068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.970000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.218}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0860000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.6239999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":684900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:59:57.302 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:59:57.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3359e700 1 Processor -- start 2023-10-06T02:59:57.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3359e700 1 -- start start 2023-10-06T02:59:57.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3359e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3414aed0 0x7fdf3414b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3359e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf340a18e0 con 0x7fdf340b7f40 2023-10-06T02:59:57.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3359e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3414f970 con 0x7fdf340a4760 2023-10-06T02:59:57.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3359e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf340bdbb0 con 0x7fdf3414aed0 2023-10-06T02:59:57.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf32d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdf340b7f40 0x7fdf3414c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52236/0 (socket says 172.21.15.27:52236) 2023-10-06T02:59:57.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf32d9d700 1 -- 172.21.15.27:0/3710818152 learned_addr learned my addr 172.21.15.27:0/3710818152 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:57.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3259c700 1 --2- 172.21.15.27:0/3710818152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3414aed0 0x7fdf3414b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292365060 0 0) 0x7fdf340a18e0 con 0x7fdf340b7f40 2023-10-06T02:59:57.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf1c003570 con 0x7fdf340b7f40 2023-10-06T02:59:57.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211468684 0 0) 0x7fdf3414f970 con 0x7fdf340a4760 2023-10-06T02:59:57.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf340a18e0 con 0x7fdf340a4760 2023-10-06T02:59:57.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3626631654 0 0) 0x7fdf1c003570 con 0x7fdf340b7f40 2023-10-06T02:59:57.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3414aed0 msgr2=0x7fdf3414b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:57.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 --2- 172.21.15.27:0/3710818152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3414aed0 0x7fdf3414b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 >> v1:172.21.15.123:6789/0 conn(0x7fdf340a4760 legacy=0x7fdf3406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3414c950 con 0x7fdf340b7f40 2023-10-06T02:59:57.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1323929577 0 0) 0x7fdf2c001470 con 0x7fdf340b7f40 2023-10-06T02:59:57.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 >> v1:172.21.15.27:6789/0 conn(0x7fdf340b7f40 legacy=0x7fdf3414c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 --2- 172.21.15.27:0/3710818152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf1c003c20 0x7fdf1c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 --2- 172.21.15.27:0/3710818152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3414aed0 0x7fdf1c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 --2- 172.21.15.27:0/3710818152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf1c004d50 0x7fdf1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf340bdbb0 con 0x7fdf1c003c20 2023-10-06T02:59:57.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c00bb40 con 0x7fdf1c004d50 2023-10-06T02:59:57.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c00bd00 con 0x7fdf3414aed0 2023-10-06T02:59:57.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf3259c700 1 --2- 172.21.15.27:0/3710818152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf1c003c20 0x7fdf1c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf32d9d700 1 --2- 172.21.15.27:0/3710818152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf1c004d50 0x7fdf1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.411+0000 7fdf31d9b700 1 --2- 172.21.15.27:0/3710818152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3414aed0 0x7fdf1c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3259c700 1 -- 172.21.15.27:0/3710818152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3414aed0 msgr2=0x7fdf1c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:57.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3259c700 1 --2- 172.21.15.27:0/3710818152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3414aed0 0x7fdf1c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3259c700 1 -- 172.21.15.27:0/3710818152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf1c004d50 msgr2=0x7fdf1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:57.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3259c700 1 --2- 172.21.15.27:0/3710818152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf1c004d50 0x7fdf1c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3259c700 1 -- 172.21.15.27:0/3710818152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c003570 con 0x7fdf1c003c20 2023-10-06T02:59:57.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3259c700 1 --2- 172.21.15.27:0/3710818152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf1c003c20 0x7fdf1c004010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009c00 tx=0x7fdf280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c7987136b491d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800e710 con 0x7fdf1c003c20 2023-10-06T02:59:57.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2800e870 con 0x7fdf1c003c20 2023-10-06T02:59:57.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3159a700 1 -- 172.21.15.27:0/3710818152 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800ec30 con 0x7fdf1c003c20 2023-10-06T02:59:57.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3359e700 1 -- 172.21.15.27:0/3710818152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf1c003c20 msgr2=0x7fdf1c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3359e700 1 --2- 172.21.15.27:0/3710818152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf1c003c20 0x7fdf1c004010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009c00 tx=0x7fdf280091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf32d9d700 1 -- 172.21.15.27:0/3710818152 reap_dead start 2023-10-06T02:59:57.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3359e700 1 -- 172.21.15.27:0/3710818152 shutdown_connections 2023-10-06T02:59:57.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3359e700 1 -- 172.21.15.27:0/3710818152 >> 172.21.15.27:0/3710818152 conn(0x7fdf340beae0 msgr2=0x7fdf340beee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:57.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3359e700 1 -- 172.21.15.27:0/3710818152 shutdown_connections 2023-10-06T02:59:57.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.415+0000 7fdf3359e700 1 -- 172.21.15.27:0/3710818152 wait complete. 2023-10-06T02:59:57.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3359e700 1 Processor -- start 2023-10-06T02:59:57.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3359e700 1 -- start start 2023-10-06T02:59:57.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf1c003c20 0x7fdf3414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3359e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf340bb100 0x7fdf3414ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf340b9120 0x7fdf3414d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf340b8830 con 0x7fdf1c003c20 2023-10-06T02:59:57.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3359e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf340bac70 con 0x7fdf340b9120 2023-10-06T02:59:57.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3359e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3414e470 con 0x7fdf340bb100 2023-10-06T02:59:57.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf1c003c20 0x7fdf3414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf1c003c20 0x7fdf3414df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59168/0 (socket says 172.21.15.27:59168) 2023-10-06T02:59:57.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3259c700 1 -- 172.21.15.27:0/605319633 learned_addr learned my addr 172.21.15.27:0/605319633 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:57.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf32d9d700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf340b9120 0x7fdf3414d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf31d9b700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf340bb100 0x7fdf3414ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3259c700 1 -- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf340bb100 msgr2=0x7fdf3414ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3259c700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf340bb100 0x7fdf3414ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3259c700 1 -- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf340b9120 msgr2=0x7fdf3414d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3259c700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf340b9120 0x7fdf3414d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3259c700 1 -- 172.21.15.27:0/605319633 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3414d730 con 0x7fdf1c003c20 2023-10-06T02:59:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf32d9d700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf340b9120 0x7fdf3414d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3259c700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf1c003c20 0x7fdf3414df30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800e4b0 tx=0x7fdf2801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf227fc700 1 -- 172.21.15.27:0/605319633 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28022070 con 0x7fdf1c003c20 2023-10-06T02:59:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf227fc700 1 -- 172.21.15.27:0/605319633 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2800ebf0 con 0x7fdf1c003c20 2023-10-06T02:59:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3359e700 1 -- 172.21.15.27:0/605319633 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf340ba650 con 0x7fdf1c003c20 2023-10-06T02:59:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf227fc700 1 -- 172.21.15.27:0/605319633 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2801c6c0 con 0x7fdf1c003c20 2023-10-06T02:59:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3359e700 1 -- 172.21.15.27:0/605319633 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3415a870 con 0x7fdf1c003c20 2023-10-06T02:59:57.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.419+0000 7fdf3359e700 1 -- 172.21.15.27:0/605319633 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf34087a70 con 0x7fdf1c003c20 2023-10-06T02:59:57.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.423+0000 7fdf227fc700 1 -- 172.21.15.27:0/605319633 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdf2801ca70 con 0x7fdf1c003c20 2023-10-06T02:59:57.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.423+0000 7fdf227fc700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fdf14060550 0x7fdf14062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.423+0000 7fdf227fc700 1 -- 172.21.15.27:0/605319633 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf2807e0e0 con 0x7fdf1c003c20 2023-10-06T02:59:57.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.423+0000 7fdf31d9b700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fdf14060550 0x7fdf14062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.423+0000 7fdf31d9b700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fdf14060550 0x7fdf14062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdf24004290 tx=0x7fdf240017a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.427+0000 7fdf227fc700 1 -- 172.21.15.27:0/605319633 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdf2804e570 con 0x7fdf1c003c20 2023-10-06T02:59:57.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.587+0000 7fdf3359e700 1 -- 172.21.15.27:0/605319633 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf340b9a80 con 0x7fdf14060550 2023-10-06T02:59:57.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.603+0000 7fdf227fc700 1 -- 172.21.15.27:0/605319633 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286564 (secure 0 0 0) 0x7fdf340b9a80 con 0x7fdf14060550 2023-10-06T02:59:57.613 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:57.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.611+0000 7fdf3359e700 1 -- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fdf14060550 msgr2=0x7fdf14062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.611+0000 7fdf3359e700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fdf14060550 0x7fdf14062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdf24004290 tx=0x7fdf240017a0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.611+0000 7fdf3359e700 1 -- 172.21.15.27:0/605319633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf1c003c20 msgr2=0x7fdf3414df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.611+0000 7fdf3359e700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf1c003c20 0x7fdf3414df30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800e4b0 tx=0x7fdf2801a000 comp rx=0 tx=0).stop 2023-10-06T02:59:57.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.611+0000 7fdf3359e700 1 -- 172.21.15.27:0/605319633 shutdown_connections 2023-10-06T02:59:57.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.611+0000 7fdf3359e700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fdf14060550 0x7fdf14062a00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.611+0000 7fdf3359e700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf340b9120 0x7fdf3414d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.611+0000 7fdf3359e700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf340bb100 0x7fdf3414ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.611+0000 7fdf3359e700 1 --2- 172.21.15.27:0/605319633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf1c003c20 0x7fdf3414df30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.611+0000 7fdf3359e700 1 -- 172.21.15.27:0/605319633 >> 172.21.15.27:0/605319633 conn(0x7fdf340beae0 msgr2=0x7fdf340c1850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:57.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.611+0000 7fdf3359e700 1 -- 172.21.15.27:0/605319633 shutdown_connections 2023-10-06T02:59:57.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.611+0000 7fdf3359e700 1 -- 172.21.15.27:0/605319633 wait complete. 2023-10-06T02:59:57.619 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-10-06T02:59:57.631 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-06T02:59:56.961458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":198,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381512,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593208,"statfs":{"total":773094113280,"available":770655444992,"internally_reserved":0,"allocated":3284992,"data_stored":1937172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.703183"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684810+0000","last_change":"2023-10-06T02:59:53.681789+0000","last_active":"2023-10-06T02:59:53.684810+0000","last_peered":"2023-10-06T02:59:53.684810+0000","last_clean":"2023-10-06T02:59:53.684810+0000","last_became_active":"2023-10-06T02:59:53.681495+0000","last_became_peered":"2023-10-06T02:59:53.681495+0000","last_unstale":"2023-10-06T02:59:53.684810+0000","last_undegraded":"2023-10-06T02:59:53.684810+0000","last_fullsized":"2023-10-06T02:59:53.684810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:19.626429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.685709+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T02:59:53.685709+0000","last_peered":"2023-10-06T02:59:53.685709+0000","last_clean":"2023-10-06T02:59:53.685709+0000","last_became_active":"2023-10-06T02:59:53.681849+0000","last_became_peered":"2023-10-06T02:59:53.681849+0000","last_unstale":"2023-10-06T02:59:53.685709+0000","last_undegraded":"2023-10-06T02:59:53.685709+0000","last_fullsized":"2023-10-06T02:59:53.685709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684784+0000","last_change":"2023-10-06T02:59:53.679536+0000","last_active":"2023-10-06T02:59:53.684784+0000","last_peered":"2023-10-06T02:59:53.684784+0000","last_clean":"2023-10-06T02:59:53.684784+0000","last_became_active":"2023-10-06T02:59:53.678264+0000","last_became_peered":"2023-10-06T02:59:53.678264+0000","last_unstale":"2023-10-06T02:59:53.684784+0000","last_undegraded":"2023-10-06T02:59:53.684784+0000","last_fullsized":"2023-10-06T02:59:53.684784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:18.566933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.678088+0000","last_change":"2023-10-06T02:59:53.671821+0000","last_active":"2023-10-06T02:59:53.678088+0000","last_peered":"2023-10-06T02:59:53.678088+0000","last_clean":"2023-10-06T02:59:53.678088+0000","last_became_active":"2023-10-06T02:59:53.671555+0000","last_became_peered":"2023-10-06T02:59:53.671555+0000","last_unstale":"2023-10-06T02:59:53.678088+0000","last_undegraded":"2023-10-06T02:59:53.678088+0000","last_fullsized":"2023-10-06T02:59:53.678088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:36:28.006545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684527+0000","last_change":"2023-10-06T02:59:53.682691+0000","last_active":"2023-10-06T02:59:53.684527+0000","last_peered":"2023-10-06T02:59:53.684527+0000","last_clean":"2023-10-06T02:59:53.684527+0000","last_became_active":"2023-10-06T02:59:53.682399+0000","last_became_peered":"2023-10-06T02:59:53.682399+0000","last_unstale":"2023-10-06T02:59:53.684527+0000","last_undegraded":"2023-10-06T02:59:53.684527+0000","last_fullsized":"2023-10-06T02:59:53.684527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683184+0000","last_change":"2023-10-06T02:59:53.678208+0000","last_active":"2023-10-06T02:59:53.683184+0000","last_peered":"2023-10-06T02:59:53.683184+0000","last_clean":"2023-10-06T02:59:53.683184+0000","last_became_active":"2023-10-06T02:59:53.676481+0000","last_became_peered":"2023-10-06T02:59:53.676481+0000","last_unstale":"2023-10-06T02:59:53.683184+0000","last_undegraded":"2023-10-06T02:59:53.683184+0000","last_fullsized":"2023-10-06T02:59:53.683184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:42.767531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688401+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T02:59:53.688401+0000","last_peered":"2023-10-06T02:59:53.688401+0000","last_clean":"2023-10-06T02:59:53.688401+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T02:59:53.688401+0000","last_undegraded":"2023-10-06T02:59:53.688401+0000","last_fullsized":"2023-10-06T02:59:53.688401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688329+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T02:59:53.688329+0000","last_peered":"2023-10-06T02:59:53.688329+0000","last_clean":"2023-10-06T02:59:53.688329+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T02:59:53.688329+0000","last_undegraded":"2023-10-06T02:59:53.688329+0000","last_fullsized":"2023-10-06T02:59:53.688329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682066+0000","last_change":"2023-10-06T02:59:53.680395+0000","last_active":"2023-10-06T02:59:53.682066+0000","last_peered":"2023-10-06T02:59:53.682066+0000","last_clean":"2023-10-06T02:59:53.682066+0000","last_became_active":"2023-10-06T02:59:53.680086+0000","last_became_peered":"2023-10-06T02:59:53.680086+0000","last_unstale":"2023-10-06T02:59:53.682066+0000","last_undegraded":"2023-10-06T02:59:53.682066+0000","last_fullsized":"2023-10-06T02:59:53.682066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.680410+0000","last_change":"2023-10-06T02:59:53.675582+0000","last_active":"2023-10-06T02:59:53.680410+0000","last_peered":"2023-10-06T02:59:53.680410+0000","last_clean":"2023-10-06T02:59:53.680410+0000","last_became_active":"2023-10-06T02:59:53.675243+0000","last_became_peered":"2023-10-06T02:59:53.675243+0000","last_unstale":"2023-10-06T02:59:53.680410+0000","last_undegraded":"2023-10-06T02:59:53.680410+0000","last_fullsized":"2023-10-06T02:59:53.680410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684759+0000","last_change":"2023-10-06T02:59:53.679489+0000","last_active":"2023-10-06T02:59:53.684759+0000","last_peered":"2023-10-06T02:59:53.684759+0000","last_clean":"2023-10-06T02:59:53.684759+0000","last_became_active":"2023-10-06T02:59:53.678985+0000","last_became_peered":"2023-10-06T02:59:53.678985+0000","last_unstale":"2023-10-06T02:59:53.684759+0000","last_undegraded":"2023-10-06T02:59:53.684759+0000","last_fullsized":"2023-10-06T02:59:53.684759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:12.576010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684951+0000","last_change":"2023-10-06T02:59:53.682799+0000","last_active":"2023-10-06T02:59:53.684951+0000","last_peered":"2023-10-06T02:59:53.684951+0000","last_clean":"2023-10-06T02:59:53.684951+0000","last_became_active":"2023-10-06T02:59:53.682464+0000","last_became_peered":"2023-10-06T02:59:53.682464+0000","last_unstale":"2023-10-06T02:59:53.684951+0000","last_undegraded":"2023-10-06T02:59:53.684951+0000","last_fullsized":"2023-10-06T02:59:53.684951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:06.403449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683827+0000","last_change":"2023-10-06T02:59:53.678968+0000","last_active":"2023-10-06T02:59:53.683827+0000","last_peered":"2023-10-06T02:59:53.683827+0000","last_clean":"2023-10-06T02:59:53.683827+0000","last_became_active":"2023-10-06T02:59:53.678562+0000","last_became_peered":"2023-10-06T02:59:53.678562+0000","last_unstale":"2023-10-06T02:59:53.683827+0000","last_undegraded":"2023-10-06T02:59:53.683827+0000","last_fullsized":"2023-10-06T02:59:53.683827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:46.305158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.674814+0000","last_change":"2023-10-06T02:59:53.673321+0000","last_active":"2023-10-06T02:59:53.674814+0000","last_peered":"2023-10-06T02:59:53.674814+0000","last_clean":"2023-10-06T02:59:53.674814+0000","last_became_active":"2023-10-06T02:59:53.672957+0000","last_became_peered":"2023-10-06T02:59:53.672957+0000","last_unstale":"2023-10-06T02:59:53.674814+0000","last_undegraded":"2023-10-06T02:59:53.674814+0000","last_fullsized":"2023-10-06T02:59:53.674814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.689370+0000","last_change":"2023-10-06T02:59:53.686669+0000","last_active":"2023-10-06T02:59:53.689370+0000","last_peered":"2023-10-06T02:59:53.689370+0000","last_clean":"2023-10-06T02:59:53.689370+0000","last_became_active":"2023-10-06T02:59:53.686352+0000","last_became_peered":"2023-10-06T02:59:53.686352+0000","last_unstale":"2023-10-06T02:59:53.689370+0000","last_undegraded":"2023-10-06T02:59:53.689370+0000","last_fullsized":"2023-10-06T02:59:53.689370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684827+0000","last_change":"2023-10-06T02:59:53.680975+0000","last_active":"2023-10-06T02:59:53.684827+0000","last_peered":"2023-10-06T02:59:53.684827+0000","last_clean":"2023-10-06T02:59:53.684827+0000","last_became_active":"2023-10-06T02:59:53.678449+0000","last_became_peered":"2023-10-06T02:59:53.678449+0000","last_unstale":"2023-10-06T02:59:53.684827+0000","last_undegraded":"2023-10-06T02:59:53.684827+0000","last_fullsized":"2023-10-06T02:59:53.684827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:18.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682046+0000","last_change":"2023-10-06T02:59:53.680344+0000","last_active":"2023-10-06T02:59:53.682046+0000","last_peered":"2023-10-06T02:59:53.682046+0000","last_clean":"2023-10-06T02:59:53.682046+0000","last_became_active":"2023-10-06T02:59:53.680028+0000","last_became_peered":"2023-10-06T02:59:53.680028+0000","last_unstale":"2023-10-06T02:59:53.682046+0000","last_undegraded":"2023-10-06T02:59:53.682046+0000","last_fullsized":"2023-10-06T02:59:53.682046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682183+0000","last_change":"2023-10-06T02:59:53.678143+0000","last_active":"2023-10-06T02:59:53.682183+0000","last_peered":"2023-10-06T02:59:53.682183+0000","last_clean":"2023-10-06T02:59:53.682183+0000","last_became_active":"2023-10-06T02:59:53.676602+0000","last_became_peered":"2023-10-06T02:59:53.676602+0000","last_unstale":"2023-10-06T02:59:53.682183+0000","last_undegraded":"2023-10-06T02:59:53.682183+0000","last_fullsized":"2023-10-06T02:59:53.682183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:29.621147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.677525+0000","last_change":"2023-10-06T02:59:53.675935+0000","last_active":"2023-10-06T02:59:53.677525+0000","last_peered":"2023-10-06T02:59:53.677525+0000","last_clean":"2023-10-06T02:59:53.677525+0000","last_became_active":"2023-10-06T02:59:53.675657+0000","last_became_peered":"2023-10-06T02:59:53.675657+0000","last_unstale":"2023-10-06T02:59:53.677525+0000","last_undegraded":"2023-10-06T02:59:53.677525+0000","last_fullsized":"2023-10-06T02:59:53.677525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:56.862647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681975+0000","last_change":"2023-10-06T02:59:53.673043+0000","last_active":"2023-10-06T02:59:53.681975+0000","last_peered":"2023-10-06T02:59:53.681975+0000","last_clean":"2023-10-06T02:59:53.681975+0000","last_became_active":"2023-10-06T02:59:53.672690+0000","last_became_peered":"2023-10-06T02:59:53.672690+0000","last_unstale":"2023-10-06T02:59:53.681975+0000","last_undegraded":"2023-10-06T02:59:53.681975+0000","last_fullsized":"2023-10-06T02:59:53.681975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688445+0000","last_change":"2023-10-06T02:59:53.684492+0000","last_active":"2023-10-06T02:59:53.688445+0000","last_peered":"2023-10-06T02:59:53.688445+0000","last_clean":"2023-10-06T02:59:53.688445+0000","last_became_active":"2023-10-06T02:59:53.684145+0000","last_became_peered":"2023-10-06T02:59:53.684145+0000","last_unstale":"2023-10-06T02:59:53.688445+0000","last_undegraded":"2023-10-06T02:59:53.688445+0000","last_fullsized":"2023-10-06T02:59:53.688445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687097+0000","last_change":"2023-10-06T02:59:53.683256+0000","last_active":"2023-10-06T02:59:53.687097+0000","last_peered":"2023-10-06T02:59:53.687097+0000","last_clean":"2023-10-06T02:59:53.687097+0000","last_became_active":"2023-10-06T02:59:53.682948+0000","last_became_peered":"2023-10-06T02:59:53.682948+0000","last_unstale":"2023-10-06T02:59:53.687097+0000","last_undegraded":"2023-10-06T02:59:53.687097+0000","last_fullsized":"2023-10-06T02:59:53.687097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681303+0000","last_change":"2023-10-06T02:59:53.675936+0000","last_active":"2023-10-06T02:59:53.681303+0000","last_peered":"2023-10-06T02:59:53.681303+0000","last_clean":"2023-10-06T02:59:53.681303+0000","last_became_active":"2023-10-06T02:59:53.675319+0000","last_became_peered":"2023-10-06T02:59:53.675319+0000","last_unstale":"2023-10-06T02:59:53.681303+0000","last_undegraded":"2023-10-06T02:59:53.681303+0000","last_fullsized":"2023-10-06T02:59:53.681303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.689381+0000","last_change":"2023-10-06T02:59:53.686758+0000","last_active":"2023-10-06T02:59:53.689381+0000","last_peered":"2023-10-06T02:59:53.689381+0000","last_clean":"2023-10-06T02:59:53.689381+0000","last_became_active":"2023-10-06T02:59:53.686007+0000","last_became_peered":"2023-10-06T02:59:53.686007+0000","last_unstale":"2023-10-06T02:59:53.689381+0000","last_undegraded":"2023-10-06T02:59:53.689381+0000","last_fullsized":"2023-10-06T02:59:53.689381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.686023+0000","last_change":"2023-10-06T02:59:53.682853+0000","last_active":"2023-10-06T02:59:53.686023+0000","last_peered":"2023-10-06T02:59:53.686023+0000","last_clean":"2023-10-06T02:59:53.686023+0000","last_became_active":"2023-10-06T02:59:53.682511+0000","last_became_peered":"2023-10-06T02:59:53.682511+0000","last_unstale":"2023-10-06T02:59:53.686023+0000","last_undegraded":"2023-10-06T02:59:53.686023+0000","last_fullsized":"2023-10-06T02:59:53.686023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.685842+0000","last_change":"2023-10-06T02:59:53.682001+0000","last_active":"2023-10-06T02:59:53.685842+0000","last_peered":"2023-10-06T02:59:53.685842+0000","last_clean":"2023-10-06T02:59:53.685842+0000","last_became_active":"2023-10-06T02:59:53.681732+0000","last_became_peered":"2023-10-06T02:59:53.681732+0000","last_unstale":"2023-10-06T02:59:53.685842+0000","last_undegraded":"2023-10-06T02:59:53.685842+0000","last_fullsized":"2023-10-06T02:59:53.685842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.680523+0000","last_change":"2023-10-06T02:59:53.676598+0000","last_active":"2023-10-06T02:59:53.680523+0000","last_peered":"2023-10-06T02:59:53.680523+0000","last_clean":"2023-10-06T02:59:53.680523+0000","last_became_active":"2023-10-06T02:59:53.676284+0000","last_became_peered":"2023-10-06T02:59:53.676284+0000","last_unstale":"2023-10-06T02:59:53.680523+0000","last_undegraded":"2023-10-06T02:59:53.680523+0000","last_fullsized":"2023-10-06T02:59:53.680523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.690178+0000","last_change":"2023-10-06T02:59:53.687275+0000","last_active":"2023-10-06T02:59:53.690178+0000","last_peered":"2023-10-06T02:59:53.690178+0000","last_clean":"2023-10-06T02:59:53.690178+0000","last_became_active":"2023-10-06T02:59:53.686912+0000","last_became_peered":"2023-10-06T02:59:53.686912+0000","last_unstale":"2023-10-06T02:59:53.690178+0000","last_undegraded":"2023-10-06T02:59:53.690178+0000","last_fullsized":"2023-10-06T02:59:53.690178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687065+0000","last_change":"2023-10-06T02:59:53.685421+0000","last_active":"2023-10-06T02:59:53.687065+0000","last_peered":"2023-10-06T02:59:53.687065+0000","last_clean":"2023-10-06T02:59:53.687065+0000","last_became_active":"2023-10-06T02:59:53.684806+0000","last_became_peered":"2023-10-06T02:59:53.684806+0000","last_unstale":"2023-10-06T02:59:53.687065+0000","last_undegraded":"2023-10-06T02:59:53.687065+0000","last_fullsized":"2023-10-06T02:59:53.687065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682303+0000","last_change":"2023-10-06T02:59:53.676085+0000","last_active":"2023-10-06T02:59:53.682303+0000","last_peered":"2023-10-06T02:59:53.682303+0000","last_clean":"2023-10-06T02:59:53.682303+0000","last_became_active":"2023-10-06T02:59:53.675718+0000","last_became_peered":"2023-10-06T02:59:53.675718+0000","last_unstale":"2023-10-06T02:59:53.682303+0000","last_undegraded":"2023-10-06T02:59:53.682303+0000","last_fullsized":"2023-10-06T02:59:53.682303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:00.548441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681322+0000","last_change":"2023-10-06T02:59:53.676118+0000","last_active":"2023-10-06T02:59:53.681322+0000","last_peered":"2023-10-06T02:59:53.681322+0000","last_clean":"2023-10-06T02:59:53.681322+0000","last_became_active":"2023-10-06T02:59:53.675682+0000","last_became_peered":"2023-10-06T02:59:53.675682+0000","last_unstale":"2023-10-06T02:59:53.681322+0000","last_undegraded":"2023-10-06T02:59:53.681322+0000","last_fullsized":"2023-10-06T02:59:53.681322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.678043+0000","last_change":"2023-10-06T02:59:53.673225+0000","last_active":"2023-10-06T02:59:53.678043+0000","last_peered":"2023-10-06T02:59:53.678043+0000","last_clean":"2023-10-06T02:59:53.678043+0000","last_became_active":"2023-10-06T02:59:53.672930+0000","last_became_peered":"2023-10-06T02:59:53.672930+0000","last_unstale":"2023-10-06T02:59:53.678043+0000","last_undegraded":"2023-10-06T02:59:53.678043+0000","last_fullsized":"2023-10-06T02:59:53.678043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:02.845187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683926+0000","last_change":"2023-10-06T02:59:53.678742+0000","last_active":"2023-10-06T02:59:53.683926+0000","last_peered":"2023-10-06T02:59:53.683926+0000","last_clean":"2023-10-06T02:59:53.683926+0000","last_became_active":"2023-10-06T02:59:53.678471+0000","last_became_peered":"2023-10-06T02:59:53.678471+0000","last_unstale":"2023-10-06T02:59:53.683926+0000","last_undegraded":"2023-10-06T02:59:53.683926+0000","last_fullsized":"2023-10-06T02:59:53.683926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292803+0000","last_change":"2023-10-06T02:59:53.297136+0000","last_active":"2023-10-06T02:59:54.292803+0000","last_peered":"2023-10-06T02:59:54.292803+0000","last_clean":"2023-10-06T02:59:54.292803+0000","last_became_active":"2023-10-06T02:59:53.296816+0000","last_became_peered":"2023-10-06T02:59:53.296816+0000","last_unstale":"2023-10-06T02:59:54.292803+0000","last_undegraded":"2023-10-06T02:59:54.292803+0000","last_fullsized":"2023-10-06T02:59:54.292803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:58.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688369+0000","last_change":"2023-10-06T02:59:53.684876+0000","last_active":"2023-10-06T02:59:53.688369+0000","last_peered":"2023-10-06T02:59:53.688369+0000","last_clean":"2023-10-06T02:59:53.688369+0000","last_became_active":"2023-10-06T02:59:53.684522+0000","last_became_peered":"2023-10-06T02:59:53.684522+0000","last_unstale":"2023-10-06T02:59:53.688369+0000","last_undegraded":"2023-10-06T02:59:53.688369+0000","last_fullsized":"2023-10-06T02:59:53.688369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668295+0000","last_change":"2023-10-06T02:59:53.292700+0000","last_active":"2023-10-06T02:59:53.668295+0000","last_peered":"2023-10-06T02:59:53.668295+0000","last_clean":"2023-10-06T02:59:53.668295+0000","last_became_active":"2023-10-06T02:59:53.292378+0000","last_became_peered":"2023-10-06T02:59:53.292378+0000","last_unstale":"2023-10-06T02:59:53.668295+0000","last_undegraded":"2023-10-06T02:59:53.668295+0000","last_fullsized":"2023-10-06T02:59:53.668295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.677456+0000","last_change":"2023-10-06T02:59:53.675542+0000","last_active":"2023-10-06T02:59:53.677456+0000","last_peered":"2023-10-06T02:59:53.677456+0000","last_clean":"2023-10-06T02:59:53.677456+0000","last_became_active":"2023-10-06T02:59:53.675219+0000","last_became_peered":"2023-10-06T02:59:53.675219+0000","last_unstale":"2023-10-06T02:59:53.677456+0000","last_undegraded":"2023-10-06T02:59:53.677456+0000","last_fullsized":"2023-10-06T02:59:53.677456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.670933+0000","last_change":"2023-10-06T02:59:53.302122+0000","last_active":"2023-10-06T02:59:53.670933+0000","last_peered":"2023-10-06T02:59:53.670933+0000","last_clean":"2023-10-06T02:59:53.670933+0000","last_became_active":"2023-10-06T02:59:53.301737+0000","last_became_peered":"2023-10-06T02:59:53.301737+0000","last_unstale":"2023-10-06T02:59:53.670933+0000","last_undegraded":"2023-10-06T02:59:53.670933+0000","last_fullsized":"2023-10-06T02:59:53.670933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.686222+0000","last_change":"2023-10-06T02:59:53.684854+0000","last_active":"2023-10-06T02:59:53.686222+0000","last_peered":"2023-10-06T02:59:53.686222+0000","last_clean":"2023-10-06T02:59:53.686222+0000","last_became_active":"2023-10-06T02:59:53.684527+0000","last_became_peered":"2023-10-06T02:59:53.684527+0000","last_unstale":"2023-10-06T02:59:53.686222+0000","last_undegraded":"2023-10-06T02:59:53.686222+0000","last_fullsized":"2023-10-06T02:59:53.686222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.295747+0000","last_change":"2023-10-06T02:59:53.294103+0000","last_active":"2023-10-06T02:59:54.295747+0000","last_peered":"2023-10-06T02:59:54.295747+0000","last_clean":"2023-10-06T02:59:54.295747+0000","last_became_active":"2023-10-06T02:59:53.293707+0000","last_became_peered":"2023-10-06T02:59:53.293707+0000","last_unstale":"2023-10-06T02:59:54.295747+0000","last_undegraded":"2023-10-06T02:59:54.295747+0000","last_fullsized":"2023-10-06T02:59:54.295747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292846+0000","last_change":"2023-10-06T02:59:53.296507+0000","last_active":"2023-10-06T02:59:54.292846+0000","last_peered":"2023-10-06T02:59:54.292846+0000","last_clean":"2023-10-06T02:59:54.292846+0000","last_became_active":"2023-10-06T02:59:53.296230+0000","last_became_peered":"2023-10-06T02:59:53.296230+0000","last_unstale":"2023-10-06T02:59:54.292846+0000","last_undegraded":"2023-10-06T02:59:54.292846+0000","last_fullsized":"2023-10-06T02:59:54.292846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688349+0000","last_change":"2023-10-06T02:59:53.684046+0000","last_active":"2023-10-06T02:59:53.688349+0000","last_peered":"2023-10-06T02:59:53.688349+0000","last_clean":"2023-10-06T02:59:53.688349+0000","last_became_active":"2023-10-06T02:59:53.683705+0000","last_became_peered":"2023-10-06T02:59:53.683705+0000","last_unstale":"2023-10-06T02:59:53.688349+0000","last_undegraded":"2023-10-06T02:59:53.688349+0000","last_fullsized":"2023-10-06T02:59:53.688349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292725+0000","last_change":"2023-10-06T02:59:53.296465+0000","last_active":"2023-10-06T02:59:54.292725+0000","last_peered":"2023-10-06T02:59:54.292725+0000","last_clean":"2023-10-06T02:59:54.292725+0000","last_became_active":"2023-10-06T02:59:53.296225+0000","last_became_peered":"2023-10-06T02:59:53.296225+0000","last_unstale":"2023-10-06T02:59:54.292725+0000","last_undegraded":"2023-10-06T02:59:54.292725+0000","last_fullsized":"2023-10-06T02:59:54.292725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688679+0000","last_change":"2023-10-06T02:59:53.683216+0000","last_active":"2023-10-06T02:59:53.688679+0000","last_peered":"2023-10-06T02:59:53.688679+0000","last_clean":"2023-10-06T02:59:53.688679+0000","last_became_active":"2023-10-06T02:59:53.682938+0000","last_became_peered":"2023-10-06T02:59:53.682938+0000","last_unstale":"2023-10-06T02:59:53.688679+0000","last_undegraded":"2023-10-06T02:59:53.688679+0000","last_fullsized":"2023-10-06T02:59:53.688679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292905+0000","last_change":"2023-10-06T02:59:53.293929+0000","last_active":"2023-10-06T02:59:54.292905+0000","last_peered":"2023-10-06T02:59:54.292905+0000","last_clean":"2023-10-06T02:59:54.292905+0000","last_became_active":"2023-10-06T02:59:53.293602+0000","last_became_peered":"2023-10-06T02:59:53.293602+0000","last_unstale":"2023-10-06T02:59:54.292905+0000","last_undegraded":"2023-10-06T02:59:54.292905+0000","last_fullsized":"2023-10-06T02:59:54.292905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.677911+0000","last_change":"2023-10-06T02:59:53.672111+0000","last_active":"2023-10-06T02:59:53.677911+0000","last_peered":"2023-10-06T02:59:53.677911+0000","last_clean":"2023-10-06T02:59:53.677911+0000","last_became_active":"2023-10-06T02:59:53.671511+0000","last_became_peered":"2023-10-06T02:59:53.671511+0000","last_unstale":"2023-10-06T02:59:53.677911+0000","last_undegraded":"2023-10-06T02:59:53.677911+0000","last_fullsized":"2023-10-06T02:59:53.677911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668804+0000","last_change":"2023-10-06T02:59:53.300059+0000","last_active":"2023-10-06T02:59:53.668804+0000","last_peered":"2023-10-06T02:59:53.668804+0000","last_clean":"2023-10-06T02:59:53.668804+0000","last_became_active":"2023-10-06T02:59:53.299715+0000","last_became_peered":"2023-10-06T02:59:53.299715+0000","last_unstale":"2023-10-06T02:59:53.668804+0000","last_undegraded":"2023-10-06T02:59:53.668804+0000","last_fullsized":"2023-10-06T02:59:53.668804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687172+0000","last_change":"2023-10-06T02:59:53.683331+0000","last_active":"2023-10-06T02:59:53.687172+0000","last_peered":"2023-10-06T02:59:53.687172+0000","last_clean":"2023-10-06T02:59:53.687172+0000","last_became_active":"2023-10-06T02:59:53.682994+0000","last_became_peered":"2023-10-06T02:59:53.682994+0000","last_unstale":"2023-10-06T02:59:53.687172+0000","last_undegraded":"2023-10-06T02:59:53.687172+0000","last_fullsized":"2023-10-06T02:59:53.687172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.288613+0000","last_change":"2023-10-06T02:59:53.301126+0000","last_active":"2023-10-06T02:59:54.288613+0000","last_peered":"2023-10-06T02:59:54.288613+0000","last_clean":"2023-10-06T02:59:54.288613+0000","last_became_active":"2023-10-06T02:59:53.300850+0000","last_became_peered":"2023-10-06T02:59:53.300850+0000","last_unstale":"2023-10-06T02:59:54.288613+0000","last_undegraded":"2023-10-06T02:59:54.288613+0000","last_fullsized":"2023-10-06T02:59:54.288613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684480+0000","last_change":"2023-10-06T02:59:53.678930+0000","last_active":"2023-10-06T02:59:53.684480+0000","last_peered":"2023-10-06T02:59:53.684480+0000","last_clean":"2023-10-06T02:59:53.684480+0000","last_became_active":"2023-10-06T02:59:53.678630+0000","last_became_peered":"2023-10-06T02:59:53.678630+0000","last_unstale":"2023-10-06T02:59:53.684480+0000","last_undegraded":"2023-10-06T02:59:53.684480+0000","last_fullsized":"2023-10-06T02:59:53.684480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:14.961350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.662824+0000","last_change":"2023-10-06T02:59:53.291521+0000","last_active":"2023-10-06T02:59:53.662824+0000","last_peered":"2023-10-06T02:59:53.662824+0000","last_clean":"2023-10-06T02:59:53.662824+0000","last_became_active":"2023-10-06T02:59:53.290773+0000","last_became_peered":"2023-10-06T02:59:53.290773+0000","last_unstale":"2023-10-06T02:59:53.662824+0000","last_undegraded":"2023-10-06T02:59:53.662824+0000","last_fullsized":"2023-10-06T02:59:53.662824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682164+0000","last_change":"2023-10-06T02:59:53.678188+0000","last_active":"2023-10-06T02:59:53.682164+0000","last_peered":"2023-10-06T02:59:53.682164+0000","last_clean":"2023-10-06T02:59:53.682164+0000","last_became_active":"2023-10-06T02:59:53.676507+0000","last_became_peered":"2023-10-06T02:59:53.676507+0000","last_unstale":"2023-10-06T02:59:53.682164+0000","last_undegraded":"2023-10-06T02:59:53.682164+0000","last_fullsized":"2023-10-06T02:59:53.682164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.672575+0000","last_change":"2023-10-06T02:59:53.289980+0000","last_active":"2023-10-06T02:59:53.672575+0000","last_peered":"2023-10-06T02:59:53.672575+0000","last_clean":"2023-10-06T02:59:53.672575+0000","last_became_active":"2023-10-06T02:59:53.288601+0000","last_became_peered":"2023-10-06T02:59:53.288601+0000","last_unstale":"2023-10-06T02:59:53.672575+0000","last_undegraded":"2023-10-06T02:59:53.672575+0000","last_fullsized":"2023-10-06T02:59:53.672575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:54.630392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681947+0000","last_change":"2023-10-06T02:59:53.675456+0000","last_active":"2023-10-06T02:59:53.681947+0000","last_peered":"2023-10-06T02:59:53.681947+0000","last_clean":"2023-10-06T02:59:53.681947+0000","last_became_active":"2023-10-06T02:59:53.673268+0000","last_became_peered":"2023-10-06T02:59:53.673268+0000","last_unstale":"2023-10-06T02:59:53.681947+0000","last_undegraded":"2023-10-06T02:59:53.681947+0000","last_fullsized":"2023-10-06T02:59:53.681947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.658166+0000","last_change":"2023-10-06T02:59:53.298398+0000","last_active":"2023-10-06T02:59:53.658166+0000","last_peered":"2023-10-06T02:59:53.658166+0000","last_clean":"2023-10-06T02:59:53.658166+0000","last_became_active":"2023-10-06T02:59:53.297896+0000","last_became_peered":"2023-10-06T02:59:53.297896+0000","last_unstale":"2023-10-06T02:59:53.658166+0000","last_undegraded":"2023-10-06T02:59:53.658166+0000","last_fullsized":"2023-10-06T02:59:53.658166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684745+0000","last_change":"2023-10-06T02:59:53.679712+0000","last_active":"2023-10-06T02:59:53.684745+0000","last_peered":"2023-10-06T02:59:53.684745+0000","last_clean":"2023-10-06T02:59:53.684745+0000","last_became_active":"2023-10-06T02:59:53.679390+0000","last_became_peered":"2023-10-06T02:59:53.679390+0000","last_unstale":"2023-10-06T02:59:53.684745+0000","last_undegraded":"2023-10-06T02:59:53.684745+0000","last_fullsized":"2023-10-06T02:59:53.684745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.674991+0000","last_change":"2023-10-06T02:59:44.074625+0000","last_active":"2023-10-06T02:59:53.674991+0000","last_peered":"2023-10-06T02:59:53.674991+0000","last_clean":"2023-10-06T02:59:53.674991+0000","last_became_active":"2023-10-06T02:59:44.072854+0000","last_became_peered":"2023-10-06T02:59:44.072854+0000","last_unstale":"2023-10-06T02:59:53.674991+0000","last_undegraded":"2023-10-06T02:59:53.674991+0000","last_fullsized":"2023-10-06T02:59:53.674991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_clean_scrub_stamp":"2023-10-06T02:59:43.039151+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:04.936706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668581+0000","last_change":"2023-10-06T02:59:49.107090+0000","last_active":"2023-10-06T02:59:53.668581+0000","last_peered":"2023-10-06T02:59:53.668581+0000","last_clean":"2023-10-06T02:59:53.668581+0000","last_became_active":"2023-10-06T02:59:49.106619+0000","last_became_peered":"2023-10-06T02:59:49.106619+0000","last_unstale":"2023-10-06T02:59:53.668581+0000","last_undegraded":"2023-10-06T02:59:53.668581+0000","last_fullsized":"2023-10-06T02:59:53.668581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.658030+0000","last_change":"2023-10-06T02:59:53.298769+0000","last_active":"2023-10-06T02:59:53.658030+0000","last_peered":"2023-10-06T02:59:53.658030+0000","last_clean":"2023-10-06T02:59:53.658030+0000","last_became_active":"2023-10-06T02:59:53.298012+0000","last_became_peered":"2023-10-06T02:59:53.298012+0000","last_unstale":"2023-10-06T02:59:53.658030+0000","last_undegraded":"2023-10-06T02:59:53.658030+0000","last_fullsized":"2023-10-06T02:59:53.658030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681729+0000","last_change":"2023-10-06T02:59:53.679625+0000","last_active":"2023-10-06T02:59:53.681729+0000","last_peered":"2023-10-06T02:59:53.681729+0000","last_clean":"2023-10-06T02:59:53.681729+0000","last_became_active":"2023-10-06T02:59:53.679200+0000","last_became_peered":"2023-10-06T02:59:53.679200+0000","last_unstale":"2023-10-06T02:59:53.681729+0000","last_undegraded":"2023-10-06T02:59:53.681729+0000","last_fullsized":"2023-10-06T02:59:53.681729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:59.309901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.671317+0000","last_change":"2023-10-06T02:59:49.107231+0000","last_active":"2023-10-06T02:59:53.671317+0000","last_peered":"2023-10-06T02:59:53.671317+0000","last_clean":"2023-10-06T02:59:53.671317+0000","last_became_active":"2023-10-06T02:59:49.106878+0000","last_became_peered":"2023-10-06T02:59:49.106878+0000","last_unstale":"2023-10-06T02:59:53.671317+0000","last_undegraded":"2023-10-06T02:59:53.671317+0000","last_fullsized":"2023-10-06T02:59:53.671317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668411+0000","last_change":"2023-10-06T02:59:53.296937+0000","last_active":"2023-10-06T02:59:53.668411+0000","last_peered":"2023-10-06T02:59:53.668411+0000","last_clean":"2023-10-06T02:59:53.668411+0000","last_became_active":"2023-10-06T02:59:53.296171+0000","last_became_peered":"2023-10-06T02:59:53.296171+0000","last_unstale":"2023-10-06T02:59:53.668411+0000","last_undegraded":"2023-10-06T02:59:53.668411+0000","last_fullsized":"2023-10-06T02:59:53.668411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684479+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T02:59:53.684479+0000","last_peered":"2023-10-06T02:59:53.684479+0000","last_clean":"2023-10-06T02:59:53.684479+0000","last_became_active":"2023-10-06T02:59:53.681786+0000","last_became_peered":"2023-10-06T02:59:53.681786+0000","last_unstale":"2023-10-06T02:59:53.684479+0000","last_undegraded":"2023-10-06T02:59:53.684479+0000","last_fullsized":"2023-10-06T02:59:53.684479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669847+0000","last_change":"2023-10-06T02:59:49.115200+0000","last_active":"2023-10-06T02:59:53.669847+0000","last_peered":"2023-10-06T02:59:53.669847+0000","last_clean":"2023-10-06T02:59:53.669847+0000","last_became_active":"2023-10-06T02:59:49.114769+0000","last_became_peered":"2023-10-06T02:59:49.114769+0000","last_unstale":"2023-10-06T02:59:53.669847+0000","last_undegraded":"2023-10-06T02:59:53.669847+0000","last_fullsized":"2023-10-06T02:59:53.669847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:37.773233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.665174+0000","last_change":"2023-10-06T02:59:53.298658+0000","last_active":"2023-10-06T02:59:53.665174+0000","last_peered":"2023-10-06T02:59:53.665174+0000","last_clean":"2023-10-06T02:59:53.665174+0000","last_became_active":"2023-10-06T02:59:53.298054+0000","last_became_peered":"2023-10-06T02:59:53.298054+0000","last_unstale":"2023-10-06T02:59:53.665174+0000","last_undegraded":"2023-10-06T02:59:53.665174+0000","last_fullsized":"2023-10-06T02:59:53.665174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681569+0000","last_change":"2023-10-06T02:59:53.673950+0000","last_active":"2023-10-06T02:59:53.681569+0000","last_peered":"2023-10-06T02:59:53.681569+0000","last_clean":"2023-10-06T02:59:53.681569+0000","last_became_active":"2023-10-06T02:59:53.673677+0000","last_became_peered":"2023-10-06T02:59:53.673677+0000","last_unstale":"2023-10-06T02:59:53.681569+0000","last_undegraded":"2023-10-06T02:59:53.681569+0000","last_fullsized":"2023-10-06T02:59:53.681569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668455+0000","last_change":"2023-10-06T02:59:49.107944+0000","last_active":"2023-10-06T02:59:53.668455+0000","last_peered":"2023-10-06T02:59:53.668455+0000","last_clean":"2023-10-06T02:59:53.668455+0000","last_became_active":"2023-10-06T02:59:49.107560+0000","last_became_peered":"2023-10-06T02:59:49.107560+0000","last_unstale":"2023-10-06T02:59:53.668455+0000","last_undegraded":"2023-10-06T02:59:53.668455+0000","last_fullsized":"2023-10-06T02:59:53.668455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.671674+0000","last_change":"2023-10-06T02:59:53.300945+0000","last_active":"2023-10-06T02:59:53.671674+0000","last_peered":"2023-10-06T02:59:53.671674+0000","last_clean":"2023-10-06T02:59:53.671674+0000","last_became_active":"2023-10-06T02:59:53.300609+0000","last_became_peered":"2023-10-06T02:59:53.300609+0000","last_unstale":"2023-10-06T02:59:53.671674+0000","last_undegraded":"2023-10-06T02:59:53.671674+0000","last_fullsized":"2023-10-06T02:59:53.671674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682292+0000","last_change":"2023-10-06T02:59:53.677554+0000","last_active":"2023-10-06T02:59:53.682292+0000","last_peered":"2023-10-06T02:59:53.682292+0000","last_clean":"2023-10-06T02:59:53.682292+0000","last_became_active":"2023-10-06T02:59:53.677245+0000","last_became_peered":"2023-10-06T02:59:53.677245+0000","last_unstale":"2023-10-06T02:59:53.682292+0000","last_undegraded":"2023-10-06T02:59:53.682292+0000","last_fullsized":"2023-10-06T02:59:53.682292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668605+0000","last_change":"2023-10-06T02:59:53.301191+0000","last_active":"2023-10-06T02:59:53.668605+0000","last_peered":"2023-10-06T02:59:53.668605+0000","last_clean":"2023-10-06T02:59:53.668605+0000","last_became_active":"2023-10-06T02:59:53.300919+0000","last_became_peered":"2023-10-06T02:59:53.300919+0000","last_unstale":"2023-10-06T02:59:53.668605+0000","last_undegraded":"2023-10-06T02:59:53.668605+0000","last_fullsized":"2023-10-06T02:59:53.668605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669826+0000","last_change":"2023-10-06T02:59:49.108499+0000","last_active":"2023-10-06T02:59:53.669826+0000","last_peered":"2023-10-06T02:59:53.669826+0000","last_clean":"2023-10-06T02:59:53.669826+0000","last_became_active":"2023-10-06T02:59:49.107967+0000","last_became_peered":"2023-10-06T02:59:49.107967+0000","last_unstale":"2023-10-06T02:59:53.669826+0000","last_undegraded":"2023-10-06T02:59:53.669826+0000","last_fullsized":"2023-10-06T02:59:53.669826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682251+0000","last_change":"2023-10-06T02:59:53.676753+0000","last_active":"2023-10-06T02:59:53.682251+0000","last_peered":"2023-10-06T02:59:53.682251+0000","last_clean":"2023-10-06T02:59:53.682251+0000","last_became_active":"2023-10-06T02:59:53.676385+0000","last_became_peered":"2023-10-06T02:59:53.676385+0000","last_unstale":"2023-10-06T02:59:53.682251+0000","last_undegraded":"2023-10-06T02:59:53.682251+0000","last_fullsized":"2023-10-06T02:59:53.682251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669538+0000","last_change":"2023-10-06T02:59:53.303221+0000","last_active":"2023-10-06T02:59:53.669538+0000","last_peered":"2023-10-06T02:59:53.669538+0000","last_clean":"2023-10-06T02:59:53.669538+0000","last_became_active":"2023-10-06T02:59:53.302890+0000","last_became_peered":"2023-10-06T02:59:53.302890+0000","last_unstale":"2023-10-06T02:59:53.669538+0000","last_undegraded":"2023-10-06T02:59:53.669538+0000","last_fullsized":"2023-10-06T02:59:53.669538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.670899+0000","last_change":"2023-10-06T02:59:49.102005+0000","last_active":"2023-10-06T02:59:53.670899+0000","last_peered":"2023-10-06T02:59:53.670899+0000","last_clean":"2023-10-06T02:59:53.670899+0000","last_became_active":"2023-10-06T02:59:49.101530+0000","last_became_peered":"2023-10-06T02:59:49.101530+0000","last_unstale":"2023-10-06T02:59:53.670899+0000","last_undegraded":"2023-10-06T02:59:53.670899+0000","last_fullsized":"2023-10-06T02:59:53.670899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.675026+0000","last_change":"2023-10-06T02:59:53.672581+0000","last_active":"2023-10-06T02:59:53.675026+0000","last_peered":"2023-10-06T02:59:53.675026+0000","last_clean":"2023-10-06T02:59:53.675026+0000","last_became_active":"2023-10-06T02:59:53.672299+0000","last_became_peered":"2023-10-06T02:59:53.672299+0000","last_unstale":"2023-10-06T02:59:53.675026+0000","last_undegraded":"2023-10-06T02:59:53.675026+0000","last_fullsized":"2023-10-06T02:59:53.675026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.293712+0000","last_change":"2023-10-06T02:59:53.300135+0000","last_active":"2023-10-06T02:59:54.293712+0000","last_peered":"2023-10-06T02:59:54.293712+0000","last_clean":"2023-10-06T02:59:54.293712+0000","last_became_active":"2023-10-06T02:59:53.299271+0000","last_became_peered":"2023-10-06T02:59:53.299271+0000","last_unstale":"2023-10-06T02:59:54.293712+0000","last_undegraded":"2023-10-06T02:59:54.293712+0000","last_fullsized":"2023-10-06T02:59:54.293712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.672088+0000","last_change":"2023-10-06T02:59:49.100171+0000","last_active":"2023-10-06T02:59:53.672088+0000","last_peered":"2023-10-06T02:59:53.672088+0000","last_clean":"2023-10-06T02:59:53.672088+0000","last_became_active":"2023-10-06T02:59:49.099689+0000","last_became_peered":"2023-10-06T02:59:49.099689+0000","last_unstale":"2023-10-06T02:59:53.672088+0000","last_undegraded":"2023-10-06T02:59:53.672088+0000","last_fullsized":"2023-10-06T02:59:53.672088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687100+0000","last_change":"2023-10-06T02:59:53.685270+0000","last_active":"2023-10-06T02:59:53.687100+0000","last_peered":"2023-10-06T02:59:53.687100+0000","last_clean":"2023-10-06T02:59:53.687100+0000","last_became_active":"2023-10-06T02:59:53.684983+0000","last_became_peered":"2023-10-06T02:59:53.684983+0000","last_unstale":"2023-10-06T02:59:53.687100+0000","last_undegraded":"2023-10-06T02:59:53.687100+0000","last_fullsized":"2023-10-06T02:59:53.687100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:49.904101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668939+0000","last_change":"2023-10-06T02:59:53.301048+0000","last_active":"2023-10-06T02:59:53.668939+0000","last_peered":"2023-10-06T02:59:53.668939+0000","last_clean":"2023-10-06T02:59:53.668939+0000","last_became_active":"2023-10-06T02:59:53.300086+0000","last_became_peered":"2023-10-06T02:59:53.300086+0000","last_unstale":"2023-10-06T02:59:53.668939+0000","last_undegraded":"2023-10-06T02:59:53.668939+0000","last_fullsized":"2023-10-06T02:59:53.668939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.663390+0000","last_change":"2023-10-06T02:59:49.102935+0000","last_active":"2023-10-06T02:59:53.663390+0000","last_peered":"2023-10-06T02:59:53.663390+0000","last_clean":"2023-10-06T02:59:53.663390+0000","last_became_active":"2023-10-06T02:59:49.102397+0000","last_became_peered":"2023-10-06T02:59:49.102397+0000","last_unstale":"2023-10-06T02:59:53.663390+0000","last_undegraded":"2023-10-06T02:59:53.663390+0000","last_fullsized":"2023-10-06T02:59:53.663390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683104+0000","last_change":"2023-10-06T02:59:53.676229+0000","last_active":"2023-10-06T02:59:53.683104+0000","last_peered":"2023-10-06T02:59:53.683104+0000","last_clean":"2023-10-06T02:59:53.683104+0000","last_became_active":"2023-10-06T02:59:53.675895+0000","last_became_peered":"2023-10-06T02:59:53.675895+0000","last_unstale":"2023-10-06T02:59:53.683104+0000","last_undegraded":"2023-10-06T02:59:53.683104+0000","last_fullsized":"2023-10-06T02:59:53.683104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:03.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682155+0000","last_change":"2023-10-06T02:59:53.676843+0000","last_active":"2023-10-06T02:59:53.682155+0000","last_peered":"2023-10-06T02:59:53.682155+0000","last_clean":"2023-10-06T02:59:53.682155+0000","last_became_active":"2023-10-06T02:59:53.676528+0000","last_became_peered":"2023-10-06T02:59:53.676528+0000","last_unstale":"2023-10-06T02:59:53.682155+0000","last_undegraded":"2023-10-06T02:59:53.682155+0000","last_fullsized":"2023-10-06T02:59:53.682155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.296186+0000","last_change":"2023-10-06T02:59:53.294557+0000","last_active":"2023-10-06T02:59:54.296186+0000","last_peered":"2023-10-06T02:59:54.296186+0000","last_clean":"2023-10-06T02:59:54.296186+0000","last_became_active":"2023-10-06T02:59:53.291434+0000","last_became_peered":"2023-10-06T02:59:53.291434+0000","last_unstale":"2023-10-06T02:59:54.296186+0000","last_undegraded":"2023-10-06T02:59:54.296186+0000","last_fullsized":"2023-10-06T02:59:54.296186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684770+0000","last_change":"2023-10-06T02:59:53.678204+0000","last_active":"2023-10-06T02:59:53.684770+0000","last_peered":"2023-10-06T02:59:53.684770+0000","last_clean":"2023-10-06T02:59:53.684770+0000","last_became_active":"2023-10-06T02:59:53.677924+0000","last_became_peered":"2023-10-06T02:59:53.677924+0000","last_unstale":"2023-10-06T02:59:53.684770+0000","last_undegraded":"2023-10-06T02:59:53.684770+0000","last_fullsized":"2023-10-06T02:59:53.684770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292832+0000","last_change":"2023-10-06T02:59:53.301253+0000","last_active":"2023-10-06T02:59:54.292832+0000","last_peered":"2023-10-06T02:59:54.292832+0000","last_clean":"2023-10-06T02:59:54.292832+0000","last_became_active":"2023-10-06T02:59:53.300926+0000","last_became_peered":"2023-10-06T02:59:53.300926+0000","last_unstale":"2023-10-06T02:59:54.292832+0000","last_undegraded":"2023-10-06T02:59:54.292832+0000","last_fullsized":"2023-10-06T02:59:54.292832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:21.432516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668818+0000","last_change":"2023-10-06T02:59:53.292844+0000","last_active":"2023-10-06T02:59:53.668818+0000","last_peered":"2023-10-06T02:59:53.668818+0000","last_clean":"2023-10-06T02:59:53.668818+0000","last_became_active":"2023-10-06T02:59:53.292493+0000","last_became_peered":"2023-10-06T02:59:53.292493+0000","last_unstale":"2023-10-06T02:59:53.668818+0000","last_undegraded":"2023-10-06T02:59:53.668818+0000","last_fullsized":"2023-10-06T02:59:53.668818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681376+0000","last_change":"2023-10-06T02:59:53.676684+0000","last_active":"2023-10-06T02:59:53.681376+0000","last_peered":"2023-10-06T02:59:53.681376+0000","last_clean":"2023-10-06T02:59:53.681376+0000","last_became_active":"2023-10-06T02:59:53.676410+0000","last_became_peered":"2023-10-06T02:59:53.676410+0000","last_unstale":"2023-10-06T02:59:53.681376+0000","last_undegraded":"2023-10-06T02:59:53.681376+0000","last_fullsized":"2023-10-06T02:59:53.681376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668711+0000","last_change":"2023-10-06T02:59:53.293924+0000","last_active":"2023-10-06T02:59:53.668711+0000","last_peered":"2023-10-06T02:59:53.668711+0000","last_clean":"2023-10-06T02:59:53.668711+0000","last_became_active":"2023-10-06T02:59:53.293596+0000","last_became_peered":"2023-10-06T02:59:53.293596+0000","last_unstale":"2023-10-06T02:59:53.668711+0000","last_undegraded":"2023-10-06T02:59:53.668711+0000","last_fullsized":"2023-10-06T02:59:53.668711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681521+0000","last_change":"2023-10-06T02:59:53.673847+0000","last_active":"2023-10-06T02:59:53.681521+0000","last_peered":"2023-10-06T02:59:53.681521+0000","last_clean":"2023-10-06T02:59:53.681521+0000","last_became_active":"2023-10-06T02:59:53.673559+0000","last_became_peered":"2023-10-06T02:59:53.673559+0000","last_unstale":"2023-10-06T02:59:53.681521+0000","last_undegraded":"2023-10-06T02:59:53.681521+0000","last_fullsized":"2023-10-06T02:59:53.681521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.678028+0000","last_change":"2023-10-06T02:59:53.674388+0000","last_active":"2023-10-06T02:59:53.678028+0000","last_peered":"2023-10-06T02:59:53.678028+0000","last_clean":"2023-10-06T02:59:53.678028+0000","last_became_active":"2023-10-06T02:59:53.674086+0000","last_became_peered":"2023-10-06T02:59:53.674086+0000","last_unstale":"2023-10-06T02:59:53.678028+0000","last_undegraded":"2023-10-06T02:59:53.678028+0000","last_fullsized":"2023-10-06T02:59:53.678028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.658043+0000","last_change":"2023-10-06T02:59:53.296871+0000","last_active":"2023-10-06T02:59:53.658043+0000","last_peered":"2023-10-06T02:59:53.658043+0000","last_clean":"2023-10-06T02:59:53.658043+0000","last_became_active":"2023-10-06T02:59:53.296550+0000","last_became_peered":"2023-10-06T02:59:53.296550+0000","last_unstale":"2023-10-06T02:59:53.658043+0000","last_undegraded":"2023-10-06T02:59:53.658043+0000","last_fullsized":"2023-10-06T02:59:53.658043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687227+0000","last_change":"2023-10-06T02:59:53.683771+0000","last_active":"2023-10-06T02:59:53.687227+0000","last_peered":"2023-10-06T02:59:53.687227+0000","last_clean":"2023-10-06T02:59:53.687227+0000","last_became_active":"2023-10-06T02:59:53.683458+0000","last_became_peered":"2023-10-06T02:59:53.683458+0000","last_unstale":"2023-10-06T02:59:53.687227+0000","last_undegraded":"2023-10-06T02:59:53.687227+0000","last_fullsized":"2023-10-06T02:59:53.687227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669694+0000","last_change":"2023-10-06T02:59:53.301158+0000","last_active":"2023-10-06T02:59:53.669694+0000","last_peered":"2023-10-06T02:59:53.669694+0000","last_clean":"2023-10-06T02:59:53.669694+0000","last_became_active":"2023-10-06T02:59:53.300797+0000","last_became_peered":"2023-10-06T02:59:53.300797+0000","last_unstale":"2023-10-06T02:59:53.669694+0000","last_undegraded":"2023-10-06T02:59:53.669694+0000","last_fullsized":"2023-10-06T02:59:53.669694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.686119+0000","last_change":"2023-10-06T02:59:53.683576+0000","last_active":"2023-10-06T02:59:53.686119+0000","last_peered":"2023-10-06T02:59:53.686119+0000","last_clean":"2023-10-06T02:59:53.686119+0000","last_became_active":"2023-10-06T02:59:53.683301+0000","last_became_peered":"2023-10-06T02:59:53.683301+0000","last_unstale":"2023-10-06T02:59:53.686119+0000","last_undegraded":"2023-10-06T02:59:53.686119+0000","last_fullsized":"2023-10-06T02:59:53.686119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.290397+0000","last_change":"2023-10-06T02:59:53.297975+0000","last_active":"2023-10-06T02:59:54.290397+0000","last_peered":"2023-10-06T02:59:54.290397+0000","last_clean":"2023-10-06T02:59:54.290397+0000","last_became_active":"2023-10-06T02:59:53.297724+0000","last_became_peered":"2023-10-06T02:59:53.297724+0000","last_unstale":"2023-10-06T02:59:54.290397+0000","last_undegraded":"2023-10-06T02:59:54.290397+0000","last_fullsized":"2023-10-06T02:59:54.290397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.689406+0000","last_change":"2023-10-06T02:59:53.684667+0000","last_active":"2023-10-06T02:59:53.689406+0000","last_peered":"2023-10-06T02:59:53.689406+0000","last_clean":"2023-10-06T02:59:53.689406+0000","last_became_active":"2023-10-06T02:59:53.684378+0000","last_became_peered":"2023-10-06T02:59:53.684378+0000","last_unstale":"2023-10-06T02:59:53.689406+0000","last_undegraded":"2023-10-06T02:59:53.689406+0000","last_fullsized":"2023-10-06T02:59:53.689406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:40.914600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.288809+0000","last_change":"2023-10-06T02:59:53.298276+0000","last_active":"2023-10-06T02:59:54.288809+0000","last_peered":"2023-10-06T02:59:54.288809+0000","last_clean":"2023-10-06T02:59:54.288809+0000","last_became_active":"2023-10-06T02:59:53.297471+0000","last_became_peered":"2023-10-06T02:59:53.297471+0000","last_unstale":"2023-10-06T02:59:54.288809+0000","last_undegraded":"2023-10-06T02:59:54.288809+0000","last_fullsized":"2023-10-06T02:59:54.288809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684717+0000","last_change":"2023-10-06T02:59:53.679138+0000","last_active":"2023-10-06T02:59:53.684717+0000","last_peered":"2023-10-06T02:59:53.684717+0000","last_clean":"2023-10-06T02:59:53.684717+0000","last_became_active":"2023-10-06T02:59:53.678831+0000","last_became_peered":"2023-10-06T02:59:53.678831+0000","last_unstale":"2023-10-06T02:59:53.684717+0000","last_undegraded":"2023-10-06T02:59:53.684717+0000","last_fullsized":"2023-10-06T02:59:53.684717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:25.273960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292430+0000","last_change":"2023-10-06T02:59:53.295949+0000","last_active":"2023-10-06T02:59:54.292430+0000","last_peered":"2023-10-06T02:59:54.292430+0000","last_clean":"2023-10-06T02:59:54.292430+0000","last_became_active":"2023-10-06T02:59:53.295697+0000","last_became_peered":"2023-10-06T02:59:53.295697+0000","last_unstale":"2023-10-06T02:59:54.292430+0000","last_undegraded":"2023-10-06T02:59:54.292430+0000","last_fullsized":"2023-10-06T02:59:54.292430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682283+0000","last_change":"2023-10-06T02:59:53.673079+0000","last_active":"2023-10-06T02:59:53.682283+0000","last_peered":"2023-10-06T02:59:53.682283+0000","last_clean":"2023-10-06T02:59:53.682283+0000","last_became_active":"2023-10-06T02:59:53.672629+0000","last_became_peered":"2023-10-06T02:59:53.672629+0000","last_unstale":"2023-10-06T02:59:53.682283+0000","last_undegraded":"2023-10-06T02:59:53.682283+0000","last_fullsized":"2023-10-06T02:59:53.682283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292559+0000","last_change":"2023-10-06T02:59:53.297170+0000","last_active":"2023-10-06T02:59:54.292559+0000","last_peered":"2023-10-06T02:59:54.292559+0000","last_clean":"2023-10-06T02:59:54.292559+0000","last_became_active":"2023-10-06T02:59:53.296843+0000","last_became_peered":"2023-10-06T02:59:53.296843+0000","last_unstale":"2023-10-06T02:59:54.292559+0000","last_undegraded":"2023-10-06T02:59:54.292559+0000","last_fullsized":"2023-10-06T02:59:54.292559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681280+0000","last_change":"2023-10-06T02:59:53.675030+0000","last_active":"2023-10-06T02:59:53.681280+0000","last_peered":"2023-10-06T02:59:53.681280+0000","last_clean":"2023-10-06T02:59:53.681280+0000","last_became_active":"2023-10-06T02:59:53.673662+0000","last_became_peered":"2023-10-06T02:59:53.673662+0000","last_unstale":"2023-10-06T02:59:53.681280+0000","last_undegraded":"2023-10-06T02:59:53.681280+0000","last_fullsized":"2023-10-06T02:59:53.681280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.294000+0000","last_change":"2023-10-06T02:59:53.299596+0000","last_active":"2023-10-06T02:59:54.294000+0000","last_peered":"2023-10-06T02:59:54.294000+0000","last_clean":"2023-10-06T02:59:54.294000+0000","last_became_active":"2023-10-06T02:59:53.298881+0000","last_became_peered":"2023-10-06T02:59:53.298881+0000","last_unstale":"2023-10-06T02:59:54.294000+0000","last_undegraded":"2023-10-06T02:59:54.294000+0000","last_fullsized":"2023-10-06T02:59:54.294000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681995+0000","last_change":"2023-10-06T02:59:53.675391+0000","last_active":"2023-10-06T02:59:53.681995+0000","last_peered":"2023-10-06T02:59:53.681995+0000","last_clean":"2023-10-06T02:59:53.681995+0000","last_became_active":"2023-10-06T02:59:53.675092+0000","last_became_peered":"2023-10-06T02:59:53.675092+0000","last_unstale":"2023-10-06T02:59:53.681995+0000","last_undegraded":"2023-10-06T02:59:53.681995+0000","last_fullsized":"2023-10-06T02:59:53.681995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292391+0000","last_change":"2023-10-06T02:59:53.294074+0000","last_active":"2023-10-06T02:59:54.292391+0000","last_peered":"2023-10-06T02:59:54.292391+0000","last_clean":"2023-10-06T02:59:54.292391+0000","last_became_active":"2023-10-06T02:59:53.293752+0000","last_became_peered":"2023-10-06T02:59:53.293752+0000","last_unstale":"2023-10-06T02:59:54.292391+0000","last_undegraded":"2023-10-06T02:59:54.292391+0000","last_fullsized":"2023-10-06T02:59:54.292391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":686098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":94602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":95570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":94068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.970000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.218}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0860000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.6239999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":684900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:59:57.640 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:59:57.640 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T02:59:57.640 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T02:59:57.640 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T02:59:57.641 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T02:59:57.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb8163a3700 1 Processor -- start 2023-10-06T02:59:57.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb8163a3700 1 -- start start 2023-10-06T02:59:57.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb8163a3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb81006ab10 0x7fb8100b94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb8163a3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb8100b34e0 0x7fb8100b8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb8163a3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb810146570 0x7fb8101469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb8163a3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8101495e0 con 0x7fb81006ab10 2023-10-06T02:59:57.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb8163a3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb810146ef0 con 0x7fb8100b34e0 2023-10-06T02:59:57.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb8163a3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100b3930 con 0x7fb810146570 2023-10-06T02:59:57.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb80ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb81006ab10 0x7fb8100b94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb80f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb8100b34e0 0x7fb8100b8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb80ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb81006ab10 0x7fb8100b94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59174/0 (socket says 172.21.15.27:59174) 2023-10-06T02:59:57.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb80ffff700 1 -- 172.21.15.27:0/346957520 learned_addr learned my addr 172.21.15.27:0/346957520 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:57.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb814940700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb810146570 0x7fb8101469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb80f7fe700 1 -- 172.21.15.27:0/346957520 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb810146570 msgr2=0x7fb8101469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb80f7fe700 1 --2- 172.21.15.27:0/346957520 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb810146570 0x7fb8101469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb80f7fe700 1 -- 172.21.15.27:0/346957520 >> v2:172.21.15.27:3300/0 conn(0x7fb81006ab10 msgr2=0x7fb8100b94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb80f7fe700 1 --2- 172.21.15.27:0/346957520 >> v2:172.21.15.27:3300/0 conn(0x7fb81006ab10 0x7fb8100b94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb80f7fe700 1 -- 172.21.15.27:0/346957520 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81014d590 con 0x7fb8100b34e0 2023-10-06T02:59:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb80f7fe700 1 --2- 172.21.15.27:0/346957520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8100b34e0 0x7fb8100b8bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb8100b48f0 tx=0x7fb800009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9acd2518394aacea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb80effd700 1 -- 172.21.15.27:0/346957520 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80000e070 con 0x7fb8100b34e0 2023-10-06T02:59:57.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb80effd700 1 -- 172.21.15.27:0/346957520 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80000bab0 con 0x7fb8100b34e0 2023-10-06T02:59:57.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.743+0000 7fb80effd700 1 -- 172.21.15.27:0/346957520 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80000be50 con 0x7fb8100b34e0 2023-10-06T02:59:57.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.747+0000 7fb8163a3700 1 -- 172.21.15.27:0/346957520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8100b34e0 msgr2=0x7fb8100b8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.747+0000 7fb8163a3700 1 --2- 172.21.15.27:0/346957520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8100b34e0 0x7fb8100b8bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb8100b48f0 tx=0x7fb800009780 comp rx=0 tx=0).stop 2023-10-06T02:59:57.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.747+0000 7fb8163a3700 1 -- 172.21.15.27:0/346957520 shutdown_connections 2023-10-06T02:59:57.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.747+0000 7fb8163a3700 1 --2- 172.21.15.27:0/346957520 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb810146570 0x7fb8101469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.747+0000 7fb8163a3700 1 --2- 172.21.15.27:0/346957520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8100b34e0 0x7fb8100b8bd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.747+0000 7fb8163a3700 1 --2- 172.21.15.27:0/346957520 >> v2:172.21.15.27:3300/0 conn(0x7fb81006ab10 0x7fb8100b94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.747+0000 7fb8163a3700 1 -- 172.21.15.27:0/346957520 >> 172.21.15.27:0/346957520 conn(0x7fb8100bde40 msgr2=0x7fb8100be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:57.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.747+0000 7fb8163a3700 1 -- 172.21.15.27:0/346957520 shutdown_connections 2023-10-06T02:59:57.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.747+0000 7fb8163a3700 1 -- 172.21.15.27:0/346957520 wait complete. 2023-10-06T02:59:57.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.747+0000 7fb8163a3700 1 Processor -- start 2023-10-06T02:59:57.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.747+0000 7fb8163a3700 1 -- start start 2023-10-06T02:59:57.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb8163a3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb81006ab10 0x7fb8100b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb8163a3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8100b34e0 0x7fb8100b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb8163a3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb810146570 0x7fb810140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb8163a3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100b4b00 con 0x7fb8100b34e0 2023-10-06T02:59:57.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb8163a3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100b50c0 con 0x7fb81006ab10 2023-10-06T02:59:57.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb8163a3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100b4d50 con 0x7fb810146570 2023-10-06T02:59:57.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb80f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8100b34e0 0x7fb8100b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb80f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8100b34e0 0x7fb8100b7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59190/0 (socket says 172.21.15.27:59190) 2023-10-06T02:59:57.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb80f7fe700 1 -- 172.21.15.27:0/4073798423 learned_addr learned my addr 172.21.15.27:0/4073798423 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:57.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb80ffff700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb81006ab10 0x7fb8100b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb814940700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb810146570 0x7fb810140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb80f7fe700 1 -- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb810146570 msgr2=0x7fb810140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb80f7fe700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb810146570 0x7fb810140350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb80f7fe700 1 -- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb81006ab10 msgr2=0x7fb8100b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb80f7fe700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb81006ab10 0x7fb8100b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb80f7fe700 1 -- 172.21.15.27:0/4073798423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800009a20 con 0x7fb8100b34e0 2023-10-06T02:59:57.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb80ffff700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb81006ab10 0x7fb8100b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:57.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb80f7fe700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8100b34e0 0x7fb8100b7990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb80000b610 tx=0x7fb800019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb807fff700 1 -- 172.21.15.27:0/4073798423 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800007000 con 0x7fb8100b34e0 2023-10-06T02:59:57.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb8163a3700 1 -- 172.21.15.27:0/4073798423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81015c660 con 0x7fb8100b34e0 2023-10-06T02:59:57.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb807fff700 1 -- 172.21.15.27:0/4073798423 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb800012be0 con 0x7fb8100b34e0 2023-10-06T02:59:57.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb8163a3700 1 -- 172.21.15.27:0/4073798423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81015e760 con 0x7fb8100b34e0 2023-10-06T02:59:57.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb807fff700 1 -- 172.21.15.27:0/4073798423 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8000263f0 con 0x7fb8100b34e0 2023-10-06T02:59:57.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.751+0000 7fb8163a3700 1 -- 172.21.15.27:0/4073798423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81015ea10 con 0x7fb8100b34e0 2023-10-06T02:59:57.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.755+0000 7fb807fff700 1 -- 172.21.15.27:0/4073798423 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb8000267a0 con 0x7fb8100b34e0 2023-10-06T02:59:57.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.755+0000 7fb807fff700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb7f0060550 0x7fb7f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.755+0000 7fb807fff700 1 -- 172.21.15.27:0/4073798423 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb80007ecc0 con 0x7fb8100b34e0 2023-10-06T02:59:57.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.755+0000 7fb80ffff700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb7f0060550 0x7fb7f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.755+0000 7fb80ffff700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb7f0060550 0x7fb7f0062a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8006d40 tx=0x7fb7f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.763+0000 7fb807fff700 1 -- 172.21.15.27:0/4073798423 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb80004f150 con 0x7fb8100b34e0 2023-10-06T02:59:57.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.963+0000 7fb8163a3700 1 -- 172.21.15.27:0/4073798423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb81004be40 con 0x7fb8100b34e0 2023-10-06T02:59:57.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.967+0000 7fb807fff700 1 -- 172.21.15.27:0/4073798423 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154136 (secure 0 0 0) 0x7fb800052770 con 0x7fb8100b34e0 2023-10-06T02:59:57.976 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.971+0000 7fb8163a3700 1 -- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb7f0060550 msgr2=0x7fb7f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.971+0000 7fb8163a3700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb7f0060550 0x7fb7f0062a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8006d40 tx=0x7fb7f8008040 comp rx=0 tx=0).stop 2023-10-06T02:59:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.971+0000 7fb8163a3700 1 -- 172.21.15.27:0/4073798423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8100b34e0 msgr2=0x7fb8100b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.971+0000 7fb8163a3700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8100b34e0 0x7fb8100b7990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb80000b610 tx=0x7fb800019000 comp rx=0 tx=0).stop 2023-10-06T02:59:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.971+0000 7fb8163a3700 1 -- 172.21.15.27:0/4073798423 shutdown_connections 2023-10-06T02:59:57.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.971+0000 7fb8163a3700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb7f0060550 0x7fb7f0062a00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.971+0000 7fb8163a3700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb810146570 0x7fb810140350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.971+0000 7fb8163a3700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8100b34e0 0x7fb8100b7990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.971+0000 7fb8163a3700 1 --2- 172.21.15.27:0/4073798423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb81006ab10 0x7fb8100b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.971+0000 7fb8163a3700 1 -- 172.21.15.27:0/4073798423 >> 172.21.15.27:0/4073798423 conn(0x7fb8100bde40 msgr2=0x7fb8100be210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:57.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.971+0000 7fb8163a3700 1 -- 172.21.15.27:0/4073798423 shutdown_connections 2023-10-06T02:59:57.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:57.971+0000 7fb8163a3700 1 -- 172.21.15.27:0/4073798423 wait complete. 2023-10-06T02:59:57.992 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":33327},{"type":"v1","addr":"172.21.15.123:6833","nonce":33327}]},"active_addr":"172.21.15.123:6833/33327","active_change":"2023-10-06T02:59:32.943868+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2117892785}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":836472375}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":3063027658}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":350902908}]}]} 2023-10-06T02:59:57.996 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T02:59:57.996 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T02:59:57.996 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:58.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.099+0000 7f5a98a49700 1 Processor -- start 2023-10-06T02:59:58.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.099+0000 7f5a98a49700 1 -- start start 2023-10-06T02:59:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a98a49700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a9406d3d0 0x7f5a941450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a98a49700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5a9406b900 0x7f5a941455e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a98a49700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9414bf90 con 0x7f5a940bbcd0 2023-10-06T02:59:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a98a49700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a940b4900 con 0x7f5a9406b900 2023-10-06T02:59:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a98a49700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9414c270 con 0x7f5a9406d3d0 2023-10-06T02:59:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a93fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5a940bbcd0 0x7f5a9414eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52238/0 (socket says 172.21.15.27:52238) 2023-10-06T02:59:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a92ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5a9406b900 0x7f5a941455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a93fff700 1 -- 172.21.15.27:0/1612466961 learned_addr learned my addr 172.21.15.27:0/1612466961 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a937fe700 1 --2- 172.21.15.27:0/1612466961 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a9406d3d0 0x7f5a941450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a927fc700 1 -- 172.21.15.27:0/1612466961 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862505919 0 0) 0x7f5a9414bf90 con 0x7f5a940bbcd0 2023-10-06T02:59:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a927fc700 1 -- 172.21.15.27:0/1612466961 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a7c003570 con 0x7f5a940bbcd0 2023-10-06T02:59:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a92ffd700 1 -- 172.21.15.27:0/1612466961 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a9406d3d0 msgr2=0x7f5a941450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a92ffd700 1 --2- 172.21.15.27:0/1612466961 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a9406d3d0 0x7f5a941450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a92ffd700 1 -- 172.21.15.27:0/1612466961 >> v1:172.21.15.27:6789/0 conn(0x7f5a940bbcd0 legacy=0x7f5a9414eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a92ffd700 1 -- 172.21.15.27:0/1612466961 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a94069970 con 0x7f5a9406b900 2023-10-06T02:59:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a92ffd700 1 --2- 172.21.15.27:0/1612466961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a9406b900 0x7f5a941455e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a880098e0 tx=0x7f5a880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75c749f306c9e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a927fc700 1 -- 172.21.15.27:0/1612466961 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88011630 con 0x7f5a9406b900 2023-10-06T02:59:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a927fc700 1 -- 172.21.15.27:0/1612466961 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a88011790 con 0x7f5a9406b900 2023-10-06T02:59:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a927fc700 1 -- 172.21.15.27:0/1612466961 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88011b30 con 0x7f5a9406b900 2023-10-06T02:59:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a98a49700 1 -- 172.21.15.27:0/1612466961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a9406b900 msgr2=0x7f5a941455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.103+0000 7f5a98a49700 1 --2- 172.21.15.27:0/1612466961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a9406b900 0x7f5a941455e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a880098e0 tx=0x7f5a880091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 -- 172.21.15.27:0/1612466961 shutdown_connections 2023-10-06T02:59:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 --2- 172.21.15.27:0/1612466961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a9406b900 0x7f5a941455e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 --2- 172.21.15.27:0/1612466961 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a9406d3d0 0x7f5a941450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 -- 172.21.15.27:0/1612466961 >> 172.21.15.27:0/1612466961 conn(0x7f5a940bae20 msgr2=0x7f5a940bb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 -- 172.21.15.27:0/1612466961 shutdown_connections 2023-10-06T02:59:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 -- 172.21.15.27:0/1612466961 wait complete. 2023-10-06T02:59:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 Processor -- start 2023-10-06T02:59:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 -- start start 2023-10-06T02:59:58.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a9406b900 0x7f5a9414ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a9406d3d0 0x7f5a9413de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a940bbcd0 0x7f5a9413e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9415aef0 con 0x7f5a9406b900 2023-10-06T02:59:58.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9413e8a0 con 0x7f5a940bbcd0 2023-10-06T02:59:58.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.107+0000 7f5a98a49700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9414f2a0 con 0x7f5a9406d3d0 2023-10-06T02:59:58.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a937fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a9406b900 0x7f5a9414ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a937fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a9406b900 0x7f5a9414ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59208/0 (socket says 172.21.15.27:59208) 2023-10-06T02:59:58.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a937fe700 1 -- 172.21.15.27:0/560860979 learned_addr learned my addr 172.21.15.27:0/560860979 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a93fff700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a940bbcd0 0x7f5a9413e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a92ffd700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a9406d3d0 0x7f5a9413de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a937fe700 1 -- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a9406d3d0 msgr2=0x7f5a9413de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a937fe700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a9406d3d0 0x7f5a9413de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a937fe700 1 -- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a940bbcd0 msgr2=0x7f5a9413e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a937fe700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a940bbcd0 0x7f5a9413e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a937fe700 1 -- 172.21.15.27:0/560860979 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a88009420 con 0x7f5a9406b900 2023-10-06T02:59:58.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a92ffd700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a9406d3d0 0x7f5a9413de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:58.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a937fe700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a9406b900 0x7f5a9414ed60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400ec80 tx=0x7f5a840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a7b7fe700 1 -- 172.21.15.27:0/560860979 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8400c850 con 0x7f5a9406b900 2023-10-06T02:59:58.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a7b7fe700 1 -- 172.21.15.27:0/560860979 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8400c9b0 con 0x7f5a9406b900 2023-10-06T02:59:58.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a98a49700 1 -- 172.21.15.27:0/560860979 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9413f1b0 con 0x7f5a9406b900 2023-10-06T02:59:58.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a7b7fe700 1 -- 172.21.15.27:0/560860979 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8400cd50 con 0x7f5a9406b900 2023-10-06T02:59:58.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a98a49700 1 -- 172.21.15.27:0/560860979 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a94150810 con 0x7f5a9406b900 2023-10-06T02:59:58.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a98a49700 1 -- 172.21.15.27:0/560860979 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9413f010 con 0x7f5a9406b900 2023-10-06T02:59:58.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.111+0000 7f5a7b7fe700 1 -- 172.21.15.27:0/560860979 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5a84013680 con 0x7f5a9406b900 2023-10-06T02:59:58.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.115+0000 7f5a7b7fe700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5a80060550 0x7f5a80062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.115+0000 7f5a7b7fe700 1 -- 172.21.15.27:0/560860979 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5a8407cbb0 con 0x7f5a9406b900 2023-10-06T02:59:58.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.115+0000 7f5a92ffd700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5a80060550 0x7f5a80062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.115+0000 7f5a92ffd700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5a80060550 0x7f5a80062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5a9406bd10 tx=0x7f5a88017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.123+0000 7f5a7b7fe700 1 -- 172.21.15.27:0/560860979 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5a9413f010 con 0x7f5a9406b900 2023-10-06T02:59:58.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.283+0000 7f5a98a49700 1 -- 172.21.15.27:0/560860979 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a9413f010 con 0x7f5a9406b900 2023-10-06T02:59:58.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.287+0000 7f5a7b7fe700 1 -- 172.21.15.27:0/560860979 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f5a9413f010 con 0x7f5a9406b900 2023-10-06T02:59:58.292 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:58.292 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":24,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:54.652472+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:59:47.570918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:51.949130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:52.638817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:58.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.287+0000 7f5a98a49700 1 -- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5a80060550 msgr2=0x7f5a80062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.287+0000 7f5a98a49700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5a80060550 0x7f5a80062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5a9406bd10 tx=0x7f5a88017000 comp rx=0 tx=0).stop 2023-10-06T02:59:58.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.287+0000 7f5a98a49700 1 -- 172.21.15.27:0/560860979 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a9406b900 msgr2=0x7f5a9414ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.287+0000 7f5a98a49700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a9406b900 0x7f5a9414ed60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400ec80 tx=0x7f5a840091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.287+0000 7f5a98a49700 1 -- 172.21.15.27:0/560860979 shutdown_connections 2023-10-06T02:59:58.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.287+0000 7f5a98a49700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5a80060550 0x7f5a80062a00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.287+0000 7f5a98a49700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a940bbcd0 0x7f5a9413e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.287+0000 7f5a98a49700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a9406d3d0 0x7f5a9413de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.287+0000 7f5a98a49700 1 --2- 172.21.15.27:0/560860979 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a9406b900 0x7f5a9414ed60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.287+0000 7f5a98a49700 1 -- 172.21.15.27:0/560860979 >> 172.21.15.27:0/560860979 conn(0x7f5a940bae20 msgr2=0x7f5a940b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.287+0000 7f5a98a49700 1 -- 172.21.15.27:0/560860979 shutdown_connections 2023-10-06T02:59:58.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.287+0000 7f5a98a49700 1 -- 172.21.15.27:0/560860979 wait complete. 2023-10-06T02:59:58.307 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T02:59:58.307 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:58.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.407+0000 7fc748c8b700 1 Processor -- start 2023-10-06T02:59:58.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.407+0000 7fc748c8b700 1 -- start start 2023-10-06T02:59:58.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7440be150 0x7fc74406cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc7440b5520 0x7fc7440b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc7440b5ec0 0x7fc74406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74406d0f0 con 0x7fc7440b5520 2023-10-06T02:59:58.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7440a2310 con 0x7fc7440b5ec0 2023-10-06T02:59:58.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440a2680 con 0x7fc7440be150 2023-10-06T02:59:58.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc742ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc7440b5520 0x7fc7440b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc742ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc7440b5520 0x7fc7440b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59218/0 (socket says 172.21.15.27:59218) 2023-10-06T02:59:58.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc742ffd700 1 -- 172.21.15.27:0/23505434 learned_addr learned my addr 172.21.15.27:0/23505434 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc743fff700 1 --2- 172.21.15.27:0/23505434 >> v2:172.21.15.123:3300/0 conn(0x7fc7440b5ec0 0x7fc74406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc7437fe700 1 --2- 172.21.15.27:0/23505434 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7440be150 0x7fc74406cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc742ffd700 1 -- 172.21.15.27:0/23505434 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7440be150 msgr2=0x7fc74406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc742ffd700 1 --2- 172.21.15.27:0/23505434 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7440be150 0x7fc74406cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc742ffd700 1 -- 172.21.15.27:0/23505434 >> v2:172.21.15.123:3300/0 conn(0x7fc7440b5ec0 msgr2=0x7fc74406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc742ffd700 1 --2- 172.21.15.27:0/23505434 >> v2:172.21.15.123:3300/0 conn(0x7fc7440b5ec0 0x7fc74406b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc742ffd700 1 -- 172.21.15.27:0/23505434 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7440bd1d0 con 0x7fc7440b5520 2023-10-06T02:59:58.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc7437fe700 1 --2- 172.21.15.27:0/23505434 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7440be150 0x7fc74406cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:58.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc742ffd700 1 --2- 172.21.15.27:0/23505434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7440b5520 0x7fc7440b5980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7440639c0 tx=0x7fc734009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74797f5cd74d279a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc7427fc700 1 -- 172.21.15.27:0/23505434 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73400b860 con 0x7fc7440b5520 2023-10-06T02:59:58.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc7427fc700 1 -- 172.21.15.27:0/23505434 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73400b9c0 con 0x7fc7440b5520 2023-10-06T02:59:58.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc7427fc700 1 -- 172.21.15.27:0/23505434 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73400bd60 con 0x7fc7440b5520 2023-10-06T02:59:58.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 -- 172.21.15.27:0/23505434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7440b5520 msgr2=0x7fc7440b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 --2- 172.21.15.27:0/23505434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7440b5520 0x7fc7440b5980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7440639c0 tx=0x7fc734009250 comp rx=0 tx=0).stop 2023-10-06T02:59:58.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 -- 172.21.15.27:0/23505434 shutdown_connections 2023-10-06T02:59:58.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 --2- 172.21.15.27:0/23505434 >> v2:172.21.15.123:3300/0 conn(0x7fc7440b5ec0 0x7fc74406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 --2- 172.21.15.27:0/23505434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7440b5520 0x7fc7440b5980 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 --2- 172.21.15.27:0/23505434 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7440be150 0x7fc74406cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 -- 172.21.15.27:0/23505434 >> 172.21.15.27:0/23505434 conn(0x7fc7440bf440 msgr2=0x7fc74406df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 -- 172.21.15.27:0/23505434 shutdown_connections 2023-10-06T02:59:58.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.411+0000 7fc748c8b700 1 -- 172.21.15.27:0/23505434 wait complete. 2023-10-06T02:59:58.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc748c8b700 1 Processor -- start 2023-10-06T02:59:58.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc748c8b700 1 -- start start 2023-10-06T02:59:58.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc748c8b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7440b5520 0x7fc74415eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc748c8b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7440b5ec0 0x7fc74415f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc748c8b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7440be150 0x7fc7440b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc748c8b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440a6030 con 0x7fc7440b5ec0 2023-10-06T02:59:58.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc748c8b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440b8250 con 0x7fc7440be150 2023-10-06T02:59:58.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc748c8b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440a5630 con 0x7fc7440b5520 2023-10-06T02:59:58.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc742ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7440b5ec0 0x7fc74415f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc742ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7440b5ec0 0x7fc74415f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59226/0 (socket says 172.21.15.27:59226) 2023-10-06T02:59:58.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc742ffd700 1 -- 172.21.15.27:0/1067883831 learned_addr learned my addr 172.21.15.27:0/1067883831 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc7437fe700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7440b5520 0x7fc74415eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc743fff700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7440be150 0x7fc7440b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc742ffd700 1 -- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7440b5520 msgr2=0x7fc74415eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc742ffd700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7440b5520 0x7fc74415eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc742ffd700 1 -- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7440be150 msgr2=0x7fc7440b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc742ffd700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7440be150 0x7fc7440b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.415+0000 7fc742ffd700 1 -- 172.21.15.27:0/1067883831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7340094f0 con 0x7fc7440b5ec0 2023-10-06T02:59:58.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.419+0000 7fc742ffd700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7440b5ec0 0x7fc74415f020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc744087070 tx=0x7fc734017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.419+0000 7fc72b7fe700 1 -- 172.21.15.27:0/1067883831 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734024440 con 0x7fc7440b5ec0 2023-10-06T02:59:58.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.419+0000 7fc72b7fe700 1 -- 172.21.15.27:0/1067883831 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7340245c0 con 0x7fc7440b5ec0 2023-10-06T02:59:58.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.419+0000 7fc748c8b700 1 -- 172.21.15.27:0/1067883831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74415f560 con 0x7fc7440b5ec0 2023-10-06T02:59:58.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.419+0000 7fc72b7fe700 1 -- 172.21.15.27:0/1067883831 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734024980 con 0x7fc7440b5ec0 2023-10-06T02:59:58.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.419+0000 7fc748c8b700 1 -- 172.21.15.27:0/1067883831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7440a52b0 con 0x7fc7440b5ec0 2023-10-06T02:59:58.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.419+0000 7fc748c8b700 1 -- 172.21.15.27:0/1067883831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7440a61a0 con 0x7fc7440b5ec0 2023-10-06T02:59:58.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.419+0000 7fc72b7fe700 1 -- 172.21.15.27:0/1067883831 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc73401a420 con 0x7fc7440b5ec0 2023-10-06T02:59:58.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.419+0000 7fc72b7fe700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc730060550 0x7fc730062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.419+0000 7fc72b7fe700 1 -- 172.21.15.27:0/1067883831 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc73407e530 con 0x7fc7440b5ec0 2023-10-06T02:59:58.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.423+0000 7fc7437fe700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc730060550 0x7fc730062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.423+0000 7fc7437fe700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc730060550 0x7fc730062a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc73800adc0 tx=0x7fc738006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.431+0000 7fc72b7fe700 1 -- 172.21.15.27:0/1067883831 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc7440a61a0 con 0x7fc7440b5ec0 2023-10-06T02:59:58.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.591+0000 7fc748c8b700 1 -- 172.21.15.27:0/1067883831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7440a6170 con 0x7fc7440b5ec0 2023-10-06T02:59:58.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.595+0000 7fc72b7fe700 1 -- 172.21.15.27:0/1067883831 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fc73404eae0 con 0x7fc7440b5ec0 2023-10-06T02:59:58.600 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T02:59:58.600 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":24,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:54.652472+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:59:47.570918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:51.949130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:52.638817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:58.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.595+0000 7fc748c8b700 1 -- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc730060550 msgr2=0x7fc730062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.595+0000 7fc748c8b700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc730060550 0x7fc730062a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc73800adc0 tx=0x7fc738006f90 comp rx=0 tx=0).stop 2023-10-06T02:59:58.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.595+0000 7fc748c8b700 1 -- 172.21.15.27:0/1067883831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7440b5ec0 msgr2=0x7fc74415f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.595+0000 7fc748c8b700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7440b5ec0 0x7fc74415f020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc744087070 tx=0x7fc734017000 comp rx=0 tx=0).stop 2023-10-06T02:59:58.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.595+0000 7fc748c8b700 1 -- 172.21.15.27:0/1067883831 shutdown_connections 2023-10-06T02:59:58.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.595+0000 7fc748c8b700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fc730060550 0x7fc730062a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.595+0000 7fc748c8b700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7440be150 0x7fc7440b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.595+0000 7fc748c8b700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7440b5ec0 0x7fc74415f020 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.595+0000 7fc748c8b700 1 --2- 172.21.15.27:0/1067883831 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7440b5520 0x7fc74415eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.595+0000 7fc748c8b700 1 -- 172.21.15.27:0/1067883831 >> 172.21.15.27:0/1067883831 conn(0x7fc7440bf440 msgr2=0x7fc74406eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.595+0000 7fc748c8b700 1 -- 172.21.15.27:0/1067883831 shutdown_connections 2023-10-06T02:59:58.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.595+0000 7fc748c8b700 1 -- 172.21.15.27:0/1067883831 wait complete. 2023-10-06T02:59:58.614 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T02:59:58.615 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T02:59:58.615 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T02:59:58.615 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T02:59:58.616 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T02:59:58.616 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T02:59:58.617 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T02:59:58.617 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T02:59:58.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7fd363fff700 1 Processor -- start 2023-10-06T02:59:58.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7fd363fff700 1 -- start start 2023-10-06T02:59:58.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7f4a77fff700 1 Processor -- start 2023-10-06T02:59:58.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7f4a77fff700 1 -- start start 2023-10-06T02:59:58.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7fd363fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3640a02a0 0x7fd3640867c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7fd363fff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd364086d00 con 0x7fd36415fe80 2023-10-06T02:59:58.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7fd363fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36409fc50 con 0x7fd364160250 2023-10-06T02:59:58.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7fd363fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd364160af0 con 0x7fd3640a02a0 2023-10-06T02:59:58.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7fd362ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd36415fe80 0x7fd3640860b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44432/0 (socket says 172.21.15.27:44432) 2023-10-06T02:59:58.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7fd362ffd700 1 -- 172.21.15.27:0/2003479910 learned_addr learned my addr 172.21.15.27:0/2003479910 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:58.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7f4a77fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a7814eb70 0x7f4a7809fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7f4a77fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4a780a02a0 0x7f4a7814ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7f4a77fff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7809f5a0 con 0x7f4a7809e3f0 2023-10-06T02:59:58.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7f4a77fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7814f880 con 0x7f4a780a02a0 2023-10-06T02:59:58.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7f4a77fff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7814f5a0 con 0x7f4a7814eb70 2023-10-06T02:59:58.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7f4a777fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4a7809e3f0 0x7f4a7806b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44446/0 (socket says 172.21.15.27:44446) 2023-10-06T02:59:58.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7f4a777fe700 1 -- 172.21.15.27:0/1681367792 learned_addr learned my addr 172.21.15.27:0/1681367792 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:58.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7fd3627fc700 1 --2- 172.21.15.27:0/2003479910 >> v2:172.21.15.123:3300/0 conn(0x7fd3640a02a0 0x7fd3640867c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7f4a76ffd700 1 --2- 172.21.15.27:0/1681367792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a7814eb70 0x7f4a7809fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122591047 0 0) 0x7fd354001110 con 0x7fd36415fe80 2023-10-06T02:59:58.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd34c003570 con 0x7fd36415fe80 2023-10-06T02:59:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a767fc700 1 --2- 172.21.15.27:0/1681367792 >> v2:172.21.15.123:3300/0 conn(0x7f4a780a02a0 0x7f4a7814ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.755+0000 7f4a75ffb700 1 -- 172.21.15.27:0/1681367792 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804649430 0 0) 0x7f4a7809f5a0 con 0x7f4a7809e3f0 2023-10-06T02:59:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a75ffb700 1 -- 172.21.15.27:0/1681367792 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a60003570 con 0x7f4a7809e3f0 2023-10-06T02:59:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 384571873 0 0) 0x7fd34c003570 con 0x7fd36415fe80 2023-10-06T02:59:58.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 >> v2:172.21.15.123:3300/0 conn(0x7fd3640a02a0 msgr2=0x7fd3640867c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 --2- 172.21.15.27:0/2003479910 >> v2:172.21.15.123:3300/0 conn(0x7fd3640a02a0 0x7fd3640867c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 >> v1:172.21.15.123:6789/0 conn(0x7fd364160250 legacy=0x7fd36406c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364160710 con 0x7fd36415fe80 2023-10-06T02:59:58.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1323929577 0 0) 0x7fd354001600 con 0x7fd36415fe80 2023-10-06T02:59:58.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 >> v1:172.21.15.27:6789/0 conn(0x7fd36415fe80 legacy=0x7fd3640860b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a76ffd700 1 -- 172.21.15.27:0/1681367792 >> v2:172.21.15.123:3300/0 conn(0x7f4a780a02a0 msgr2=0x7f4a7814ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a76ffd700 1 --2- 172.21.15.27:0/1681367792 >> v2:172.21.15.123:3300/0 conn(0x7f4a780a02a0 0x7f4a7814ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a76ffd700 1 -- 172.21.15.27:0/1681367792 >> v1:172.21.15.27:6789/0 conn(0x7f4a7809e3f0 legacy=0x7f4a7806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a76ffd700 1 -- 172.21.15.27:0/1681367792 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7806d020 con 0x7f4a7814eb70 2023-10-06T02:59:58.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a767fc700 1 --2- 172.21.15.27:0/1681367792 >> v2:172.21.15.123:3300/0 conn(0x7f4a780a02a0 0x7f4a7814ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:58.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 --2- 172.21.15.27:0/2003479910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd34c003b30 0x7fd34c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 --2- 172.21.15.27:0/2003479910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd34c004810 0x7fd34c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 --2- 172.21.15.27:0/2003479910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd34c0052e0 0x7fd34c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd364160af0 con 0x7fd34c004810 2023-10-06T02:59:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c00c190 con 0x7fd34c0052e0 2023-10-06T02:59:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c00c350 con 0x7fd34c003b30 2023-10-06T02:59:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd362ffd700 1 --2- 172.21.15.27:0/2003479910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd34c003b30 0x7fd34c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd3627fc700 1 --2- 172.21.15.27:0/2003479910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd34c004810 0x7fd34c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a76ffd700 1 --2- 172.21.15.27:0/1681367792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a7814eb70 0x7f4a7809fa30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a70009e60 tx=0x7f4a70009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afdd5c4e1c3b5a21 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd3637fe700 1 --2- 172.21.15.27:0/2003479910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd34c0052e0 0x7fd34c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd3627fc700 1 -- 172.21.15.27:0/2003479910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd34c003b30 msgr2=0x7fd34c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd3627fc700 1 --2- 172.21.15.27:0/2003479910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd34c003b30 0x7fd34c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd3627fc700 1 -- 172.21.15.27:0/2003479910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd34c0052e0 msgr2=0x7fd34c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd3627fc700 1 --2- 172.21.15.27:0/2003479910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd34c0052e0 0x7fd34c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd3627fc700 1 -- 172.21.15.27:0/2003479910 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c003570 con 0x7fd34c004810 2023-10-06T02:59:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd3637fe700 1 --2- 172.21.15.27:0/2003479910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd34c0052e0 0x7fd34c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd3637fe700 1 -- 172.21.15.27:0/2003479910 reap_dead start 2023-10-06T02:59:58.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a75ffb700 1 -- 172.21.15.27:0/1681367792 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7000e070 con 0x7f4a7814eb70 2023-10-06T02:59:58.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a75ffb700 1 -- 172.21.15.27:0/1681367792 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7000bb60 con 0x7f4a7814eb70 2023-10-06T02:59:58.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a75ffb700 1 -- 172.21.15.27:0/1681367792 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70012430 con 0x7f4a7814eb70 2023-10-06T02:59:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd3627fc700 1 --2- 172.21.15.27:0/2003479910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd34c004810 0x7fd34c004c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd3640a0670 tx=0x7fd35c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8898992192a3445 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c00ea90 con 0x7fd34c004810 2023-10-06T02:59:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c00f040 con 0x7fd34c004810 2023-10-06T02:59:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd361ffb700 1 -- 172.21.15.27:0/2003479910 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c00ee40 con 0x7fd34c004810 2023-10-06T02:59:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f2de529d700 1 Processor -- start 2023-10-06T02:59:58.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd665828700 1 Processor -- start 2023-10-06T02:59:58.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a77fff700 1 -- 172.21.15.27:0/1681367792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a7814eb70 msgr2=0x7f4a7809fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a77fff700 1 --2- 172.21.15.27:0/1681367792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a7814eb70 0x7f4a7809fa30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a70009e60 tx=0x7f4a70009780 comp rx=0 tx=0).stop 2023-10-06T02:59:58.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a77fff700 1 -- 172.21.15.27:0/1681367792 shutdown_connections 2023-10-06T02:59:58.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a77fff700 1 --2- 172.21.15.27:0/1681367792 >> v2:172.21.15.123:3300/0 conn(0x7f4a780a02a0 0x7f4a7814ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a77fff700 1 --2- 172.21.15.27:0/1681367792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a7814eb70 0x7f4a7809fa30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a77fff700 1 -- 172.21.15.27:0/1681367792 >> 172.21.15.27:0/1681367792 conn(0x7f4a7806e040 msgr2=0x7f4a7806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a77fff700 1 -- 172.21.15.27:0/1681367792 shutdown_connections 2023-10-06T02:59:58.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a77fff700 1 -- 172.21.15.27:0/1681367792 wait complete. 2023-10-06T02:59:58.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd363fff700 1 -- 172.21.15.27:0/2003479910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd34c004810 msgr2=0x7fd34c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd363fff700 1 --2- 172.21.15.27:0/2003479910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd34c004810 0x7fd34c004c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd3640a0670 tx=0x7fd35c00b040 comp rx=0 tx=0).stop 2023-10-06T02:59:58.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd665828700 1 -- start start 2023-10-06T02:59:58.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd665828700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6600baec0 0x7fd6601487e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd665828700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd6600a0a30 0x7fd66009d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd665828700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd66009d850 0x7fd66006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd665828700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd660148d20 con 0x7fd6600a0a30 2023-10-06T02:59:58.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd665828700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd66009dcd0 con 0x7fd66009d850 2023-10-06T02:59:58.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd665828700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd660147a80 con 0x7fd6600baec0 2023-10-06T02:59:58.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd65ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd6600a0a30 0x7fd66009d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd65ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd6600a0a30 0x7fd66009d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48636/0 (socket says 172.21.15.27:48636) 2023-10-06T02:59:58.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd65ffff700 1 -- 172.21.15.27:0/3654331910 learned_addr learned my addr 172.21.15.27:0/3654331910 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a77fff700 1 Processor -- start 2023-10-06T02:59:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f4a77fff700 1 -- start start 2023-10-06T02:59:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f2de529d700 1 -- start start 2023-10-06T02:59:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f2de529d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2de00bafc0 0x7f2de00686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f2de529d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2de00bb390 0x7f2de0068c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f2de529d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2de00ba090 0x7f2de0069150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f2de529d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de01539f0 con 0x7f2de00ba090 2023-10-06T02:59:58.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7fd664826700 1 --2- 172.21.15.27:0/3654331910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6600baec0 0x7fd6601487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f2de529d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de0153150 con 0x7f2de00bafc0 2023-10-06T02:59:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.759+0000 7f2de529d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de006a420 con 0x7f2de00bb390 2023-10-06T02:59:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd665027700 1 --2- 172.21.15.27:0/3654331910 >> v2:172.21.15.123:3300/0 conn(0x7fd66009d850 0x7fd66006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd65ffff700 1 -- 172.21.15.27:0/3654331910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6600baec0 msgr2=0x7fd6601487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd65ffff700 1 --2- 172.21.15.27:0/3654331910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6600baec0 0x7fd6601487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd65ffff700 1 -- 172.21.15.27:0/3654331910 >> v2:172.21.15.123:3300/0 conn(0x7fd66009d850 msgr2=0x7fd66006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd65ffff700 1 --2- 172.21.15.27:0/3654331910 >> v2:172.21.15.123:3300/0 conn(0x7fd66009d850 0x7fd66006c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd65ffff700 1 -- 172.21.15.27:0/3654331910 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd660147d00 con 0x7fd6600a0a30 2023-10-06T02:59:58.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2dde7fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2de00bb390 0x7f2de0068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2ddf7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2de00ba090 0x7f2de0069150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2dde7fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2de00bb390 0x7f2de0068c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.27:53784/0 (socket says 172.21.15.27:53784) 2023-10-06T02:59:58.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2dde7fc700 1 -- 172.21.15.27:0/219059488 learned_addr learned my addr 172.21.15.27:0/219059488 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2ddeffd700 1 --2- 172.21.15.27:0/219059488 >> v2:172.21.15.123:3300/0 conn(0x7f2de00bafc0 0x7f2de00686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd665027700 1 --2- 172.21.15.27:0/3654331910 >> v2:172.21.15.123:3300/0 conn(0x7fd66009d850 0x7fd66006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:58.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd664826700 1 --2- 172.21.15.27:0/3654331910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6600baec0 0x7fd6601487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:58.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd363fff700 1 -- 172.21.15.27:0/2003479910 shutdown_connections 2023-10-06T02:59:58.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd363fff700 1 --2- 172.21.15.27:0/2003479910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd34c004810 0x7fd34c004c80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd363fff700 1 -- 172.21.15.27:0/2003479910 >> 172.21.15.27:0/2003479910 conn(0x7fd36406e040 msgr2=0x7fd36406e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd65ffff700 1 --2- 172.21.15.27:0/3654331910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6600a0a30 0x7fd66009d310 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd6600a05f0 tx=0x7fd658009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d631790b3b414c06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2ddf7fe700 1 -- 172.21.15.27:0/219059488 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2de00bb390 msgr2=0x7f2de0068c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2ddf7fe700 1 --2- 172.21.15.27:0/219059488 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2de00bb390 0x7f2de0068c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2ddf7fe700 1 -- 172.21.15.27:0/219059488 >> v2:172.21.15.123:3300/0 conn(0x7f2de00bafc0 msgr2=0x7f2de00686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2ddf7fe700 1 --2- 172.21.15.27:0/219059488 >> v2:172.21.15.123:3300/0 conn(0x7f2de00bafc0 0x7f2de00686d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2ddf7fe700 1 -- 172.21.15.27:0/219059488 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de01533a0 con 0x7f2de00ba090 2023-10-06T02:59:58.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee09653700 1 Processor -- start 2023-10-06T02:59:58.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65d5cb2700 1 Processor -- start 2023-10-06T02:59:58.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee09653700 1 -- start start 2023-10-06T02:59:58.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65d5cb2700 1 -- start start 2023-10-06T02:59:58.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a77fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a7809e3f0 0x7f4a7814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2ddf7fe700 1 --2- 172.21.15.27:0/219059488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2de00ba090 0x7f2de0069150 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2de0067e00 tx=0x7f2dd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627856ca8b346349 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a77fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a780a02a0 0x7f4a7814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a77fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a7814eb70 0x7f4a7815e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a77fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7815f470 con 0x7f4a7814eb70 2023-10-06T02:59:58.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a77fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7809ccf0 con 0x7f4a780a02a0 2023-10-06T02:59:58.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a77fff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7809c980 con 0x7f4a7809e3f0 2023-10-06T02:59:58.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd363fff700 1 -- 172.21.15.27:0/2003479910 shutdown_connections 2023-10-06T02:59:58.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a777fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a7814eb70 0x7f4a7815e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a777fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a7814eb70 0x7f4a7815e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48658/0 (socket says 172.21.15.27:48658) 2023-10-06T02:59:58.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a777fe700 1 -- 172.21.15.27:0/1388258829 learned_addr learned my addr 172.21.15.27:0/1388258829 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a767fc700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a780a02a0 0x7f4a7814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a76ffd700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a7809e3f0 0x7f4a7814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a777fe700 1 -- 172.21.15.27:0/1388258829 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a7809e3f0 msgr2=0x7f4a7814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a777fe700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a7809e3f0 0x7f4a7814abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a777fe700 1 -- 172.21.15.27:0/1388258829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a780a02a0 msgr2=0x7f4a7814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a777fe700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a780a02a0 0x7f4a7814b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a777fe700 1 -- 172.21.15.27:0/1388258829 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a70009a20 con 0x7f4a7814eb70 2023-10-06T02:59:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a777fe700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a7814eb70 0x7f4a7815e660 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4a680010e0 tx=0x7f4a68007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a5effd700 1 -- 172.21.15.27:0/1388258829 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68005c00 con 0x7f4a7814eb70 2023-10-06T02:59:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a77fff700 1 -- 172.21.15.27:0/1388258829 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7814b660 con 0x7f4a7814eb70 2023-10-06T02:59:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a77fff700 1 -- 172.21.15.27:0/1388258829 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7809b9c0 con 0x7f4a7814eb70 2023-10-06T02:59:58.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a5effd700 1 -- 172.21.15.27:0/1388258829 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a68005d60 con 0x7f4a7814eb70 2023-10-06T02:59:58.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f4a5effd700 1 -- 172.21.15.27:0/1388258829 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a680072e0 con 0x7f4a7814eb70 2023-10-06T02:59:58.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65d5cb2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65d009f7a0 0x7f65d009fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65d5cb2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f65d006c6b0 0x7f65d0148990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65d5cb2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d0149fc0 con 0x7f65d006b1d0 2023-10-06T02:59:58.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65d5cb2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d00a3120 con 0x7f65d006c6b0 2023-10-06T02:59:58.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65d5cb2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0149970 con 0x7f65d009f7a0 2023-10-06T02:59:58.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd65f7fe700 1 -- 172.21.15.27:0/3654331910 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65800e070 con 0x7fd6600a0a30 2023-10-06T02:59:58.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd65f7fe700 1 -- 172.21.15.27:0/3654331910 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65800ba50 con 0x7fd6600a0a30 2023-10-06T02:59:58.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd65f7fe700 1 -- 172.21.15.27:0/3654331910 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6580092e0 con 0x7fd6600a0a30 2023-10-06T02:59:58.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd363fff700 1 -- 172.21.15.27:0/2003479910 wait complete. 2023-10-06T02:59:58.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee09653700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee040ba0c0 0x7fee04068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee09653700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fee0406c910 0x7fee0406cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee09653700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee04147e50 con 0x7fee0406a100 2023-10-06T02:59:58.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee09653700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0414c180 con 0x7fee0406c910 2023-10-06T02:59:58.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee09653700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee04147bb0 con 0x7fee040ba0c0 2023-10-06T02:59:58.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee02ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee040ba0c0 0x7fee04068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee02ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee040ba0c0 0x7fee04068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:54654/0 (socket says 172.21.15.27:54654) 2023-10-06T02:59:58.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee02ffd700 1 -- 172.21.15.27:0/3141132300 learned_addr learned my addr 172.21.15.27:0/3141132300 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee037fe700 1 --2- 172.21.15.27:0/3141132300 >> v2:172.21.15.27:3300/0 conn(0x7fee0406c910 0x7fee0406cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f9c6e9a6700 1 Processor -- start 2023-10-06T02:59:58.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f9c6e9a6700 1 -- start start 2023-10-06T02:59:58.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f9c6e9a6700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c680bb390 0x7f9c68068de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f9c6e9a6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9c680ba090 0x7f9c6814fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f9c6e9a6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c681539f0 con 0x7f9c680bafc0 2023-10-06T02:59:58.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f9c6e9a6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c68153150 con 0x7f9c680ba090 2023-10-06T02:59:58.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f9c6e9a6700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6806a420 con 0x7f9c680bb390 2023-10-06T02:59:58.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2dddffb700 1 -- 172.21.15.27:0/219059488 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd000b650 con 0x7f2de00ba090 2023-10-06T02:59:58.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2dddffb700 1 -- 172.21.15.27:0/219059488 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd000b7d0 con 0x7f2de00ba090 2023-10-06T02:59:58.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2dddffb700 1 -- 172.21.15.27:0/219059488 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd000bb90 con 0x7f2de00ba090 2023-10-06T02:59:58.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2de529d700 1 -- 172.21.15.27:0/219059488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2de00ba090 msgr2=0x7f2de0069150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f2de529d700 1 --2- 172.21.15.27:0/219059488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2de00ba090 0x7f2de0069150 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2de0067e00 tx=0x7f2dd00091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd665828700 1 -- 172.21.15.27:0/3654331910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6600a0a30 msgr2=0x7fd66009d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd665828700 1 --2- 172.21.15.27:0/3654331910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6600a0a30 0x7fd66009d310 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd6600a05f0 tx=0x7fd658009840 comp rx=0 tx=0).stop 2023-10-06T02:59:58.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd665828700 1 -- 172.21.15.27:0/3654331910 shutdown_connections 2023-10-06T02:59:58.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd665828700 1 --2- 172.21.15.27:0/3654331910 >> v2:172.21.15.123:3300/0 conn(0x7fd66009d850 0x7fd66006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd665828700 1 --2- 172.21.15.27:0/3654331910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6600a0a30 0x7fd66009d310 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd665828700 1 --2- 172.21.15.27:0/3654331910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6600baec0 0x7fd6601487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd665828700 1 -- 172.21.15.27:0/3654331910 >> 172.21.15.27:0/3654331910 conn(0x7fd66006eb10 msgr2=0x7fd6600ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd665828700 1 -- 172.21.15.27:0/3654331910 shutdown_connections 2023-10-06T02:59:58.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fd665828700 1 -- 172.21.15.27:0/3654331910 wait complete. 2023-10-06T02:59:58.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f9c6cf43700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9c680ba090 0x7f9c6814fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f9c6cf43700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9c680ba090 0x7f9c6814fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48670/0 (socket says 172.21.15.27:48670) 2023-10-06T02:59:58.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f9c6cf43700 1 -- 172.21.15.27:0/2519880182 learned_addr learned my addr 172.21.15.27:0/2519880182 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f9c677fe700 1 --2- 172.21.15.27:0/2519880182 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c680bb390 0x7f9c68068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f542152e700 1 Processor -- start 2023-10-06T02:59:58.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f542152e700 1 -- start start 2023-10-06T02:59:58.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 -- 172.21.15.27:0/219059488 shutdown_connections 2023-10-06T02:59:58.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 --2- 172.21.15.27:0/219059488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2de00ba090 0x7f2de0069150 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 --2- 172.21.15.27:0/219059488 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2de00bb390 0x7f2de0068c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 --2- 172.21.15.27:0/219059488 >> v2:172.21.15.123:3300/0 conn(0x7f2de00bafc0 0x7f2de00686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 -- 172.21.15.27:0/219059488 >> 172.21.15.27:0/219059488 conn(0x7f2de00be770 msgr2=0x7f2de00ba710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee02ffd700 1 -- 172.21.15.27:0/3141132300 >> v2:172.21.15.27:3300/0 conn(0x7fee0406c910 msgr2=0x7fee0406cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee02ffd700 1 --2- 172.21.15.27:0/3141132300 >> v2:172.21.15.27:3300/0 conn(0x7fee0406c910 0x7fee0406cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee02ffd700 1 -- 172.21.15.27:0/3141132300 >> v1:172.21.15.27:6789/0 conn(0x7fee0406a100 legacy=0x7fee040bae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7fee02ffd700 1 -- 172.21.15.27:0/3141132300 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee04069200 con 0x7fee040ba0c0 2023-10-06T02:59:58.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 -- 172.21.15.27:0/219059488 shutdown_connections 2023-10-06T02:59:58.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fee02ffd700 1 --2- 172.21.15.27:0/3141132300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee040ba0c0 0x7fee04068cc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fee040bed30 tx=0x7fedf4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f89a42a0ccda2fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 -- 172.21.15.27:0/219059488 wait complete. 2023-10-06T02:59:58.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f4a77fff700 1 -- 172.21.15.27:0/1388258829 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a58000fd0 con 0x7f4a7814eb70 2023-10-06T02:59:58.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd363fff700 1 Processor -- start 2023-10-06T02:59:58.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65d4cb0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65d009f7a0 0x7f65d009fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65d4cb0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65d009f7a0 0x7f65d009fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.27:53800/0 (socket says 172.21.15.27:53800) 2023-10-06T02:59:58.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65d4cb0700 1 -- 172.21.15.27:0/4207116977 learned_addr learned my addr 172.21.15.27:0/4207116977 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65cffff700 1 --2- 172.21.15.27:0/4207116977 >> v2:172.21.15.123:3300/0 conn(0x7f65d006c6b0 0x7f65d0148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65cffff700 1 -- 172.21.15.27:0/4207116977 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65d009f7a0 msgr2=0x7f65d009fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65cffff700 1 --2- 172.21.15.27:0/4207116977 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65d009f7a0 0x7f65d009fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65cffff700 1 -- 172.21.15.27:0/4207116977 >> v1:172.21.15.123:6789/0 conn(0x7f65d006b1d0 legacy=0x7f65d0148ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:59:58.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.763+0000 7f65cffff700 1 -- 172.21.15.27:0/4207116977 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d0149c50 con 0x7f65d006c6b0 2023-10-06T02:59:58.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f65cffff700 1 --2- 172.21.15.27:0/4207116977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d006c6b0 0x7f65d0148990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f65c40098e0 tx=0x7f65c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e181d5d8a00fe4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd363fff700 1 -- start start 2023-10-06T02:59:58.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd665828700 1 Processor -- start 2023-10-06T02:59:58.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fee01ffb700 1 -- 172.21.15.27:0/3141132300 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf4009e70 con 0x7fee040ba0c0 2023-10-06T02:59:58.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f542152e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f541c06d880 0x7f541c1483b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f542152e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f541c0b9ce0 0x7f541c0bae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f542152e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c06b150 con 0x7f541c0bb360 2023-10-06T02:59:58.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f542152e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541c1478d0 con 0x7f541c06d880 2023-10-06T02:59:58.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f542152e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c147bb0 con 0x7f541c0b9ce0 2023-10-06T02:59:58.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f541affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f541c06d880 0x7f541c1483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fee01ffb700 1 -- 172.21.15.27:0/3141132300 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf400b860 con 0x7fee040ba0c0 2023-10-06T02:59:58.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fee01ffb700 1 -- 172.21.15.27:0/3141132300 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400bc00 con 0x7fee040ba0c0 2023-10-06T02:59:58.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c677fe700 1 -- 172.21.15.27:0/2519880182 >> v2:172.21.15.27:3300/0 conn(0x7f9c680ba090 msgr2=0x7f9c6814fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c677fe700 1 --2- 172.21.15.27:0/2519880182 >> v2:172.21.15.27:3300/0 conn(0x7f9c680ba090 0x7f9c6814fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c677fe700 1 -- 172.21.15.27:0/2519880182 >> v1:172.21.15.27:6789/0 conn(0x7f9c680bafc0 legacy=0x7f9c680686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c677fe700 1 -- 172.21.15.27:0/2519880182 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c681533a0 con 0x7f9c680bb390 2023-10-06T02:59:58.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f541a7fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f541c0b9ce0 0x7f541c0bae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f541affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f541c06d880 0x7f541c1483b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48676/0 (socket says 172.21.15.27:48676) 2023-10-06T02:59:58.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f541affd700 1 -- 172.21.15.27:0/1095708419 learned_addr learned my addr 172.21.15.27:0/1095708419 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd665828700 1 -- start start 2023-10-06T02:59:58.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c677fe700 1 --2- 172.21.15.27:0/2519880182 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c680bb390 0x7f9c68068de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c580098e0 tx=0x7f9c580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96a33d5d1398b9f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f541affd700 1 -- 172.21.15.27:0/1095708419 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f541c0b9ce0 msgr2=0x7f541c0bae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f541affd700 1 --2- 172.21.15.27:0/1095708419 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f541c0b9ce0 0x7f541c0bae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f541affd700 1 -- 172.21.15.27:0/1095708419 >> v1:172.21.15.123:6789/0 conn(0x7f541c0bb360 legacy=0x7f541c0686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd363fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd34c004810 0x7fd36416fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd363fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3640b5110 0x7fd364170390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd363fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3640b8b80 0x7fd3640b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd363fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3640b4380 con 0x7fd34c004810 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd363fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36409fad0 con 0x7fd3640b8b80 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd363fff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd364171c90 con 0x7fd3640b5110 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 Processor -- start 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f541affd700 1 -- 172.21.15.27:0/1095708419 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c147e90 con 0x7f541c06d880 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd362ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd34c004810 0x7fd36416fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd362ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd34c004810 0x7fd36416fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48682/0 (socket says 172.21.15.27:48682) 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd362ffd700 1 -- 172.21.15.27:0/1278112759 learned_addr learned my addr 172.21.15.27:0/1278112759 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 -- start start 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fee09653700 1 -- 172.21.15.27:0/3141132300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee040ba0c0 msgr2=0x7fee04068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fee09653700 1 --2- 172.21.15.27:0/3141132300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee040ba0c0 0x7fee04068cc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fee040bed30 tx=0x7fedf4009250 comp rx=0 tx=0).stop 2023-10-06T02:59:58.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd3627fc700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3640b5110 0x7fd364170390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd665828700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd66009d850 0x7fd6600bcff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd665828700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6600a0a30 0x7fd66013ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd664826700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd66009d850 0x7fd6600bcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd665828700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6600baec0 0x7fd66013f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd665828700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6601414f0 con 0x7fd66009d850 2023-10-06T02:59:58.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd664826700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd66009d850 0x7fd6600bcff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48694/0 (socket says 172.21.15.27:48694) 2023-10-06T02:59:58.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd664826700 1 -- 172.21.15.27:0/468792658 learned_addr learned my addr 172.21.15.27:0/468792658 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd665828700 1 -- 172.21.15.27:0/468792658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66013ffb0 con 0x7fd6600a0a30 2023-10-06T02:59:58.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd665828700 1 -- 172.21.15.27:0/468792658 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd660142be0 con 0x7fd6600baec0 2023-10-06T02:59:58.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f4a5effd700 1 -- 172.21.15.27:0/1388258829 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4a6801b3b0 con 0x7f4a7814eb70 2023-10-06T02:59:58.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f4a5effd700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4a640606a0 0x7f4a64062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f4a5effd700 1 -- 172.21.15.27:0/1388258829 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4a6807c830 con 0x7f4a7814eb70 2023-10-06T02:59:58.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fee09653700 1 -- 172.21.15.27:0/3141132300 shutdown_connections 2023-10-06T02:59:58.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fee09653700 1 --2- 172.21.15.27:0/3141132300 >> v2:172.21.15.27:3300/0 conn(0x7fee0406c910 0x7fee0406cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fee09653700 1 --2- 172.21.15.27:0/3141132300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee040ba0c0 0x7fee04068cc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fee09653700 1 -- 172.21.15.27:0/3141132300 >> 172.21.15.27:0/3141132300 conn(0x7fee040be770 msgr2=0x7fee040ba710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd65ffff700 1 --2- 172.21.15.27:0/468792658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6600a0a30 0x7fd66013ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f4a5effd700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] conn(0x7f4a64068f50 0x7f4a6406b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f4a5effd700 1 -- 172.21.15.27:0/1388258829 --> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a6406ba10 con 0x7f4a64068f50 2023-10-06T02:59:58.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f4a5effd700 1 -- 172.21.15.27:0/1388258829 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a6807cb60 con 0x7f4a7814eb70 2023-10-06T02:59:58.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f65cf7fe700 1 -- 172.21.15.27:0/4207116977 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4011630 con 0x7f65d006c6b0 2023-10-06T02:59:58.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f65cf7fe700 1 -- 172.21.15.27:0/4207116977 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c4011790 con 0x7f65d006c6b0 2023-10-06T02:59:58.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f65cf7fe700 1 -- 172.21.15.27:0/4207116977 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4011b30 con 0x7f65d006c6b0 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2de00ba090 0x7f2de00a7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2de00bafc0 0x7f2de00b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd3637fe700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3640b8b80 0x7fd3640b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2de00bb390 0x7f2de00b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de014d380 con 0x7f2de00bb390 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00b67a0 con 0x7f2de00bafc0 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2de529d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de014e2a0 con 0x7f2de00ba090 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c66ffd700 1 -- 172.21.15.27:0/2519880182 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58009e80 con 0x7f9c680bb390 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c66ffd700 1 -- 172.21.15.27:0/2519880182 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5800b860 con 0x7f9c680bb390 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c66ffd700 1 -- 172.21.15.27:0/2519880182 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5800bc00 con 0x7f9c680bb390 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f4a767fc700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] conn(0x7f4a64068f50 0x7f4a6406b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2dde7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2de00bafc0 0x7f2de00b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd664826700 1 -- 172.21.15.27:0/468792658 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6600baec0 msgr2=0x7fd66013f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd664826700 1 --2- 172.21.15.27:0/468792658 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6600baec0 0x7fd66013f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd664826700 1 -- 172.21.15.27:0/468792658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6600a0a30 msgr2=0x7fd66013ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd664826700 1 --2- 172.21.15.27:0/468792658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6600a0a30 0x7fd66013ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd664826700 1 -- 172.21.15.27:0/468792658 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd658009ae0 con 0x7fd66009d850 2023-10-06T02:59:58.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2dde7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2de00bafc0 0x7f2de00b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:54680/0 (socket says 172.21.15.27:54680) 2023-10-06T02:59:58.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2dde7fc700 1 -- 172.21.15.27:0/1451783098 learned_addr learned my addr 172.21.15.27:0/1451783098 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/2519880182 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c680bb390 msgr2=0x7f9c68068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c6e9a6700 1 --2- 172.21.15.27:0/2519880182 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c680bb390 0x7f9c68068de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c580098e0 tx=0x7f9c580091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd3627fc700 1 -- 172.21.15.27:0/1278112759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3640b8b80 msgr2=0x7fd3640b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd3627fc700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3640b8b80 0x7fd3640b8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd3627fc700 1 -- 172.21.15.27:0/1278112759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd34c004810 msgr2=0x7fd36416fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd3627fc700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd34c004810 0x7fd36416fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd3627fc700 1 -- 172.21.15.27:0/1278112759 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364171640 con 0x7fd3640b5110 2023-10-06T02:59:58.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f65d5cb2700 1 -- 172.21.15.27:0/4207116977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d006c6b0 msgr2=0x7f65d0148990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f65d5cb2700 1 --2- 172.21.15.27:0/4207116977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d006c6b0 0x7f65d0148990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f65c40098e0 tx=0x7f65c40091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2ddeffd700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2de00ba090 0x7f2de00a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd3637fe700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3640b8b80 0x7fd3640b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:58.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fee09653700 1 -- 172.21.15.27:0/3141132300 shutdown_connections 2023-10-06T02:59:58.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f541affd700 1 --2- 172.21.15.27:0/1095708419 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f541c06d880 0x7f541c1483b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f540c0099b0 tx=0x7f540c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b9aa9babf99ac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/2519880182 shutdown_connections 2023-10-06T02:59:58.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c6e9a6700 1 --2- 172.21.15.27:0/2519880182 >> v2:172.21.15.27:3300/0 conn(0x7f9c680ba090 0x7f9c6814fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c6e9a6700 1 --2- 172.21.15.27:0/2519880182 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c680bb390 0x7f9c68068de0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/2519880182 >> 172.21.15.27:0/2519880182 conn(0x7f9c680be770 msgr2=0x7f9c680ba710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7fd664826700 1 --2- 172.21.15.27:0/468792658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd66009d850 0x7fd6600bcff0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd65000d860 tx=0x7fd650008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f4a76ffd700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4a640606a0 0x7f4a64062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 -- 172.21.15.27:0/4207116977 shutdown_connections 2023-10-06T02:59:58.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 --2- 172.21.15.27:0/4207116977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d006c6b0 0x7f65d0148990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 --2- 172.21.15.27:0/4207116977 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65d009f7a0 0x7f65d009fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 -- 172.21.15.27:0/4207116977 >> 172.21.15.27:0/4207116977 conn(0x7f65d006e040 msgr2=0x7f65d006e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.767+0000 7f2ddf7fe700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2de00bb390 0x7f2de00b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f2dde7fc700 1 -- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2de00ba090 msgr2=0x7f2de00a7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f2dde7fc700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2de00ba090 0x7f2de00a7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f2dde7fc700 1 -- 172.21.15.27:0/1451783098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2de00bb390 msgr2=0x7f2de00b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f2dde7fc700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2de00bb390 0x7f2de00b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/2519880182 shutdown_connections 2023-10-06T02:59:58.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f4a767fc700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] conn(0x7f4a64068f50 0x7f4a6406b360 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f2dde7fc700 1 -- 172.21.15.27:0/1451783098 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd0009420 con 0x7f2de00bafc0 2023-10-06T02:59:58.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f2ddf7fe700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2de00bb390 0x7f2de00b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:58.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/2519880182 wait complete. 2023-10-06T02:59:58.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd65cff9700 1 -- 172.21.15.27:0/468792658 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6500125f0 con 0x7fd66009d850 2023-10-06T02:59:58.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd65cff9700 1 -- 172.21.15.27:0/468792658 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd650012750 con 0x7fd66009d850 2023-10-06T02:59:58.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd65cff9700 1 -- 172.21.15.27:0/468792658 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd650012af0 con 0x7fd66009d850 2023-10-06T02:59:58.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 -- 172.21.15.27:0/4207116977 shutdown_connections 2023-10-06T02:59:58.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 -- 172.21.15.27:0/4207116977 wait complete. 2023-10-06T02:59:58.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd665828700 1 -- 172.21.15.27:0/468792658 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6600bd530 con 0x7fd66009d850 2023-10-06T02:59:58.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd3627fc700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3640b5110 0x7fd364170390 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0094d0 tx=0x7fd35c01a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd34affd700 1 -- 172.21.15.27:0/1278112759 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c01d420 con 0x7fd3640b5110 2023-10-06T02:59:58.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd34affd700 1 -- 172.21.15.27:0/1278112759 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c01d5a0 con 0x7fd3640b5110 2023-10-06T02:59:58.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd34affd700 1 -- 172.21.15.27:0/1278112759 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c01d9a0 con 0x7fd3640b5110 2023-10-06T02:59:58.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd363fff700 1 -- 172.21.15.27:0/1278112759 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd364171920 con 0x7fd3640b5110 2023-10-06T02:59:58.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd363fff700 1 -- 172.21.15.27:0/1278112759 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3640b9530 con 0x7fd3640b5110 2023-10-06T02:59:58.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f2dde7fc700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2de00bafc0 0x7f2de00b4d50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400e950 tx=0x7f2dd4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f4a5effd700 1 -- 172.21.15.27:0/1388258829 <== osd.0 v2:172.21.15.27:6824/33281 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f4a6406ba10 con 0x7f4a64068f50 2023-10-06T02:59:58.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c6e9a6700 1 Processor -- start 2023-10-06T02:59:58.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f5419ffb700 1 -- 172.21.15.27:0/1095708419 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c00b820 con 0x7f541c06d880 2023-10-06T02:59:58.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f5419ffb700 1 -- 172.21.15.27:0/1095708419 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c00b980 con 0x7f541c06d880 2023-10-06T02:59:58.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c6e9a6700 1 -- start start 2023-10-06T02:59:58.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f2dc6ffd700 1 -- 172.21.15.27:0/1451783098 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4013680 con 0x7f2de00bafc0 2023-10-06T02:59:58.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f2dc6ffd700 1 -- 172.21.15.27:0/1451783098 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd40137e0 con 0x7f2de00bafc0 2023-10-06T02:59:58.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f2dc6ffd700 1 -- 172.21.15.27:0/1451783098 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4013ba0 con 0x7f2de00bafc0 2023-10-06T02:59:58.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 Processor -- start 2023-10-06T02:59:58.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f2de529d700 1 -- 172.21.15.27:0/1451783098 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de00a7a80 con 0x7f2de00bafc0 2023-10-06T02:59:58.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f2de529d700 1 -- 172.21.15.27:0/1451783098 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de00b69f0 con 0x7f2de00bafc0 2023-10-06T02:59:58.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd363fff700 1 -- 172.21.15.27:0/1278112759 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd3640b97e0 con 0x7fd3640b5110 2023-10-06T02:59:58.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c6e9a6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c680ba090 0x7f9c680b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c6e9a6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c680bafc0 0x7f9c680a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c6e9a6700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c680bb390 0x7f9c6813df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c6e9a6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6813e9b0 con 0x7f9c680ba090 2023-10-06T02:59:58.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c6e9a6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680b39d0 con 0x7f9c680bafc0 2023-10-06T02:59:58.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c6e9a6700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6813a820 con 0x7f9c680bb390 2023-10-06T02:59:58.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 -- start start 2023-10-06T02:59:58.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d006b1d0 0x7f65d0147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65d006c6b0 0x7f65d015e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d009f7a0 0x7f65d015e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0148de0 con 0x7f65d006b1d0 2023-10-06T02:59:58.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d01479c0 con 0x7f65d009f7a0 2023-10-06T02:59:58.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d5cb2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0148240 con 0x7f65d006c6b0 2023-10-06T02:59:58.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d4cb0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d006b1d0 0x7f65d0147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d4cb0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d006b1d0 0x7f65d0147480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48724/0 (socket says 172.21.15.27:48724) 2023-10-06T02:59:58.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65cffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65d006c6b0 0x7f65d015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d4cb0700 1 -- 172.21.15.27:0/3546490280 learned_addr learned my addr 172.21.15.27:0/3546490280 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d54b1700 1 --2- 172.21.15.27:0/3546490280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d009f7a0 0x7f65d015e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d4cb0700 1 -- 172.21.15.27:0/3546490280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65d006c6b0 msgr2=0x7f65d015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d4cb0700 1 --2- 172.21.15.27:0/3546490280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65d006c6b0 0x7f65d015e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d4cb0700 1 -- 172.21.15.27:0/3546490280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d009f7a0 msgr2=0x7f65d015e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d4cb0700 1 --2- 172.21.15.27:0/3546490280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d009f7a0 0x7f65d015e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f65d4cb0700 1 -- 172.21.15.27:0/3546490280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c4009420 con 0x7f65d006b1d0 2023-10-06T02:59:58.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd665828700 1 -- 172.21.15.27:0/468792658 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd660143160 con 0x7fd66009d850 2023-10-06T02:59:58.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f65d4cb0700 1 --2- 172.21.15.27:0/3546490280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d006b1d0 0x7f65d0147480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f65c000e980 tx=0x7f65c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd34affd700 1 -- 172.21.15.27:0/1278112759 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd35c003040 con 0x7fd3640b5110 2023-10-06T02:59:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd34affd700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd350060600 0x7fd350062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd34affd700 1 -- 172.21.15.27:0/1278112759 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd35c07e780 con 0x7fd3640b5110 2023-10-06T02:59:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fd34affd700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] conn(0x7fd350068eb0 0x7fd35006b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fd34affd700 1 -- 172.21.15.27:0/1278112759 --> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd35006b970 con 0x7fd350068eb0 2023-10-06T02:59:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fd34affd700 1 -- 172.21.15.27:0/1278112759 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd35c080d20 con 0x7fd3640b5110 2023-10-06T02:59:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f542152e700 1 -- 172.21.15.27:0/1095708419 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f541c06d880 msgr2=0x7f541c1483b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f542152e700 1 --2- 172.21.15.27:0/1095708419 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f541c06d880 0x7f541c1483b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f540c0099b0 tx=0x7f540c009250 comp rx=0 tx=0).stop 2023-10-06T02:59:58.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c67fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c680ba090 0x7f9c680b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c67fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c680ba090 0x7f9c680b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48708/0 (socket says 172.21.15.27:48708) 2023-10-06T02:59:58.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c67fff700 1 -- 172.21.15.27:0/1649581823 learned_addr learned my addr 172.21.15.27:0/1649581823 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7f9c677fe700 1 --2- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c680bafc0 0x7f9c680a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f9c67fff700 1 -- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c680bb390 msgr2=0x7f9c6813df50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:59:58.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f9c67fff700 1 --2- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c680bb390 0x7f9c6813df50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f9c67fff700 1 -- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c680bafc0 msgr2=0x7f9c680a67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f9c67fff700 1 --2- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c680bafc0 0x7f9c680a67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f9c67fff700 1 -- 172.21.15.27:0/1649581823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c58009420 con 0x7f9c680ba090 2023-10-06T02:59:58.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f9c67fff700 1 --2- 172.21.15.27:0/1649581823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c680ba090 0x7f9c680b3460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000cb40 tx=0x7f9c60001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fd65cff9700 1 -- 172.21.15.27:0/468792658 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd650014430 con 0x7fd66009d850 2023-10-06T02:59:58.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fd65cff9700 1 --2- 172.21.15.27:0/468792658 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd64c060580 0x7fd64c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fd65ffff700 1 --2- 172.21.15.27:0/468792658 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd64c060580 0x7fd64c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fd3637fe700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] conn(0x7fd350068eb0 0x7fd35006b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fd362ffd700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd350060600 0x7fd350062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f65ccff9700 1 -- 172.21.15.27:0/3546490280 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c000ee70 con 0x7f65d006b1d0 2023-10-06T02:59:58.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f65ccff9700 1 -- 172.21.15.27:0/3546490280 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c000c850 con 0x7f65d006b1d0 2023-10-06T02:59:58.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f65ccff9700 1 -- 172.21.15.27:0/3546490280 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c000cbd0 con 0x7f65d006b1d0 2023-10-06T02:59:58.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f65d5cb2700 1 -- 172.21.15.27:0/3546490280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d01465b0 con 0x7f65d006b1d0 2023-10-06T02:59:58.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f65d5cb2700 1 -- 172.21.15.27:0/3546490280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d009d090 con 0x7f65d006b1d0 2023-10-06T02:59:58.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fd3637fe700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] conn(0x7fd350068eb0 0x7fd35006b2c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fd362ffd700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd350060600 0x7fd350062ab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd354001270 tx=0x7fd36409d790 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fee09653700 1 -- 172.21.15.27:0/3141132300 wait complete. 2023-10-06T02:59:58.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fee09653700 1 Processor -- start 2023-10-06T02:59:58.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.771+0000 7fee09653700 1 -- start start 2023-10-06T02:59:58.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee09653700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee0406a100 0x7fee040b8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee09653700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee0406c910 0x7fee040b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee09653700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee040ba0c0 0x7fee040bbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee09653700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee040b7ee0 con 0x7fee040ba0c0 2023-10-06T02:59:58.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee09653700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee040b7890 con 0x7fee0406a100 2023-10-06T02:59:58.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee09653700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee040b7b70 con 0x7fee0406c910 2023-10-06T02:59:58.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee037fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee040ba0c0 0x7fee040bbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee037fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee040ba0c0 0x7fee040bbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48730/0 (socket says 172.21.15.27:48730) 2023-10-06T02:59:58.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee037fe700 1 -- 172.21.15.27:0/2239122251 learned_addr learned my addr 172.21.15.27:0/2239122251 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee02ffd700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee0406a100 0x7fee040b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee027fc700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee0406c910 0x7fee040b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee037fe700 1 -- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee0406c910 msgr2=0x7fee040b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee037fe700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee0406c910 0x7fee040b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee037fe700 1 -- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee0406a100 msgr2=0x7fee040b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee037fe700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee0406a100 0x7fee040b8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee037fe700 1 -- 172.21.15.27:0/2239122251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf40094f0 con 0x7fee040ba0c0 2023-10-06T02:59:58.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee02ffd700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee0406a100 0x7fee040b8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:58.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fee037fe700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee040ba0c0 0x7fee040bbf10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fedf800ea50 tx=0x7fedf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f542152e700 1 -- 172.21.15.27:0/1095708419 shutdown_connections 2023-10-06T02:59:58.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f542152e700 1 --2- 172.21.15.27:0/1095708419 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f541c0b9ce0 0x7f541c0bae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f542152e700 1 --2- 172.21.15.27:0/1095708419 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f541c06d880 0x7f541c1483b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f542152e700 1 -- 172.21.15.27:0/1095708419 >> 172.21.15.27:0/1095708419 conn(0x7f541c0be770 msgr2=0x7f541c0ba710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f542152e700 1 -- 172.21.15.27:0/1095708419 shutdown_connections 2023-10-06T02:59:58.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f542152e700 1 -- 172.21.15.27:0/1095708419 wait complete. 2023-10-06T02:59:58.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f2dc6ffd700 1 -- 172.21.15.27:0/1451783098 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2dd400c490 con 0x7f2de00bafc0 2023-10-06T02:59:58.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f2de529d700 1 -- 172.21.15.27:0/1451783098 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2dc0000fd0 con 0x7f2de00bafc0 2023-10-06T02:59:58.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f2dc6ffd700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2dcc0606a0 0x7f2dcc062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f2ddeffd700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2dcc0606a0 0x7f2dcc062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fd65ffff700 1 --2- 172.21.15.27:0/468792658 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd64c060580 0x7fd64c062a30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd658009880 tx=0x7fd658018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fd65cff9700 1 -- 172.21.15.27:0/468792658 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd650012ea0 con 0x7fd66009d850 2023-10-06T02:59:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fd34affd700 1 -- 172.21.15.27:0/1278112759 <== osd.3 v2:172.21.15.27:6816/33279 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd35006b970 con 0x7fd350068eb0 2023-10-06T02:59:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f9c4ffff700 1 -- 172.21.15.27:0/1649581823 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6000a7e0 con 0x7f9c680ba090 2023-10-06T02:59:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f65d5cb2700 1 -- 172.21.15.27:0/3546490280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65d009d230 con 0x7f65d006b1d0 2023-10-06T02:59:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f9c4ffff700 1 -- 172.21.15.27:0/1649581823 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6000a960 con 0x7f9c680ba090 2023-10-06T02:59:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/1649581823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c680a6220 con 0x7f9c680ba090 2023-10-06T02:59:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f65ccff9700 1 -- 172.21.15.27:0/3546490280 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f65c0013470 con 0x7f65d006b1d0 2023-10-06T02:59:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f542152e700 1 Processor -- start 2023-10-06T02:59:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f2dc6ffd700 1 -- 172.21.15.27:0/1451783098 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2dd407ca20 con 0x7f2de00bafc0 2023-10-06T02:59:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f2ddeffd700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2dcc0606a0 0x7f2dcc062b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009fd0 tx=0x7f2dd8009880 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f2dc6ffd700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] conn(0x7f2dcc068ed0 0x7f2dcc06b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f2dc6ffd700 1 -- 172.21.15.27:0/1451783098 --> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2dcc06b990 con 0x7f2dcc068ed0 2023-10-06T02:59:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f2dc6ffd700 1 -- 172.21.15.27:0/1451783098 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dd4050920 con 0x7f2de00bafc0 2023-10-06T02:59:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7fedeaffd700 1 -- 172.21.15.27:0/2239122251 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf800ee90 con 0x7fee040ba0c0 2023-10-06T02:59:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f9c4ffff700 1 -- 172.21.15.27:0/1649581823 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6000ad20 con 0x7f9c680ba090 2023-10-06T02:59:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/1649581823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6813e490 con 0x7f9c680ba090 2023-10-06T02:59:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.775+0000 7f542152e700 1 -- start start 2023-10-06T02:59:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f65ccff9700 1 --2- 172.21.15.27:0/3546490280 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f65bc060620 0x7f65bc062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7fee09653700 1 -- 172.21.15.27:0/2239122251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee040b6410 con 0x7fee040ba0c0 2023-10-06T02:59:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7fee09653700 1 -- 172.21.15.27:0/2239122251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee040b53d0 con 0x7fee040ba0c0 2023-10-06T02:59:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7fedeaffd700 1 -- 172.21.15.27:0/2239122251 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf800c850 con 0x7fee040ba0c0 2023-10-06T02:59:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7fedeaffd700 1 -- 172.21.15.27:0/2239122251 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf800cc10 con 0x7fee040ba0c0 2023-10-06T02:59:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f65ccff9700 1 -- 172.21.15.27:0/3546490280 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f65c007c830 con 0x7f65d006b1d0 2023-10-06T02:59:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f65cffff700 1 --2- 172.21.15.27:0/3546490280 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f65bc060620 0x7f65bc062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f65ccff9700 1 --2- 172.21.15.27:0/3546490280 >> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] conn(0x7f65bc068ed0 0x7f65bc06b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f65ccff9700 1 -- 172.21.15.27:0/3546490280 --> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65bc06b990 con 0x7f65bc068ed0 2023-10-06T02:59:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f65ccff9700 1 -- 172.21.15.27:0/3546490280 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65c0081240 con 0x7f65d006b1d0 2023-10-06T02:59:58.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/1649581823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c6813ac20 con 0x7f9c680ba090 2023-10-06T02:59:58.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f65d54b1700 1 --2- 172.21.15.27:0/3546490280 >> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] conn(0x7f65bc068ed0 0x7f65bc06b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f542152e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f541c06d880 0x7f541c14a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f542152e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f541c0b9ce0 0x7f541c0b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f542152e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f541c0bb360 0x7f541c142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f542152e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c148cc0 con 0x7f541c06d880 2023-10-06T02:59:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f542152e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c148f60 con 0x7f541c0bb360 2023-10-06T02:59:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f542152e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c14a0c0 con 0x7f541c0b9ce0 2023-10-06T02:59:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f2ddf7fe700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] conn(0x7f2dcc068ed0 0x7f2dcc06b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7fee09653700 1 -- 172.21.15.27:0/2239122251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee0404be40 con 0x7fee040ba0c0 2023-10-06T02:59:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f541affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f541c06d880 0x7f541c14a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f541b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f541c0bb360 0x7f541c142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f541affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f541c06d880 0x7f541c14a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48746/0 (socket says 172.21.15.27:48746) 2023-10-06T02:59:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f541affd700 1 -- 172.21.15.27:0/3513767807 learned_addr learned my addr 172.21.15.27:0/3513767807 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f2ddf7fe700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] conn(0x7f2dcc068ed0 0x7f2dcc06b2e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f541a7fc700 1 --2- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f541c0b9ce0 0x7f541c0b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f65d54b1700 1 --2- 172.21.15.27:0/3546490280 >> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] conn(0x7f65bc068ed0 0x7f65bc06b2e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f65cffff700 1 --2- 172.21.15.27:0/3546490280 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f65bc060620 0x7f65bc062ad0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f65c40030c0 tx=0x7f65c4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f541a7fc700 1 -- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f541c0bb360 msgr2=0x7f541c142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f541a7fc700 1 --2- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f541c0bb360 0x7f541c142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f541a7fc700 1 -- 172.21.15.27:0/3513767807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f541c06d880 msgr2=0x7f541c14a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f541a7fc700 1 --2- 172.21.15.27:0/3513767807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f541c06d880 0x7f541c14a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f541a7fc700 1 -- 172.21.15.27:0/3513767807 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0094f0 con 0x7f541c0b9ce0 2023-10-06T02:59:58.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7fedeaffd700 1 -- 172.21.15.27:0/2239122251 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fedf8013470 con 0x7fee040ba0c0 2023-10-06T02:59:58.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f2dc6ffd700 1 -- 172.21.15.27:0/1451783098 <== osd.7 v2:172.21.15.123:6808/33674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2dcc06b990 con 0x7f2dcc068ed0 2023-10-06T02:59:58.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f65ccff9700 1 -- 172.21.15.27:0/3546490280 <== osd.1 v2:172.21.15.27:6800/33280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f65bc06b990 con 0x7f65bc068ed0 2023-10-06T02:59:58.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f541a7fc700 1 --2- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f541c0b9ce0 0x7f541c0b1ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f540400d890 tx=0x7f5404008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f540affd700 1 -- 172.21.15.27:0/3513767807 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040125f0 con 0x7f541c0b9ce0 2023-10-06T02:59:58.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f542152e700 1 -- 172.21.15.27:0/3513767807 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541c14a3a0 con 0x7f541c0b9ce0 2023-10-06T02:59:58.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f540affd700 1 -- 172.21.15.27:0/3513767807 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5404012750 con 0x7f541c0b9ce0 2023-10-06T02:59:58.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f542152e700 1 -- 172.21.15.27:0/3513767807 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541c134030 con 0x7f541c0b9ce0 2023-10-06T02:59:58.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f540affd700 1 -- 172.21.15.27:0/3513767807 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404012ad0 con 0x7f541c0b9ce0 2023-10-06T02:59:58.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.779+0000 7f542152e700 1 -- 172.21.15.27:0/3513767807 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f541c04be40 con 0x7f541c0b9ce0 2023-10-06T02:59:58.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7f4a76ffd700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4a640606a0 0x7f4a64062b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4a700097c0 tx=0x7f4a70019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7fedeaffd700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fedf0060550 0x7fedf0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7fedeaffd700 1 -- 172.21.15.27:0/2239122251 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fedf807cec0 con 0x7fee040ba0c0 2023-10-06T02:59:58.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7fee02ffd700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fedf0060550 0x7fedf0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7fedeaffd700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] conn(0x7fedf0068e00 0x7fedf006b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7f540affd700 1 -- 172.21.15.27:0/3513767807 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5404013480 con 0x7f541c0b9ce0 2023-10-06T02:59:58.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7fd665828700 1 --2- 172.21.15.27:0/468792658 >> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] conn(0x7fd66013f860 0x7fd660147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7fedeaffd700 1 -- 172.21.15.27:0/2239122251 --> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fedf006b8c0 con 0x7fedf0068e00 2023-10-06T02:59:58.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7fedeaffd700 1 -- 172.21.15.27:0/2239122251 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedf807d290 con 0x7fee040ba0c0 2023-10-06T02:59:58.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7fd665828700 1 -- 172.21.15.27:0/468792658 --> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6600674b0 con 0x7fd66013f860 2023-10-06T02:59:58.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7fee027fc700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] conn(0x7fedf0068e00 0x7fedf006b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7f540affd700 1 --2- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f53fc060580 0x7f53fc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7fee02ffd700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fedf0060550 0x7fedf0062a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee040bed30 tx=0x7fedf4017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7f540affd700 1 -- 172.21.15.27:0/3513767807 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f540407d6e0 con 0x7f541c0b9ce0 2023-10-06T02:59:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7f540affd700 1 --2- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] conn(0x7f53fc068db0 0x7f53fc06b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7f540affd700 1 -- 172.21.15.27:0/3513767807 --> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53fc06b870 con 0x7f53fc068db0 2023-10-06T02:59:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7f540affd700 1 -- 172.21.15.27:0/3513767807 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f540407da80 con 0x7f541c0b9ce0 2023-10-06T02:59:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7fee027fc700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] conn(0x7fedf0068e00 0x7fedf006b210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7f541b7fe700 1 --2- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] conn(0x7f53fc068db0 0x7f53fc06b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.783+0000 7fedeaffd700 1 -- 172.21.15.27:0/2239122251 <== osd.4 v2:172.21.15.123:6816/33673 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fedf006b8c0 con 0x7fedf0068e00 2023-10-06T02:59:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.787+0000 7fd665027700 1 --2- 172.21.15.27:0/468792658 >> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] conn(0x7fd66013f860 0x7fd660147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.787+0000 7fd665027700 1 --2- 172.21.15.27:0/468792658 >> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] conn(0x7fd66013f860 0x7fd660147060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.787+0000 7f541b7fe700 1 --2- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] conn(0x7f53fc068db0 0x7f53fc06b1c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.787+0000 7fd65cff9700 1 -- 172.21.15.27:0/468792658 <== osd.2 v2:172.21.15.27:6808/33282 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd6600674b0 con 0x7fd66013f860 2023-10-06T02:59:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.787+0000 7f540affd700 1 -- 172.21.15.27:0/3513767807 <== osd.5 v2:172.21.15.123:6800/33671 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f53fc06b870 con 0x7f53fc068db0 2023-10-06T02:59:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.791+0000 7f9c4ffff700 1 -- 172.21.15.27:0/1649581823 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9c60003030 con 0x7f9c680ba090 2023-10-06T02:59:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.791+0000 7f541affd700 1 --2- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f53fc060580 0x7f53fc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.791+0000 7f9c4ffff700 1 --2- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9c54060620 0x7f9c54062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.791+0000 7f9c4ffff700 1 -- 172.21.15.27:0/1649581823 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9c6007c8f0 con 0x7f9c680ba090 2023-10-06T02:59:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.791+0000 7f9c4ffff700 1 --2- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] conn(0x7f9c54068d60 0x7f9c5406b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.791+0000 7f9c4ffff700 1 -- 172.21.15.27:0/1649581823 --> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c5406b820 con 0x7f9c54068d60 2023-10-06T02:59:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.791+0000 7f9c4ffff700 1 -- 172.21.15.27:0/1649581823 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c60081220 con 0x7f9c680ba090 2023-10-06T02:59:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.791+0000 7f9c677fe700 1 --2- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9c54060620 0x7f9c54062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.791+0000 7f541affd700 1 --2- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f53fc060580 0x7f53fc062a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f540c009fd0 tx=0x7f540c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.791+0000 7f9c677fe700 1 --2- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9c54060620 0x7f9c54062ad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c580098e0 tx=0x7f9c58017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.795+0000 7f4a77fff700 1 -- 172.21.15.27:0/1388258829 --> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4a58002c90 con 0x7f4a64068f50 2023-10-06T02:59:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.795+0000 7f4a5effd700 1 -- 172.21.15.27:0/1388258829 <== osd.0 v2:172.21.15.27:6824/33281 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4a58002c90 con 0x7f4a64068f50 2023-10-06T02:59:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.799+0000 7f9c6cf43700 1 --2- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] conn(0x7f9c54068d60 0x7f9c5406b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.799+0000 7f9c6cf43700 1 --2- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] conn(0x7f9c54068d60 0x7f9c5406b170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.799+0000 7f9c4ffff700 1 -- 172.21.15.27:0/1649581823 <== osd.6 v2:172.21.15.123:6817/33672 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9c5406b820 con 0x7f9c54068d60 2023-10-06T02:59:58.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.799+0000 7f4a77fff700 1 -- 172.21.15.27:0/1388258829 >> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] conn(0x7f4a64068f50 msgr2=0x7f4a6406b360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.799+0000 7f4a77fff700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] conn(0x7f4a64068f50 0x7f4a6406b360 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.803+0000 7f4a77fff700 1 -- 172.21.15.27:0/1388258829 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4a640606a0 msgr2=0x7f4a64062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.803+0000 7f4a77fff700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4a640606a0 0x7f4a64062b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4a700097c0 tx=0x7f4a70019000 comp rx=0 tx=0).stop 2023-10-06T02:59:58.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.803+0000 7f4a77fff700 1 -- 172.21.15.27:0/1388258829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a7814eb70 msgr2=0x7f4a7815e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.803+0000 7f4a77fff700 1 --2- 172.21.15.27:0/1388258829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a7814eb70 0x7f4a7815e660 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4a680010e0 tx=0x7f4a68007dd0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.803+0000 7f4a777fe700 1 -- 172.21.15.27:0/1388258829 reap_dead start 2023-10-06T02:59:58.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.803+0000 7f4a77fff700 1 -- 172.21.15.27:0/1388258829 shutdown_connections 2023-10-06T02:59:58.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.803+0000 7f4a77fff700 1 -- 172.21.15.27:0/1388258829 >> 172.21.15.27:0/1388258829 conn(0x7f4a7806e040 msgr2=0x7f4a780bd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.803+0000 7f4a77fff700 1 -- 172.21.15.27:0/1388258829 shutdown_connections 2023-10-06T02:59:58.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.803+0000 7f4a77fff700 1 -- 172.21.15.27:0/1388258829 wait complete. 2023-10-06T02:59:58.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f65d5cb2700 1 -- 172.21.15.27:0/3546490280 --> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f65d01489b0 con 0x7f65bc068ed0 2023-10-06T02:59:58.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f65ccff9700 1 -- 172.21.15.27:0/3546490280 <== osd.1 v2:172.21.15.27:6800/33280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f65d01489b0 con 0x7f65bc068ed0 2023-10-06T02:59:58.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f65d5cb2700 1 -- 172.21.15.27:0/3546490280 >> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] conn(0x7f65bc068ed0 msgr2=0x7f65bc06b2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f65d5cb2700 1 --2- 172.21.15.27:0/3546490280 >> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] conn(0x7f65bc068ed0 0x7f65bc06b2e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f65d5cb2700 1 -- 172.21.15.27:0/3546490280 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f65bc060620 msgr2=0x7f65bc062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f65d5cb2700 1 --2- 172.21.15.27:0/3546490280 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f65bc060620 0x7f65bc062ad0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f65c40030c0 tx=0x7f65c4016000 comp rx=0 tx=0).stop 2023-10-06T02:59:58.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f65d5cb2700 1 -- 172.21.15.27:0/3546490280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d006b1d0 msgr2=0x7f65d0147480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f65d5cb2700 1 --2- 172.21.15.27:0/3546490280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d006b1d0 0x7f65d0147480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f65c000e980 tx=0x7f65c0009250 comp rx=0 tx=0).stop 2023-10-06T02:59:58.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f2de529d700 1 -- 172.21.15.27:0/1451783098 --> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2dc0002d00 con 0x7f2dcc068ed0 2023-10-06T02:59:58.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f2dc6ffd700 1 -- 172.21.15.27:0/1451783098 <== osd.7 v2:172.21.15.123:6808/33674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2dc0002d00 con 0x7f2dcc068ed0 2023-10-06T02:59:58.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f65d54b1700 1 -- 172.21.15.27:0/3546490280 reap_dead start 2023-10-06T02:59:58.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f65d5cb2700 1 -- 172.21.15.27:0/3546490280 shutdown_connections 2023-10-06T02:59:58.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f65d5cb2700 1 -- 172.21.15.27:0/3546490280 >> 172.21.15.27:0/3546490280 conn(0x7f65d006e040 msgr2=0x7f65d009e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f65d5cb2700 1 -- 172.21.15.27:0/3546490280 shutdown_connections 2023-10-06T02:59:58.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.807+0000 7f65d5cb2700 1 -- 172.21.15.27:0/3546490280 wait complete. 2023-10-06T02:59:58.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.811+0000 7fee09653700 1 -- 172.21.15.27:0/2239122251 --> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee0406c290 con 0x7fedf0068e00 2023-10-06T02:59:58.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.811+0000 7fedeaffd700 1 -- 172.21.15.27:0/2239122251 <== osd.4 v2:172.21.15.123:6816/33673 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fee0406c290 con 0x7fedf0068e00 2023-10-06T02:59:58.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.811+0000 7fee09653700 1 -- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] conn(0x7fedf0068e00 msgr2=0x7fedf006b210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.811+0000 7fee09653700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] conn(0x7fedf0068e00 0x7fedf006b210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.811+0000 7fee09653700 1 -- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fedf0060550 msgr2=0x7fedf0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.811+0000 7fee09653700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fedf0060550 0x7fedf0062a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee040bed30 tx=0x7fedf4017000 comp rx=0 tx=0).stop 2023-10-06T02:59:58.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.811+0000 7fee09653700 1 -- 172.21.15.27:0/2239122251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee040ba0c0 msgr2=0x7fee040bbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.811+0000 7fee09653700 1 --2- 172.21.15.27:0/2239122251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee040ba0c0 0x7fee040bbf10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fedf800ea50 tx=0x7fedf80091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.811+0000 7fee037fe700 1 -- 172.21.15.27:0/2239122251 reap_dead start 2023-10-06T02:59:58.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.811+0000 7fee09653700 1 -- 172.21.15.27:0/2239122251 shutdown_connections 2023-10-06T02:59:58.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.811+0000 7fee09653700 1 -- 172.21.15.27:0/2239122251 >> 172.21.15.27:0/2239122251 conn(0x7fee040be770 msgr2=0x7fee0414b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.811+0000 7fee09653700 1 -- 172.21.15.27:0/2239122251 shutdown_connections 2023-10-06T02:59:58.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.811+0000 7fee09653700 1 -- 172.21.15.27:0/2239122251 wait complete. 2023-10-06T02:59:58.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.815+0000 7fd363fff700 1 -- 172.21.15.27:0/1278112759 --> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd364067790 con 0x7fd350068eb0 2023-10-06T02:59:58.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.815+0000 7f2de529d700 1 -- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] conn(0x7f2dcc068ed0 msgr2=0x7f2dcc06b2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.815+0000 7f2de529d700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] conn(0x7f2dcc068ed0 0x7f2dcc06b2e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.815+0000 7f2de529d700 1 -- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2dcc0606a0 msgr2=0x7f2dcc062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.815+0000 7f2de529d700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2dcc0606a0 0x7f2dcc062b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009fd0 tx=0x7f2dd8009880 comp rx=0 tx=0).stop 2023-10-06T02:59:58.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.815+0000 7f2de529d700 1 -- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2de00bafc0 msgr2=0x7f2de00b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.815+0000 7f2de529d700 1 --2- 172.21.15.27:0/1451783098 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2de00bafc0 0x7f2de00b4d50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400e950 tx=0x7f2dd4009250 comp rx=0 tx=0).stop 2023-10-06T02:59:58.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.815+0000 7f2ddf7fe700 1 -- 172.21.15.27:0/1451783098 reap_dead start 2023-10-06T02:59:58.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.815+0000 7fd34affd700 1 -- 172.21.15.27:0/1278112759 <== osd.3 v2:172.21.15.27:6816/33279 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd364067790 con 0x7fd350068eb0 2023-10-06T02:59:58.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.815+0000 7f2de529d700 1 -- 172.21.15.27:0/1451783098 shutdown_connections 2023-10-06T02:59:58.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.815+0000 7f2de529d700 1 -- 172.21.15.27:0/1451783098 >> 172.21.15.27:0/1451783098 conn(0x7f2de00be770 msgr2=0x7f2de00bbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.815+0000 7f2de529d700 1 -- 172.21.15.27:0/1451783098 shutdown_connections 2023-10-06T02:59:58.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.815+0000 7f2de529d700 1 -- 172.21.15.27:0/1451783098 wait complete. 2023-10-06T02:59:58.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7fd665828700 1 -- 172.21.15.27:0/468792658 --> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd660147fe0 con 0x7fd66013f860 2023-10-06T02:59:58.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7fd65cff9700 1 -- 172.21.15.27:0/468792658 <== osd.2 v2:172.21.15.27:6808/33282 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd660147fe0 con 0x7fd66013f860 2023-10-06T02:59:58.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7f542152e700 1 -- 172.21.15.27:0/3513767807 --> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f541c068de0 con 0x7f53fc068db0 2023-10-06T02:59:58.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7f540affd700 1 -- 172.21.15.27:0/3513767807 <== osd.5 v2:172.21.15.123:6800/33671 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f541c068de0 con 0x7f53fc068db0 2023-10-06T02:59:58.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7f542152e700 1 -- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] conn(0x7f53fc068db0 msgr2=0x7f53fc06b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7f542152e700 1 --2- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] conn(0x7f53fc068db0 0x7f53fc06b1c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7f542152e700 1 -- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f53fc060580 msgr2=0x7f53fc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7f542152e700 1 --2- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f53fc060580 0x7f53fc062a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f540c009fd0 tx=0x7f540c016000 comp rx=0 tx=0).stop 2023-10-06T02:59:58.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7f542152e700 1 -- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f541c0b9ce0 msgr2=0x7f541c0b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7f542152e700 1 --2- 172.21.15.27:0/3513767807 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f541c0b9ce0 0x7f541c0b1ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f540400d890 tx=0x7f5404008040 comp rx=0 tx=0).stop 2023-10-06T02:59:58.875 INFO:teuthology.orchestra.run.smithi027.stdout:55834574856 2023-10-06T02:59:58.876 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T02:59:58.876 INFO:teuthology.orchestra.run.smithi027.stdout:55834574854 2023-10-06T02:59:58.877 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T02:59:58.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7f541b7fe700 1 -- 172.21.15.27:0/3513767807 reap_dead start 2023-10-06T02:59:58.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7f542152e700 1 -- 172.21.15.27:0/3513767807 shutdown_connections 2023-10-06T02:59:58.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7f542152e700 1 -- 172.21.15.27:0/3513767807 >> 172.21.15.27:0/3513767807 conn(0x7f541c0be770 msgr2=0x7f541c0bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7f542152e700 1 -- 172.21.15.27:0/3513767807 shutdown_connections 2023-10-06T02:59:58.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.819+0000 7f542152e700 1 -- 172.21.15.27:0/3513767807 wait complete. 2023-10-06T02:59:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.823+0000 7fd665828700 1 -- 172.21.15.27:0/468792658 >> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] conn(0x7fd66013f860 msgr2=0x7fd660147060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.823+0000 7fd665828700 1 --2- 172.21.15.27:0/468792658 >> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] conn(0x7fd66013f860 0x7fd660147060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.823+0000 7fd665828700 1 -- 172.21.15.27:0/468792658 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd64c060580 msgr2=0x7fd64c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.823+0000 7fd665828700 1 --2- 172.21.15.27:0/468792658 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd64c060580 0x7fd64c062a30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd658009880 tx=0x7fd658018000 comp rx=0 tx=0).stop 2023-10-06T02:59:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.823+0000 7fd665828700 1 -- 172.21.15.27:0/468792658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd66009d850 msgr2=0x7fd6600bcff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.823+0000 7fd665828700 1 --2- 172.21.15.27:0/468792658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd66009d850 0x7fd6600bcff0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd65000d860 tx=0x7fd650008040 comp rx=0 tx=0).stop 2023-10-06T02:59:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.823+0000 7fd665027700 1 -- 172.21.15.27:0/468792658 reap_dead start 2023-10-06T02:59:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.823+0000 7fd665828700 1 -- 172.21.15.27:0/468792658 shutdown_connections 2023-10-06T02:59:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.823+0000 7fd665828700 1 -- 172.21.15.27:0/468792658 >> 172.21.15.27:0/468792658 conn(0x7fd66006eb10 msgr2=0x7fd66006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.823+0000 7fd665828700 1 -- 172.21.15.27:0/468792658 shutdown_connections 2023-10-06T02:59:58.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.823+0000 7fd665828700 1 -- 172.21.15.27:0/468792658 wait complete. 2023-10-06T02:59:58.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7fd363fff700 1 -- 172.21.15.27:0/1278112759 >> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] conn(0x7fd350068eb0 msgr2=0x7fd35006b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7fd363fff700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] conn(0x7fd350068eb0 0x7fd35006b2c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7fd363fff700 1 -- 172.21.15.27:0/1278112759 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd350060600 msgr2=0x7fd350062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7fd363fff700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd350060600 0x7fd350062ab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd354001270 tx=0x7fd36409d790 comp rx=0 tx=0).stop 2023-10-06T02:59:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7fd363fff700 1 -- 172.21.15.27:0/1278112759 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3640b5110 msgr2=0x7fd364170390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7fd363fff700 1 --2- 172.21.15.27:0/1278112759 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3640b5110 0x7fd364170390 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0094d0 tx=0x7fd35c01a000 comp rx=0 tx=0).stop 2023-10-06T02:59:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7fd3637fe700 1 -- 172.21.15.27:0/1278112759 reap_dead start 2023-10-06T02:59:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7fd363fff700 1 -- 172.21.15.27:0/1278112759 shutdown_connections 2023-10-06T02:59:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7fd363fff700 1 -- 172.21.15.27:0/1278112759 >> 172.21.15.27:0/1278112759 conn(0x7fd36406e040 msgr2=0x7fd36415ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7fd363fff700 1 -- 172.21.15.27:0/1278112759 shutdown_connections 2023-10-06T02:59:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7fd363fff700 1 -- 172.21.15.27:0/1278112759 wait complete. 2023-10-06T02:59:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/1649581823 --> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9c6813aa60 con 0x7f9c54068d60 2023-10-06T02:59:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7f9c4ffff700 1 -- 172.21.15.27:0/1649581823 <== osd.6 v2:172.21.15.123:6817/33672 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9c6813aa60 con 0x7f9c54068d60 2023-10-06T02:59:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] conn(0x7f9c54068d60 msgr2=0x7f9c5406b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7f9c6e9a6700 1 --2- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] conn(0x7f9c54068d60 0x7f9c5406b170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9c54060620 msgr2=0x7f9c54062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7f9c6e9a6700 1 --2- 172.21.15.27:0/1649581823 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9c54060620 0x7f9c54062ad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c580098e0 tx=0x7f9c58017000 comp rx=0 tx=0).stop 2023-10-06T02:59:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/1649581823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c680ba090 msgr2=0x7f9c680b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7f9c6e9a6700 1 --2- 172.21.15.27:0/1649581823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c680ba090 0x7f9c680b3460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000cb40 tx=0x7f9c60001770 comp rx=0 tx=0).stop 2023-10-06T02:59:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7f9c6cf43700 1 -- 172.21.15.27:0/1649581823 reap_dead start 2023-10-06T02:59:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/1649581823 shutdown_connections 2023-10-06T02:59:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/1649581823 >> 172.21.15.27:0/1649581823 conn(0x7f9c680be770 msgr2=0x7f9c68150740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/1649581823 shutdown_connections 2023-10-06T02:59:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:58.827+0000 7f9c6e9a6700 1 -- 172.21.15.27:0/1649581823 wait complete. 2023-10-06T02:59:58.884 INFO:teuthology.orchestra.run.smithi027.stdout:55834574856 2023-10-06T02:59:58.884 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T02:59:58.885 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2023-10-06T02:59:58.885 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T02:59:58.886 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2023-10-06T02:59:58.887 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T02:59:58.887 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2023-10-06T02:59:58.888 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T02:59:58.888 INFO:teuthology.orchestra.run.smithi027.stdout:55834574854 2023-10-06T02:59:58.889 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T02:59:58.890 INFO:teuthology.orchestra.run.smithi027.stdout:55834574856 2023-10-06T02:59:58.891 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T02:59:59.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2be23f700 1 Processor -- start 2023-10-06T02:59:59.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2be23f700 1 -- start start 2023-10-06T02:59:59.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2be23f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2b8069710 0x7fb2b806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2be23f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2b8148540 0x7fb2b806a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2be23f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b806a9a0 con 0x7fb2b8069f60 2023-10-06T02:59:59.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2be23f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b8147910 con 0x7fb2b8148540 2023-10-06T02:59:59.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2be23f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8147600 con 0x7fb2b8069710 2023-10-06T02:59:59.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2b7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2b8148540 0x7fb2b806a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2b7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2b8148540 0x7fb2b806a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48756/0 (socket says 172.21.15.27:48756) 2023-10-06T02:59:59.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2b7fff700 1 -- 172.21.15.27:0/888085333 learned_addr learned my addr 172.21.15.27:0/888085333 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2b7fff700 1 -- 172.21.15.27:0/888085333 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2b8069710 msgr2=0x7fb2b806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2b7fff700 1 --2- 172.21.15.27:0/888085333 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2b8069710 0x7fb2b806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2b7fff700 1 -- 172.21.15.27:0/888085333 >> v1:172.21.15.27:6789/0 conn(0x7fb2b8069f60 legacy=0x7fb2b8147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2b7fff700 1 -- 172.21.15.27:0/888085333 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b80b3710 con 0x7fb2b8148540 2023-10-06T02:59:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2b7fff700 1 --2- 172.21.15.27:0/888085333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b8148540 0x7fb2b806a3b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000d1a0 tx=0x7fb2b0007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9bae5be53d4ed1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.027+0000 7fb2b67fc700 1 -- 172.21.15.27:0/888085333 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0010070 con 0x7fb2b8148540 2023-10-06T02:59:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb2b67fc700 1 -- 172.21.15.27:0/888085333 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b000dcb0 con 0x7fb2b8148540 2023-10-06T02:59:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb2b67fc700 1 -- 172.21.15.27:0/888085333 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0007d90 con 0x7fb2b8148540 2023-10-06T02:59:59.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f69e02a0700 1 Processor -- start 2023-10-06T02:59:59.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb2be23f700 1 -- 172.21.15.27:0/888085333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b8148540 msgr2=0x7fb2b806a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb2be23f700 1 --2- 172.21.15.27:0/888085333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b8148540 0x7fb2b806a3b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000d1a0 tx=0x7fb2b0007690 comp rx=0 tx=0).stop 2023-10-06T02:59:59.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f69e02a0700 1 -- start start 2023-10-06T02:59:59.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb2be23f700 1 -- 172.21.15.27:0/888085333 shutdown_connections 2023-10-06T02:59:59.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb2be23f700 1 --2- 172.21.15.27:0/888085333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b8148540 0x7fb2b806a3b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb2be23f700 1 --2- 172.21.15.27:0/888085333 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2b8069710 0x7fb2b806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb2be23f700 1 -- 172.21.15.27:0/888085333 >> 172.21.15.27:0/888085333 conn(0x7fb2b80bb0e0 msgr2=0x7fb2b806b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb2be23f700 1 -- 172.21.15.27:0/888085333 shutdown_connections 2023-10-06T02:59:59.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb2be23f700 1 -- 172.21.15.27:0/888085333 wait complete. 2023-10-06T02:59:59.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb9e9c1f700 1 Processor -- start 2023-10-06T02:59:59.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fe6e50c1700 1 Processor -- start 2023-10-06T02:59:59.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fe6e50c1700 1 -- start start 2023-10-06T02:59:59.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f3d4f10a700 1 Processor -- start 2023-10-06T02:59:59.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f3d4f10a700 1 -- start start 2023-10-06T02:59:59.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f69e02a0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f69d80b6ff0 0x7f69d80b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f69de03c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f69d80b6ff0 0x7f69d80b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f69de03c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f69d80b6ff0 0x7f69d80b8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48770/0 (socket says 172.21.15.27:48770) 2023-10-06T02:59:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f69de03c700 1 -- 172.21.15.27:0/3165404039 learned_addr learned my addr 172.21.15.27:0/3165404039 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f69e02a0700 1 --2- 172.21.15.27:0/3165404039 >> v2:172.21.15.123:3300/0 conn(0x7f69d8068f20 0x7f69d80b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fe6e50c1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe6e00a02a0 0x7fe6e009fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fe6e50c1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e009f5a0 con 0x7fe6e014eb70 2023-10-06T02:59:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fe6e50c1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e014f5a0 con 0x7fe6e009e3f0 2023-10-06T02:59:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fe6e50c1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e014f880 con 0x7fe6e00a02a0 2023-10-06T02:59:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fe9eb790700 1 Processor -- start 2023-10-06T02:59:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f3d4f10a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3d480a2960 0x7f3d480a2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f3d4f10a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4809f760 con 0x7f3d4809e7b0 2023-10-06T02:59:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f3d4f10a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4809fa40 con 0x7f3d4806d6b0 2023-10-06T02:59:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f3d4f10a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d480a02f0 con 0x7f3d480a2960 2023-10-06T02:59:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f3d4d907700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3d4809e7b0 0x7f3d4814a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44508/0 (socket says 172.21.15.27:44508) 2023-10-06T02:59:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f3d4d907700 1 -- 172.21.15.27:0/2871715067 learned_addr learned my addr 172.21.15.27:0/2871715067 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:59.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f062d70d700 1 Processor -- start 2023-10-06T02:59:59.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb2be23f700 1 Processor -- start 2023-10-06T02:59:59.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb9e9c1f700 1 -- start start 2023-10-06T02:59:59.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb9e9c1f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9e4068d60 0x7fb9e4150580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb9e9c1f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb9e40bb7c0 0x7fb9e406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb9e9c1f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e406a830 con 0x7fb9e40bb3f0 2023-10-06T02:59:59.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb9e9c1f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e4069470 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb9e9c1f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4150b80 con 0x7fb9e4068d60 2023-10-06T02:59:59.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb9e3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb9e40bb7c0 0x7fb9e406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fe6df7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe6e00a02a0 0x7fe6e009fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fe6df7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe6e00a02a0 0x7fe6e009fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48778/0 (socket says 172.21.15.27:48778) 2023-10-06T02:59:59.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fe6df7fe700 1 -- 172.21.15.27:0/1546502285 learned_addr learned my addr 172.21.15.27:0/1546502285 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f062d70d700 1 -- start start 2023-10-06T02:59:59.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb9e37fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb9e40bb3f0 0x7fb9e4069be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.27:49714/0 (socket says 172.21.15.27:49714) 2023-10-06T02:59:59.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb9e37fe700 1 -- 172.21.15.27:0/2497330796 learned_addr learned my addr 172.21.15.27:0/2497330796 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T02:59:59.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7f3d4e909700 1 --2- 172.21.15.27:0/2871715067 >> v2:172.21.15.123:3300/0 conn(0x7f3d480a2960 0x7f3d480a2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb9e2ffd700 1 --2- 172.21.15.27:0/2497330796 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9e4068d60 0x7fb9e4150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fe9eb790700 1 -- start start 2023-10-06T02:59:59.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69e02a0700 1 -- 172.21.15.27:0/3165404039 --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d8069560 con 0x7f69d814b9f0 2023-10-06T02:59:59.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738834909 0 0) 0x7f3d4809f760 con 0x7f3d4809e7b0 2023-10-06T02:59:59.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d34003570 con 0x7f3d4809e7b0 2023-10-06T02:59:59.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69e02a0700 1 -- 172.21.15.27:0/3165404039 --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d80697b0 con 0x7f69d80b6ff0 2023-10-06T02:59:59.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69e02a0700 1 -- 172.21.15.27:0/3165404039 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d806a950 con 0x7f69d8068f20 2023-10-06T02:59:59.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69dd03a700 1 -- 172.21.15.27:0/3165404039 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726775892 0 0) 0x7f69d8069560 con 0x7f69d814b9f0 2023-10-06T02:59:59.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69dd03a700 1 -- 172.21.15.27:0/3165404039 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69c4003570 con 0x7f69d814b9f0 2023-10-06T02:59:59.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69de03c700 1 -- 172.21.15.27:0/3165404039 >> v2:172.21.15.123:3300/0 conn(0x7f69d8068f20 msgr2=0x7f69d80b73c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:59:59.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69de03c700 1 --2- 172.21.15.27:0/3165404039 >> v2:172.21.15.123:3300/0 conn(0x7f69d8068f20 0x7f69d80b73c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69de03c700 1 -- 172.21.15.27:0/3165404039 >> v1:172.21.15.27:6789/0 conn(0x7f69d814b9f0 legacy=0x7f69d814be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69de03c700 1 -- 172.21.15.27:0/3165404039 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d806aac0 con 0x7f69d80b6ff0 2023-10-06T02:59:59.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe6df7fe700 1 -- 172.21.15.27:0/1546502285 >> v1:172.21.15.123:6789/0 conn(0x7fe6e009e3f0 legacy=0x7fe6e014a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:59:59.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9eb790700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe9e406a8a0 0x7fe9e406de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9eb790700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe9e40a32f0 0x7fe9e414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9eb790700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e4069970 con 0x7fe9e409e6e0 2023-10-06T02:59:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9eb790700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e406e350 con 0x7fe9e40a32f0 2023-10-06T02:59:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9eb790700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4069290 con 0x7fe9e406a8a0 2023-10-06T02:59:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058741190 0 0) 0x7f3d4809fa40 con 0x7f3d4806d6b0 2023-10-06T02:59:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d4809f760 con 0x7f3d4806d6b0 2023-10-06T02:59:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3432421701 0 0) 0x7f3d34003570 con 0x7f3d4809e7b0 2023-10-06T02:59:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 >> v2:172.21.15.123:3300/0 conn(0x7f3d480a2960 msgr2=0x7f3d480a2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 --2- 172.21.15.27:0/2871715067 >> v2:172.21.15.123:3300/0 conn(0x7f3d480a2960 0x7f3d480a2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 >> v1:172.21.15.123:6789/0 conn(0x7f3d4806d6b0 legacy=0x7f3d4806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4806d020 con 0x7f3d4809e7b0 2023-10-06T02:59:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1323929577 0 0) 0x7f3d400017f0 con 0x7f3d4809e7b0 2023-10-06T02:59:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 >> v1:172.21.15.27:6789/0 conn(0x7f3d4809e7b0 legacy=0x7f3d4814a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 --2- 172.21.15.27:0/2871715067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d34003bf0 0x7f3d34003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 --2- 172.21.15.27:0/2871715067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d34004810 0x7f3d34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 --2- 172.21.15.27:0/2871715067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d340051c0 0x7f3d3400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480a02f0 con 0x7f3d34003bf0 2023-10-06T02:59:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3400c0e0 con 0x7f3d340051c0 2023-10-06T02:59:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3400c2a0 con 0x7f3d34004810 2023-10-06T02:59:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.031+0000 7fb2be23f700 1 -- start start 2023-10-06T02:59:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2be23f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2b8069710 0x7fb2b8148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2be23f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b8069f60 0x7fb2b813fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2be23f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b8148540 0x7fb2b81403b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2be23f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b81414c0 con 0x7fb2b8148540 2023-10-06T02:59:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2be23f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b814a7e0 con 0x7fb2b8069f60 2023-10-06T02:59:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2be23f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8149240 con 0x7fb2b8069710 2023-10-06T02:59:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2b77fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2b8069710 0x7fb2b8148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2b7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b8148540 0x7fb2b81403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2b77fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2b8069710 0x7fb2b8148d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.27:53924/0 (socket says 172.21.15.27:53924) 2023-10-06T02:59:59.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2b77fe700 1 -- 172.21.15.27:0/4114383515 learned_addr learned my addr 172.21.15.27:0/4114383515 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb9e27fc700 1 -- 172.21.15.27:0/2497330796 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555124695 0 0) 0x7fb9e406a830 con 0x7fb9e40bb3f0 2023-10-06T02:59:59.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb9e27fc700 1 -- 172.21.15.27:0/2497330796 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9cc003570 con 0x7fb9e40bb3f0 2023-10-06T02:59:59.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9e8d2b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe9e406a8a0 0x7fe9e406de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9e8d2b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe9e406a8a0 0x7fe9e406de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.27:53940/0 (socket says 172.21.15.27:53940) 2023-10-06T02:59:59.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9e8d2b700 1 -- 172.21.15.27:0/450559460 learned_addr learned my addr 172.21.15.27:0/450559460 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f062d70d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06280b9c50 0x7f06280ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f062d70d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06280a3550 0x7f062809f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f062d70d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062809ef80 con 0x7f06280bb2c0 2023-10-06T02:59:59.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f062d70d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06280a0f20 con 0x7f06280a3550 2023-10-06T02:59:59.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f062d70d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06280a39d0 con 0x7f06280b9c50 2023-10-06T02:59:59.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb9e3fff700 1 -- 172.21.15.27:0/2497330796 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9e4068d60 msgr2=0x7fb9e4150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:59.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb9e3fff700 1 --2- 172.21.15.27:0/2497330796 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9e4068d60 0x7fb9e4150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb9e3fff700 1 -- 172.21.15.27:0/2497330796 >> v1:172.21.15.123:6789/0 conn(0x7fb9e40bb3f0 legacy=0x7fb9e4069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb9e3fff700 1 -- 172.21.15.27:0/2497330796 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40696c0 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4d907700 1 --2- 172.21.15.27:0/2871715067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d34004810 0x7f3d34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2b6ffd700 1 --2- 172.21.15.27:0/4114383515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b8069f60 0x7fb2b813fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69de03c700 1 --2- 172.21.15.27:0/3165404039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69d80b6ff0 0x7f69d80b8d20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f69d8067730 tx=0x7f69d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8c60faf434db91 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4e909700 1 --2- 172.21.15.27:0/2871715067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d340051c0 0x7f3d3400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9e9d2d700 1 --2- 172.21.15.27:0/450559460 >> v2:172.21.15.123:3300/0 conn(0x7fe9e40a32f0 0x7fe9e414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69dd03a700 1 -- 172.21.15.27:0/3165404039 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4009e70 con 0x7f69d80b6ff0 2023-10-06T02:59:59.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb9e2ffd700 1 --2- 172.21.15.27:0/2497330796 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9e4068d60 0x7fb9e4150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:59.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69dd03a700 1 -- 172.21.15.27:0/3165404039 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d400b820 con 0x7f69d80b6ff0 2023-10-06T02:59:59.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69dd03a700 1 -- 172.21.15.27:0/3165404039 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d400bbc0 con 0x7f69d80b6ff0 2023-10-06T02:59:59.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe6df7fe700 1 -- 172.21.15.27:0/1546502285 >> v1:172.21.15.27:6789/0 conn(0x7fe6e014eb70 legacy=0x7fe6e006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe6deffd700 1 -- 172.21.15.27:0/1546502285 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737753673 0 0) 0x7fe6e009f5a0 con 0x7fe6e014eb70 2023-10-06T02:59:59.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe6df7fe700 1 -- 172.21.15.27:0/1546502285 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e006d020 con 0x7fe6e00a02a0 2023-10-06T02:59:59.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4e108700 1 --2- 172.21.15.27:0/2871715067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d34003bf0 0x7f3d34003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f0627fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06280b9c50 0x7f06280ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2b7fff700 1 -- 172.21.15.27:0/4114383515 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2b8069710 msgr2=0x7fb2b8148d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2b7fff700 1 --2- 172.21.15.27:0/4114383515 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2b8069710 0x7fb2b8148d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2b7fff700 1 -- 172.21.15.27:0/4114383515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b8069f60 msgr2=0x7fb2b813fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2b7fff700 1 --2- 172.21.15.27:0/4114383515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b8069f60 0x7fb2b813fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2b7fff700 1 -- 172.21.15.27:0/4114383515 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b000be70 con 0x7fb2b8148540 2023-10-06T02:59:59.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9e8d2b700 1 -- 172.21.15.27:0/450559460 >> v2:172.21.15.123:3300/0 conn(0x7fe9e40a32f0 msgr2=0x7fe9e414fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:59.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9e8d2b700 1 --2- 172.21.15.27:0/450559460 >> v2:172.21.15.123:3300/0 conn(0x7fe9e40a32f0 0x7fe9e414fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9e8d2b700 1 -- 172.21.15.27:0/450559460 >> v1:172.21.15.123:6789/0 conn(0x7fe9e409e6e0 legacy=0x7fe9e406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:59.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9e8d2b700 1 -- 172.21.15.27:0/450559460 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4069600 con 0x7fe9e406a8a0 2023-10-06T02:59:59.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe6df7fe700 1 --2- 172.21.15.27:0/1546502285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6e00a02a0 0x7fe6e009fa30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009f20 tx=0x7fe6d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3342754153372150 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe6deffd700 1 -- 172.21.15.27:0/1546502285 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d800e070 con 0x7fe6e00a02a0 2023-10-06T02:59:59.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4e108700 1 -- 172.21.15.27:0/2871715067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d34004810 msgr2=0x7f3d34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:59.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4e108700 1 --2- 172.21.15.27:0/2871715067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d34004810 0x7f3d34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4e108700 1 -- 172.21.15.27:0/2871715067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d340051c0 msgr2=0x7f3d3400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:59.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4e108700 1 --2- 172.21.15.27:0/2871715067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d340051c0 0x7f3d3400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4e108700 1 -- 172.21.15.27:0/2871715067 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4806d020 con 0x7f3d34003bf0 2023-10-06T02:59:59.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4e909700 1 -- 172.21.15.27:0/2871715067 reap_dead start 2023-10-06T02:59:59.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f0627fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06280b9c50 0x7f06280ba020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.27:53960/0 (socket says 172.21.15.27:53960) 2023-10-06T02:59:59.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f0627fff700 1 -- 172.21.15.27:0/2411145672 learned_addr learned my addr 172.21.15.27:0/2411145672 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2b7fff700 1 --2- 172.21.15.27:0/4114383515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b8148540 0x7fb2b81403b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0017000 tx=0x7fb2b001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe6deffd700 1 -- 172.21.15.27:0/1546502285 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d800ba80 con 0x7fe6e00a02a0 2023-10-06T02:59:59.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe6deffd700 1 -- 172.21.15.27:0/1546502285 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d80092e0 con 0x7fe6e00a02a0 2023-10-06T02:59:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb29f7fe700 1 -- 172.21.15.27:0/4114383515 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0007370 con 0x7fb2b8148540 2023-10-06T02:59:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb29f7fe700 1 -- 172.21.15.27:0/4114383515 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b0008970 con 0x7fb2b8148540 2023-10-06T02:59:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb29f7fe700 1 -- 172.21.15.27:0/4114383515 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00206b0 con 0x7fb2b8148540 2023-10-06T02:59:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2be23f700 1 -- 172.21.15.27:0/4114383515 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b8156230 con 0x7fb2b8148540 2023-10-06T02:59:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69e02a0700 1 -- 172.21.15.27:0/3165404039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69d80b6ff0 msgr2=0x7f69d80b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69e02a0700 1 --2- 172.21.15.27:0/3165404039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69d80b6ff0 0x7f69d80b8d20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f69d8067730 tx=0x7f69d4009250 comp rx=0 tx=0).stop 2023-10-06T02:59:59.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9e8d2b700 1 --2- 172.21.15.27:0/450559460 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe9e406a8a0 0x7fe9e406de10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009fa0 tx=0x7fe9dc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77e0aa741e2c64bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb2be23f700 1 -- 172.21.15.27:0/4114383515 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b80b9ff0 con 0x7fb2b8148540 2023-10-06T02:59:59.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb9e3fff700 1 --2- 172.21.15.27:0/2497330796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e40bb7c0 0x7fb9e406a2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009e60 tx=0x7fb9dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=259387dfdb2d4ef2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f062cf0c700 1 --2- 172.21.15.27:0/2411145672 >> v2:172.21.15.123:3300/0 conn(0x7f06280a3550 0x7f062809f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69e02a0700 1 -- 172.21.15.27:0/3165404039 shutdown_connections 2023-10-06T02:59:59.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69e02a0700 1 --2- 172.21.15.27:0/3165404039 >> v2:172.21.15.123:3300/0 conn(0x7f69d8068f20 0x7f69d80b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69e02a0700 1 --2- 172.21.15.27:0/3165404039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69d80b6ff0 0x7f69d80b8d20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69e02a0700 1 -- 172.21.15.27:0/3165404039 >> 172.21.15.27:0/3165404039 conn(0x7f69d80bb0e0 msgr2=0x7f69d806b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9dbfff700 1 -- 172.21.15.27:0/450559460 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc00e070 con 0x7fe9e406a8a0 2023-10-06T02:59:59.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9dbfff700 1 -- 172.21.15.27:0/450559460 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc00ba80 con 0x7fe9e406a8a0 2023-10-06T02:59:59.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe9dbfff700 1 -- 172.21.15.27:0/450559460 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0092e0 con 0x7fe9e406a8a0 2023-10-06T02:59:59.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb9e27fc700 1 -- 172.21.15.27:0/2497330796 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc00e070 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb9e27fc700 1 -- 172.21.15.27:0/2497330796 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc00b7a0 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fb9e27fc700 1 -- 172.21.15.27:0/2497330796 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8001470 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f69e02a0700 1 -- 172.21.15.27:0/3165404039 shutdown_connections 2023-10-06T02:59:59.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f3d4e108700 1 --2- 172.21.15.27:0/2871715067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d34003bf0 0x7f3d34003fc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d38001aa0 tx=0x7f3d38007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be319d005dcad72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69e02a0700 1 -- 172.21.15.27:0/3165404039 wait complete. 2023-10-06T02:59:59.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe6e50c1700 1 -- 172.21.15.27:0/1546502285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6e00a02a0 msgr2=0x7fe6e009fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7fe6e50c1700 1 --2- 172.21.15.27:0/1546502285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6e00a02a0 0x7fe6e009fa30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009f20 tx=0x7fe6d8009840 comp rx=0 tx=0).stop 2023-10-06T02:59:59.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e50c1700 1 -- 172.21.15.27:0/1546502285 shutdown_connections 2023-10-06T02:59:59.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e50c1700 1 --2- 172.21.15.27:0/1546502285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6e00a02a0 0x7fe6e009fa30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e50c1700 1 -- 172.21.15.27:0/1546502285 >> 172.21.15.27:0/1546502285 conn(0x7fe6e006e040 msgr2=0x7fe6e006e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e50c1700 1 -- 172.21.15.27:0/1546502285 shutdown_connections 2023-10-06T02:59:59.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e50c1700 1 -- 172.21.15.27:0/1546502285 wait complete. 2023-10-06T02:59:59.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f0627fff700 1 -- 172.21.15.27:0/2411145672 >> v2:172.21.15.123:3300/0 conn(0x7f06280a3550 msgr2=0x7f062809f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:59.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f0627fff700 1 --2- 172.21.15.27:0/2411145672 >> v2:172.21.15.123:3300/0 conn(0x7f06280a3550 0x7f062809f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f0627fff700 1 -- 172.21.15.27:0/2411145672 >> v1:172.21.15.123:6789/0 conn(0x7f06280bb2c0 legacy=0x7f062806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f0627fff700 1 -- 172.21.15.27:0/2411145672 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06280a2c50 con 0x7f06280b9c50 2023-10-06T02:59:59.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.035+0000 7f0627fff700 1 --2- 172.21.15.27:0/2411145672 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06280b9c50 0x7f06280ba020 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f06180099b0 tx=0x7f0618009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a43c2c3344059565 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f0626ffd700 1 -- 172.21.15.27:0/2411145672 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618009ea0 con 0x7f06280b9c50 2023-10-06T02:59:59.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe9eb790700 1 -- 172.21.15.27:0/450559460 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe9e406a8a0 msgr2=0x7fe9e406de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe9eb790700 1 --2- 172.21.15.27:0/450559460 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe9e406a8a0 0x7fe9e406de10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009fa0 tx=0x7fe9dc009840 comp rx=0 tx=0).stop 2023-10-06T02:59:59.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f0626ffd700 1 -- 172.21.15.27:0/2411145672 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061800b760 con 0x7f06280b9c50 2023-10-06T02:59:59.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f0626ffd700 1 -- 172.21.15.27:0/2411145672 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800bb00 con 0x7f06280b9c50 2023-10-06T02:59:59.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/2497330796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e40bb7c0 msgr2=0x7fb9e406a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb9e9c1f700 1 --2- 172.21.15.27:0/2497330796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e40bb7c0 0x7fb9e406a2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009e60 tx=0x7fb9dc009780 comp rx=0 tx=0).stop 2023-10-06T02:59:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/2497330796 shutdown_connections 2023-10-06T02:59:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb9e9c1f700 1 --2- 172.21.15.27:0/2497330796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e40bb7c0 0x7fb9e406a2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb9e9c1f700 1 --2- 172.21.15.27:0/2497330796 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9e4068d60 0x7fb9e4150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/2497330796 >> 172.21.15.27:0/2497330796 conn(0x7fb9e40c6e00 msgr2=0x7fb9e406df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/2497330796 shutdown_connections 2023-10-06T02:59:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69e02a0700 1 Processor -- start 2023-10-06T02:59:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69e02a0700 1 -- start start 2023-10-06T02:59:59.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3800c590 con 0x7f3d34003bf0 2023-10-06T02:59:59.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3800c710 con 0x7f3d34003bf0 2023-10-06T02:59:59.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f3d4d106700 1 -- 172.21.15.27:0/2871715067 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3800cad0 con 0x7f3d34003bf0 2023-10-06T02:59:59.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f062d70d700 1 -- 172.21.15.27:0/2411145672 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06280b9c50 msgr2=0x7f06280ba020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f062d70d700 1 --2- 172.21.15.27:0/2411145672 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06280b9c50 0x7f06280ba020 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f06180099b0 tx=0x7f0618009250 comp rx=0 tx=0).stop 2023-10-06T02:59:59.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e50c1700 1 Processor -- start 2023-10-06T02:59:59.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e50c1700 1 -- start start 2023-10-06T02:59:59.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f062d70d700 1 -- 172.21.15.27:0/2411145672 shutdown_connections 2023-10-06T02:59:59.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f062d70d700 1 --2- 172.21.15.27:0/2411145672 >> v2:172.21.15.123:3300/0 conn(0x7f06280a3550 0x7f062809f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f062d70d700 1 --2- 172.21.15.27:0/2411145672 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06280b9c50 0x7f06280ba020 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f062d70d700 1 -- 172.21.15.27:0/2411145672 >> 172.21.15.27:0/2411145672 conn(0x7f062806eb10 msgr2=0x7f06280ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb29f7fe700 1 -- 172.21.15.27:0/4114383515 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb2b0016440 con 0x7fb2b8148540 2023-10-06T02:59:59.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb29f7fe700 1 --2- 172.21.15.27:0/4114383515 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb2a4060550 0x7fb2a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb29f7fe700 1 -- 172.21.15.27:0/4114383515 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb2b007ddb0 con 0x7fb2b8148540 2023-10-06T02:59:59.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb2b77fe700 1 --2- 172.21.15.27:0/4114383515 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb2a4060550 0x7fb2a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f062d70d700 1 -- 172.21.15.27:0/2411145672 shutdown_connections 2023-10-06T02:59:59.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f062d70d700 1 -- 172.21.15.27:0/2411145672 wait complete. 2023-10-06T02:59:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb2be23f700 1 -- 172.21.15.27:0/4114383515 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b8067800 con 0x7fb2b8148540 2023-10-06T02:59:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69e02a0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69d8068f20 0x7f69d814ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69e02a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69d80b6ff0 0x7f69d8146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/2497330796 wait complete. 2023-10-06T02:59:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb9e9c1f700 1 Processor -- start 2023-10-06T02:59:59.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69e02a0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69d814b9f0 0x7f69d81634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69e02a0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d814e740 con 0x7f69d8068f20 2023-10-06T02:59:59.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69e02a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d814f110 con 0x7f69d80b6ff0 2023-10-06T02:59:59.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69e02a0700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d814d190 con 0x7f69d814b9f0 2023-10-06T02:59:59.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f3d4f10a700 1 -- 172.21.15.27:0/2871715067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d34003bf0 msgr2=0x7f3d34003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f3d4f10a700 1 --2- 172.21.15.27:0/2871715067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d34003bf0 0x7f3d34003fc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d38001aa0 tx=0x7f3d38007d10 comp rx=0 tx=0).stop 2023-10-06T02:59:59.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f3d4f10a700 1 -- 172.21.15.27:0/2871715067 shutdown_connections 2023-10-06T02:59:59.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f3d4f10a700 1 --2- 172.21.15.27:0/2871715067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d34003bf0 0x7f3d34003fc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f3d4f10a700 1 -- 172.21.15.27:0/2871715067 >> 172.21.15.27:0/2871715067 conn(0x7f3d4806eb10 msgr2=0x7f3d480ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f3d4f10a700 1 -- 172.21.15.27:0/2871715067 shutdown_connections 2023-10-06T02:59:59.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e50c1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6e009e3f0 0x7fe6e015f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e50c1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6e00a02a0 0x7fe6e0160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f3d4f10a700 1 -- 172.21.15.27:0/2871715067 wait complete. 2023-10-06T02:59:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e50c1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6e014eb70 0x7fe6e009c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e50c1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e015fc30 con 0x7fe6e014eb70 2023-10-06T02:59:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e50c1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e015ff10 con 0x7fe6e009e3f0 2023-10-06T02:59:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e50c1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e006ae20 con 0x7fe6e00a02a0 2023-10-06T02:59:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb2b77fe700 1 --2- 172.21.15.27:0/4114383515 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb2a4060550 0x7fb2a4062a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009ca0 tx=0x7fb2a8009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e48c0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6e014eb70 0x7fe6e009c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e48c0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6e014eb70 0x7fe6e009c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48806/0 (socket says 172.21.15.27:48806) 2023-10-06T02:59:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6e48c0700 1 -- 172.21.15.27:0/45358201 learned_addr learned my addr 172.21.15.27:0/45358201 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6df7fe700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6e00a02a0 0x7fe6e0160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fe6dffff700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6e009e3f0 0x7fe6e015f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 -- 172.21.15.27:0/450559460 shutdown_connections 2023-10-06T02:59:59.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 --2- 172.21.15.27:0/450559460 >> v2:172.21.15.123:3300/0 conn(0x7fe9e40a32f0 0x7fe9e414fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 --2- 172.21.15.27:0/450559460 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe9e406a8a0 0x7fe9e406de10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 -- 172.21.15.27:0/450559460 >> 172.21.15.27:0/450559460 conn(0x7fe9e40bb0e0 msgr2=0x7fe9e406b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb9e9c1f700 1 -- start start 2023-10-06T02:59:59.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb9e9c1f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9e4068d60 0x7fb9e4147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb9e9c1f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e40bb3f0 0x7fb9e41438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7fb9e9c1f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9e40bb7c0 0x7fb9e4168770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fb9e9c1f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4145ea0 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fb9e9c1f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e41682e0 con 0x7fb9e40bb3f0 2023-10-06T02:59:59.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fb9e9c1f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4167fd0 con 0x7fb9e4068d60 2023-10-06T02:59:59.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe6dffff700 1 -- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6e00a02a0 msgr2=0x7fe6e0160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe6dffff700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6e00a02a0 0x7fe6e0160430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe6dffff700 1 -- 172.21.15.27:0/45358201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6e014eb70 msgr2=0x7fe6e009c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe6dffff700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6e014eb70 0x7fe6e009c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 -- 172.21.15.27:0/450559460 shutdown_connections 2023-10-06T02:59:59.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 -- 172.21.15.27:0/450559460 wait complete. 2023-10-06T02:59:59.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69de03c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69d8068f20 0x7f69d814ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69de03c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69d8068f20 0x7f69d814ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48794/0 (socket says 172.21.15.27:48794) 2023-10-06T02:59:59.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69de03c700 1 -- 172.21.15.27:0/499123717 learned_addr learned my addr 172.21.15.27:0/499123717 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe6dffff700 1 -- 172.21.15.27:0/45358201 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d8009ae0 con 0x7fe6e009e3f0 2023-10-06T02:59:59.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe6df7fe700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6e00a02a0 0x7fe6e0160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:59.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe6e48c0700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6e014eb70 0x7fe6e009c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:59.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69de83d700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69d814b9f0 0x7f69d81634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69de03c700 1 -- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69d814b9f0 msgr2=0x7f69d81634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69de03c700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69d814b9f0 0x7f69d81634c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69de03c700 1 -- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69d80b6ff0 msgr2=0x7f69d8146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69dd83b700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69d80b6ff0 0x7f69d8146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69de03c700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69d80b6ff0 0x7f69d8146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.039+0000 7f69de03c700 1 -- 172.21.15.27:0/499123717 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d40094f0 con 0x7f69d8068f20 2023-10-06T02:59:59.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f69dd83b700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69d80b6ff0 0x7f69d8146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:59.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f69de03c700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69d8068f20 0x7f69d814ebd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009290 tx=0x7f69d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fb9e3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9e40bb7c0 0x7fb9e4168770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062d70d700 1 Processor -- start 2023-10-06T02:59:59.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fb9e3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9e40bb7c0 0x7fb9e4168770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48812/0 (socket says 172.21.15.27:48812) 2023-10-06T02:59:59.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062d70d700 1 -- start start 2023-10-06T02:59:59.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fb9e3fff700 1 -- 172.21.15.27:0/393216240 learned_addr learned my addr 172.21.15.27:0/393216240 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fb9e2ffd700 1 --2- 172.21.15.27:0/393216240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e40bb3f0 0x7fb9e41438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe6dffff700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6e009e3f0 0x7fe6e015f5d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000c490 tx=0x7fe6d0007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fb9e3fff700 1 -- 172.21.15.27:0/393216240 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9e4068d60 msgr2=0x7fb9e4147ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:59:59.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fb9e3fff700 1 --2- 172.21.15.27:0/393216240 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9e4068d60 0x7fb9e4147ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fb9e3fff700 1 -- 172.21.15.27:0/393216240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e40bb3f0 msgr2=0x7fb9e41438e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fb9e3fff700 1 --2- 172.21.15.27:0/393216240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e40bb3f0 0x7fb9e41438e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fb9e3fff700 1 -- 172.21.15.27:0/393216240 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d4009420 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062d70d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06280a3550 0x7f062806abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062d70d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06280b9c50 0x7f0628068550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062d70d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06280bb2c0 0x7f06280b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fb9e3fff700 1 --2- 172.21.15.27:0/393216240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9e40bb7c0 0x7fb9e4168770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00b610 tx=0x7fb9dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062d70d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06280b35a0 con 0x7f06280bb2c0 2023-10-06T02:59:59.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062d70d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062816c530 con 0x7f06280b9c50 2023-10-06T02:59:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062d70d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062806b100 con 0x7f06280a3550 2023-10-06T02:59:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062cf0c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06280bb2c0 0x7f06280b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062cf0c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06280bb2c0 0x7f06280b29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48828/0 (socket says 172.21.15.27:48828) 2023-10-06T02:59:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062cf0c700 1 -- 172.21.15.27:0/734602462 learned_addr learned my addr 172.21.15.27:0/734602462 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062cf0c700 1 -- 172.21.15.27:0/734602462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06280a3550 msgr2=0x7f062806abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:59:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062cf0c700 1 --2- 172.21.15.27:0/734602462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06280a3550 0x7f062806abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062cf0c700 1 -- 172.21.15.27:0/734602462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06280b9c50 msgr2=0x7f0628068550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:59:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062cf0c700 1 --2- 172.21.15.27:0/734602462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06280b9c50 0x7f0628068550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062cf0c700 1 -- 172.21.15.27:0/734602462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06180094f0 con 0x7f06280bb2c0 2023-10-06T02:59:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f062cf0c700 1 --2- 172.21.15.27:0/734602462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06280bb2c0 0x7f06280b29b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0620009e90 tx=0x7f062000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 Processor -- start 2023-10-06T02:59:59.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4f10a700 1 Processor -- start 2023-10-06T02:59:59.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4f10a700 1 -- start start 2023-10-06T02:59:59.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4f10a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d34003bf0 0x7f3d480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4f10a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d4806b070 0x7f3d481430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4f10a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d48143610 0x7f3d48141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4f10a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4806a530 con 0x7f3d48143610 2023-10-06T02:59:59.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4f10a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480b9cf0 con 0x7f3d34003bf0 2023-10-06T02:59:59.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4f10a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4813c970 con 0x7f3d4806b070 2023-10-06T02:59:59.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 -- start start 2023-10-06T02:59:59.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4e909700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d48143610 0x7f3d48141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4e909700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d48143610 0x7f3d48141610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48838/0 (socket says 172.21.15.27:48838) 2023-10-06T02:59:59.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4d907700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d4806b070 0x7f3d481430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4e909700 1 -- 172.21.15.27:0/1974041054 learned_addr learned my addr 172.21.15.27:0/1974041054 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4e108700 1 --2- 172.21.15.27:0/1974041054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d34003bf0 0x7f3d480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4e909700 1 -- 172.21.15.27:0/1974041054 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d4806b070 msgr2=0x7f3d481430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4e909700 1 --2- 172.21.15.27:0/1974041054 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d4806b070 0x7f3d481430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4e909700 1 -- 172.21.15.27:0/1974041054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d34003bf0 msgr2=0x7f3d480697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4e909700 1 --2- 172.21.15.27:0/1974041054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d34003bf0 0x7f3d480697d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4e909700 1 -- 172.21.15.27:0/1974041054 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d48069d10 con 0x7f3d48143610 2023-10-06T02:59:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7f3d4e909700 1 --2- 172.21.15.27:0/1974041054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d48143610 0x7f3d48141610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3d480704d0 tx=0x7f3d44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e406a8a0 0x7fe9e40a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe9e409e6e0 0x7fe9e4162e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e40a32f0 0x7fe9e414ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e40b2e80 con 0x7fe9e406a8a0 2023-10-06T02:59:59.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e414c2a0 con 0x7fe9e40a32f0 2023-10-06T02:59:59.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9eb790700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e414bb40 con 0x7fe9e409e6e0 2023-10-06T02:59:59.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9e952c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e406a8a0 0x7fe9e40a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9e952c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e406a8a0 0x7fe9e40a14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48840/0 (socket says 172.21.15.27:48840) 2023-10-06T02:59:59.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9e952c700 1 -- 172.21.15.27:0/779205167 learned_addr learned my addr 172.21.15.27:0/779205167 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9e9d2d700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e40a32f0 0x7fe9e414ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9e8d2b700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe9e409e6e0 0x7fe9e4162e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9e952c700 1 -- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe9e409e6e0 msgr2=0x7fe9e4162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9e952c700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe9e409e6e0 0x7fe9e4162e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9e952c700 1 -- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e40a32f0 msgr2=0x7fe9e414ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9e952c700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e40a32f0 0x7fe9e414ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9e952c700 1 -- 172.21.15.27:0/779205167 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc009ae0 con 0x7fe9e406a8a0 2023-10-06T02:59:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9e9d2d700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e40a32f0 0x7fe9e414ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.043+0000 7fe9e952c700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e406a8a0 0x7fe9e40a14b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000c5d0 tx=0x7fe9e0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.047+0000 7fe6c7fff700 1 -- 172.21.15.27:0/45358201 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d000ce40 con 0x7fe6e009e3f0 2023-10-06T02:59:59.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.047+0000 7fe6c7fff700 1 -- 172.21.15.27:0/45358201 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d0011590 con 0x7fe6e009e3f0 2023-10-06T02:59:59.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.047+0000 7fe6e50c1700 1 -- 172.21.15.27:0/45358201 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e0160970 con 0x7fe6e009e3f0 2023-10-06T02:59:59.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.047+0000 7fe6c7fff700 1 -- 172.21.15.27:0/45358201 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0011950 con 0x7fe6e009e3f0 2023-10-06T02:59:59.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.047+0000 7fe6e50c1700 1 -- 172.21.15.27:0/45358201 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e009cac0 con 0x7fe6e009e3f0 2023-10-06T02:59:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.047+0000 7fe6e50c1700 1 -- 172.21.15.27:0/45358201 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e009cef0 con 0x7fe6e009e3f0 2023-10-06T02:59:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.047+0000 7fe6c7fff700 1 -- 172.21.15.27:0/45358201 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe6d0011d00 con 0x7fe6e009e3f0 2023-10-06T02:59:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.047+0000 7fe6c7fff700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe6cc060620 0x7fe6cc062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.047+0000 7fe6c7fff700 1 -- 172.21.15.27:0/45358201 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe6d007bde0 con 0x7fe6e009e3f0 2023-10-06T02:59:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.047+0000 7fe6df7fe700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe6cc060620 0x7fe6cc062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.047+0000 7fe6df7fe700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe6cc060620 0x7fe6cc062ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00a0690 tx=0x7fe6d8018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7f69ce7fc700 1 -- 172.21.15.27:0/499123717 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4011e80 con 0x7f69d8068f20 2023-10-06T02:59:59.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7fb9cb7fe700 1 -- 172.21.15.27:0/393216240 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc00beb0 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7fe9d97fa700 1 -- 172.21.15.27:0/779205167 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0011590 con 0x7fe9e406a8a0 2023-10-06T02:59:59.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7f060ffff700 1 -- 172.21.15.27:0/734602462 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062000cc20 con 0x7f06280bb2c0 2023-10-06T02:59:59.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7fb29f7fe700 1 -- 172.21.15.27:0/4114383515 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb2b004e240 con 0x7fb2b8148540 2023-10-06T02:59:59.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7f69e02a0700 1 -- 172.21.15.27:0/499123717 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d814e3d0 con 0x7f69d8068f20 2023-10-06T02:59:59.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7f69ce7fc700 1 -- 172.21.15.27:0/499123717 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d401b680 con 0x7f69d8068f20 2023-10-06T02:59:59.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7f69e02a0700 1 -- 172.21.15.27:0/499123717 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d81471f0 con 0x7f69d8068f20 2023-10-06T02:59:59.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7fe9eb790700 1 -- 172.21.15.27:0/779205167 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e4163a00 con 0x7fe9e406a8a0 2023-10-06T02:59:59.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7fe9eb790700 1 -- 172.21.15.27:0/779205167 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e4151620 con 0x7fe9e406a8a0 2023-10-06T02:59:59.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7f062d70d700 1 -- 172.21.15.27:0/734602462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0628165ab0 con 0x7f06280bb2c0 2023-10-06T02:59:59.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7f062d70d700 1 -- 172.21.15.27:0/734602462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0628068c30 con 0x7f06280bb2c0 2023-10-06T02:59:59.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7f060ffff700 1 -- 172.21.15.27:0/734602462 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062000f040 con 0x7f06280bb2c0 2023-10-06T02:59:59.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7f69ce7fc700 1 -- 172.21.15.27:0/499123717 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d401ba20 con 0x7f69d8068f20 2023-10-06T02:59:59.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/393216240 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc009a20 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7fb9cb7fe700 1 -- 172.21.15.27:0/393216240 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc007000 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/393216240 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e416bf90 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7fb9cb7fe700 1 -- 172.21.15.27:0/393216240 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc01e660 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/1974041054 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44015460 con 0x7f3d48143610 2023-10-06T02:59:59.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7f060ffff700 1 -- 172.21.15.27:0/734602462 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620014480 con 0x7f06280bb2c0 2023-10-06T02:59:59.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/1974041054 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d440155e0 con 0x7f3d48143610 2023-10-06T02:59:59.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/1974041054 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d440159a0 con 0x7f3d48143610 2023-10-06T02:59:59.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7fe9d97fa700 1 -- 172.21.15.27:0/779205167 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e00021c0 con 0x7fe9e406a8a0 2023-10-06T02:59:59.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.051+0000 7fe9d97fa700 1 -- 172.21.15.27:0/779205167 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0011900 con 0x7fe9e406a8a0 2023-10-06T02:59:59.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7f3d4f10a700 1 -- 172.21.15.27:0/1974041054 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d480687c0 con 0x7f3d48143610 2023-10-06T02:59:59.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7f3d4f10a700 1 -- 172.21.15.27:0/1974041054 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d48141cf0 con 0x7f3d48143610 2023-10-06T02:59:59.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7f060dffb700 1 -- 172.21.15.27:0/734602462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06280674b0 con 0x7f06280bb2c0 2023-10-06T02:59:59.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7fe9d97fa700 1 -- 172.21.15.27:0/779205167 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe9e0011a60 con 0x7fe9e406a8a0 2023-10-06T02:59:59.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7f69e02a0700 1 -- 172.21.15.27:0/499123717 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c00052b0 con 0x7f69d8068f20 2023-10-06T02:59:59.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7f69ce7fc700 1 -- 172.21.15.27:0/499123717 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f69d402f480 con 0x7f69d8068f20 2023-10-06T02:59:59.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7f69ce7fc700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f69bc060550 0x7f69bc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7fb9cb7fe700 1 -- 172.21.15.27:0/393216240 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb9dc01ea50 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7fe9eb790700 1 -- 172.21.15.27:0/779205167 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c00052b0 con 0x7fe9e406a8a0 2023-10-06T02:59:59.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7fe9d97fa700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe9c8060550 0x7fe9c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/393216240 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e40c3f20 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7fb9cb7fe700 1 --2- 172.21.15.27:0/393216240 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb9d0060580 0x7fb9d0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7f060ffff700 1 -- 172.21.15.27:0/734602462 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f06200145e0 con 0x7f06280bb2c0 2023-10-06T02:59:59.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7fe6c7fff700 1 -- 172.21.15.27:0/45358201 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe6d004c3d0 con 0x7fe6e009e3f0 2023-10-06T02:59:59.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7fe9d97fa700 1 -- 172.21.15.27:0/779205167 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe9e007c3a0 con 0x7fe9e406a8a0 2023-10-06T02:59:59.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7f69ce7fc700 1 -- 172.21.15.27:0/499123717 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f69d407e9e0 con 0x7f69d8068f20 2023-10-06T02:59:59.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7f69dd83b700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f69bc060550 0x7f69bc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7f060ffff700 1 --2- 172.21.15.27:0/734602462 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f06140605b0 0x7f0614062a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7fe9e8d2b700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe9c8060550 0x7fe9c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7fb9cb7fe700 1 -- 172.21.15.27:0/393216240 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb9dc07e260 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7fb9e37fe700 1 --2- 172.21.15.27:0/393216240 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb9d0060580 0x7fb9d0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7f060ffff700 1 -- 172.21.15.27:0/734602462 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f062007d7e0 con 0x7f06280bb2c0 2023-10-06T02:59:59.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.055+0000 7f0627fff700 1 --2- 172.21.15.27:0/734602462 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f06140605b0 0x7f0614062a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.059+0000 7fe9e8d2b700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe9c8060550 0x7fe9c8062a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe9e406ac90 tx=0x7fe9dc017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.059+0000 7f3d4f10a700 1 -- 172.21.15.27:0/1974041054 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4806a390 con 0x7f3d48143610 2023-10-06T02:59:59.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.059+0000 7f69dd83b700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f69bc060550 0x7f69bc062a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f69c8006fd0 tx=0x7f69c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.059+0000 7fb9e37fe700 1 --2- 172.21.15.27:0/393216240 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb9d0060580 0x7fb9d0062a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80011e0 tx=0x7fb9d8001000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.059+0000 7f0627fff700 1 --2- 172.21.15.27:0/734602462 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f06140605b0 0x7f0614062a60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f06180099b0 tx=0x7f0618016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.063+0000 7f060ffff700 1 -- 172.21.15.27:0/734602462 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f062004dbd0 con 0x7f06280bb2c0 2023-10-06T02:59:59.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.071+0000 7f69ce7fc700 1 -- 172.21.15.27:0/499123717 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f69d404eef0 con 0x7f69d8068f20 2023-10-06T02:59:59.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.075+0000 7f65c8955700 1 Processor -- start 2023-10-06T02:59:59.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.075+0000 7f65c8955700 1 -- start start 2023-10-06T02:59:59.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.075+0000 7f65c8955700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f65c414ed80 0x7f65c414f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.075+0000 7f65c8955700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f65c4069570 0x7f65c406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.075+0000 7f65c8955700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c4069090 con 0x7f65c406b1b0 2023-10-06T02:59:59.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.075+0000 7f65c8955700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c406aa90 con 0x7f65c4069570 2023-10-06T02:59:59.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.075+0000 7f65c8955700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c414f840 con 0x7f65c414ed80 2023-10-06T02:59:59.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.075+0000 7f65b9d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f65c4069570 0x7f65c406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7f65b9d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f65c4069570 0x7f65c406b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48848/0 (socket says 172.21.15.27:48848) 2023-10-06T02:59:59.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7f65b9d9b700 1 -- 172.21.15.27:0/2427605334 learned_addr learned my addr 172.21.15.27:0/2427605334 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7f65c259c700 1 --2- 172.21.15.27:0/2427605334 >> v2:172.21.15.123:3300/0 conn(0x7f65c414ed80 0x7f65c414f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7f65c259c700 1 -- 172.21.15.27:0/2427605334 >> v2:172.21.15.27:3300/0 conn(0x7f65c4069570 msgr2=0x7f65c406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:59.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7f65c259c700 1 --2- 172.21.15.27:0/2427605334 >> v2:172.21.15.27:3300/0 conn(0x7f65c4069570 0x7f65c406b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7f65c259c700 1 -- 172.21.15.27:0/2427605334 >> v1:172.21.15.123:6789/0 conn(0x7f65c406b1b0 legacy=0x7f65c406be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7f65c259c700 1 -- 172.21.15.27:0/2427605334 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c414fb20 con 0x7f65c414ed80 2023-10-06T02:59:59.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7f65b9d9b700 1 --2- 172.21.15.27:0/2427605334 >> v2:172.21.15.27:3300/0 conn(0x7f65c4069570 0x7f65c406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:59.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7fb9cb7fe700 1 -- 172.21.15.27:0/393216240 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb9dc052180 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7f65c259c700 1 --2- 172.21.15.27:0/2427605334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65c414ed80 0x7f65c414f150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f65c40b8440 tx=0x7f65ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d12b1bba85a9da74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/1974041054 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3d44027430 con 0x7f3d48143610 2023-10-06T02:59:59.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.083+0000 7f3d3e7fc700 1 --2- 172.21.15.27:0/1974041054 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3d2c060650 0x7f3d2c062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7f65c1d9b700 1 -- 172.21.15.27:0/2427605334 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac011630 con 0x7f65c414ed80 2023-10-06T02:59:59.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7f65c1d9b700 1 -- 172.21.15.27:0/2427605334 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac011790 con 0x7f65c414ed80 2023-10-06T02:59:59.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.079+0000 7f65c1d9b700 1 -- 172.21.15.27:0/2427605334 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac011b30 con 0x7f65c414ed80 2023-10-06T02:59:59.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.083+0000 7f3d4e108700 1 --2- 172.21.15.27:0/1974041054 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3d2c060650 0x7f3d2c062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.083+0000 7f65c8955700 1 -- 172.21.15.27:0/2427605334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65c414ed80 msgr2=0x7f65c414f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.083+0000 7f3d4e108700 1 --2- 172.21.15.27:0/1974041054 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3d2c060650 0x7f3d2c062b00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d38001aa0 tx=0x7f3d38015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.083+0000 7f65c8955700 1 --2- 172.21.15.27:0/2427605334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65c414ed80 0x7f65c414f150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f65c40b8440 tx=0x7f65ac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.083+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/1974041054 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3d44026eb0 con 0x7f3d48143610 2023-10-06T02:59:59.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.083+0000 7fe9d97fa700 1 -- 172.21.15.27:0/779205167 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe9e004c830 con 0x7fe9e406a8a0 2023-10-06T02:59:59.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.091+0000 7f65c8955700 1 -- 172.21.15.27:0/2427605334 shutdown_connections 2023-10-06T02:59:59.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.091+0000 7f65c8955700 1 --2- 172.21.15.27:0/2427605334 >> v2:172.21.15.27:3300/0 conn(0x7f65c4069570 0x7f65c406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.091+0000 7f65c8955700 1 --2- 172.21.15.27:0/2427605334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65c414ed80 0x7f65c414f150 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.091+0000 7f65c8955700 1 -- 172.21.15.27:0/2427605334 >> 172.21.15.27:0/2427605334 conn(0x7f65c40bdca0 msgr2=0x7f65c40be0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.091+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/1974041054 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3d4404d1b0 con 0x7f3d48143610 2023-10-06T02:59:59.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.091+0000 7f65c8955700 1 -- 172.21.15.27:0/2427605334 shutdown_connections 2023-10-06T02:59:59.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.091+0000 7f65c8955700 1 -- 172.21.15.27:0/2427605334 wait complete. 2023-10-06T02:59:59.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c8955700 1 Processor -- start 2023-10-06T02:59:59.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c8955700 1 -- start start 2023-10-06T02:59:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c8955700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c4069570 0x7f65c416c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c8955700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65c406b1b0 0x7f65c4148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c8955700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65c414ed80 0x7f65c414e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c8955700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c41479a0 con 0x7f65c4069570 2023-10-06T02:59:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c8955700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c414e710 con 0x7f65c414ed80 2023-10-06T02:59:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c8955700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c4147c40 con 0x7f65c406b1b0 2023-10-06T02:59:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c4069570 0x7f65c416c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c4069570 0x7f65c416c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48856/0 (socket says 172.21.15.27:48856) 2023-10-06T02:59:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c259c700 1 -- 172.21.15.27:0/269773198 learned_addr learned my addr 172.21.15.27:0/269773198 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T02:59:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65b9d9b700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65c406b1b0 0x7f65c4148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c2d9d700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65c414ed80 0x7f65c414e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c259c700 1 -- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65c406b1b0 msgr2=0x7f65c4148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c259c700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65c406b1b0 0x7f65c4148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c259c700 1 -- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65c414ed80 msgr2=0x7f65c414e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c259c700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65c414ed80 0x7f65c414e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c259c700 1 -- 172.21.15.27:0/269773198 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b40094f0 con 0x7f65c4069570 2023-10-06T02:59:59.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c259c700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c4069570 0x7f65c416c040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0093f0 tx=0x7f65ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65baffd700 1 -- 172.21.15.27:0/269773198 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac01cc40 con 0x7f65c4069570 2023-10-06T02:59:59.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.095+0000 7f65c8955700 1 -- 172.21.15.27:0/269773198 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac009420 con 0x7f65c4069570 2023-10-06T02:59:59.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.099+0000 7f65c8955700 1 -- 172.21.15.27:0/269773198 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c41496a0 con 0x7f65c4069570 2023-10-06T02:59:59.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.099+0000 7f65baffd700 1 -- 172.21.15.27:0/269773198 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac01cda0 con 0x7f65c4069570 2023-10-06T02:59:59.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.099+0000 7f65baffd700 1 -- 172.21.15.27:0/269773198 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac01a660 con 0x7f65c4069570 2023-10-06T02:59:59.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.099+0000 7f65baffd700 1 -- 172.21.15.27:0/269773198 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f65ac01aa90 con 0x7f65c4069570 2023-10-06T02:59:59.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.099+0000 7f65baffd700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f65a4060600 0x7f65a4062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.099+0000 7f65baffd700 1 -- 172.21.15.27:0/269773198 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f65ac07e110 con 0x7f65c4069570 2023-10-06T02:59:59.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.099+0000 7f65b9d9b700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f65a4060600 0x7f65a4062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.103+0000 7f65b9d9b700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f65a4060600 0x7f65a4062ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f65c406c800 tx=0x7f65b4009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.111+0000 7f65c8955700 1 -- 172.21.15.27:0/269773198 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a80052b0 con 0x7f65c4069570 2023-10-06T02:59:59.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.119+0000 7f65baffd700 1 -- 172.21.15.27:0/269773198 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f65ac04e5b0 con 0x7f65c4069570 2023-10-06T02:59:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.367+0000 7f060dffb700 1 -- 172.21.15.27:0/734602462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f062804b600 con 0x7f06280bb2c0 2023-10-06T02:59:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.367+0000 7f060ffff700 1 -- 172.21.15.27:0/734602462 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06200511f0 con 0x7f06280bb2c0 2023-10-06T02:59:59.374 INFO:teuthology.orchestra.run.smithi027.stdout:55834574854 2023-10-06T02:59:59.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.371+0000 7f062d70d700 1 -- 172.21.15.27:0/734602462 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f06140605b0 msgr2=0x7f0614062a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.371+0000 7f062d70d700 1 --2- 172.21.15.27:0/734602462 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f06140605b0 0x7f0614062a60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f06180099b0 tx=0x7f0618016000 comp rx=0 tx=0).stop 2023-10-06T02:59:59.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.371+0000 7f062d70d700 1 -- 172.21.15.27:0/734602462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06280bb2c0 msgr2=0x7f06280b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.371+0000 7f062d70d700 1 --2- 172.21.15.27:0/734602462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06280bb2c0 0x7f06280b29b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0620009e90 tx=0x7f062000b040 comp rx=0 tx=0).stop 2023-10-06T02:59:59.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.371+0000 7f062d70d700 1 -- 172.21.15.27:0/734602462 shutdown_connections 2023-10-06T02:59:59.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.371+0000 7f062d70d700 1 --2- 172.21.15.27:0/734602462 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f06140605b0 0x7f0614062a60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.371+0000 7f062d70d700 1 --2- 172.21.15.27:0/734602462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06280bb2c0 0x7f06280b29b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.371+0000 7f062d70d700 1 --2- 172.21.15.27:0/734602462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06280b9c50 0x7f0628068550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.371+0000 7f062d70d700 1 --2- 172.21.15.27:0/734602462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06280a3550 0x7f062806abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.371+0000 7f062d70d700 1 -- 172.21.15.27:0/734602462 >> 172.21.15.27:0/734602462 conn(0x7f062806eb10 msgr2=0x7f062809f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.371+0000 7f062d70d700 1 -- 172.21.15.27:0/734602462 shutdown_connections 2023-10-06T02:59:59.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.371+0000 7f062d70d700 1 -- 172.21.15.27:0/734602462 wait complete. 2023-10-06T02:59:59.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.375+0000 7fb2be23f700 1 -- 172.21.15.27:0/4114383515 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb2b8069ae0 con 0x7fb2b8148540 2023-10-06T02:59:59.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.375+0000 7fb29f7fe700 1 -- 172.21.15.27:0/4114383515 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2b0025030 con 0x7fb2b8148540 2023-10-06T02:59:59.384 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2023-10-06T02:59:59.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fe6e50c1700 1 -- 172.21.15.27:0/45358201 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe6e009cef0 con 0x7fe6e009e3f0 2023-10-06T02:59:59.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fb29d7fa700 1 -- 172.21.15.27:0/4114383515 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb2a4060550 msgr2=0x7fb2a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fb29d7fa700 1 --2- 172.21.15.27:0/4114383515 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb2a4060550 0x7fb2a4062a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009ca0 tx=0x7fb2a8009250 comp rx=0 tx=0).stop 2023-10-06T02:59:59.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fb29d7fa700 1 -- 172.21.15.27:0/4114383515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b8148540 msgr2=0x7fb2b81403b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fb29d7fa700 1 --2- 172.21.15.27:0/4114383515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b8148540 0x7fb2b81403b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0017000 tx=0x7fb2b001a000 comp rx=0 tx=0).stop 2023-10-06T02:59:59.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fb29d7fa700 1 -- 172.21.15.27:0/4114383515 shutdown_connections 2023-10-06T02:59:59.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fb29d7fa700 1 --2- 172.21.15.27:0/4114383515 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb2a4060550 0x7fb2a4062a00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fb29d7fa700 1 --2- 172.21.15.27:0/4114383515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b8148540 0x7fb2b81403b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fb29d7fa700 1 --2- 172.21.15.27:0/4114383515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b8069f60 0x7fb2b813fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fb29d7fa700 1 --2- 172.21.15.27:0/4114383515 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2b8069710 0x7fb2b8148d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fb29d7fa700 1 -- 172.21.15.27:0/4114383515 >> 172.21.15.27:0/4114383515 conn(0x7fb2b80bb0e0 msgr2=0x7fb2b8144b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fb29d7fa700 1 -- 172.21.15.27:0/4114383515 shutdown_connections 2023-10-06T02:59:59.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fb29d7fa700 1 -- 172.21.15.27:0/4114383515 wait complete. 2023-10-06T02:59:59.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.383+0000 7fe6c7fff700 1 -- 172.21.15.27:0/45358201 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe6e009cef0 con 0x7fe6e009e3f0 2023-10-06T02:59:59.389 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2023-10-06T02:59:59.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-10-06T02:59:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.387+0000 7fe6e50c1700 1 -- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe6cc060620 msgr2=0x7fe6cc062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.387+0000 7fe6e50c1700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe6cc060620 0x7fe6cc062ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00a0690 tx=0x7fe6d8018000 comp rx=0 tx=0).stop 2023-10-06T02:59:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.387+0000 7fe6e50c1700 1 -- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6e009e3f0 msgr2=0x7fe6e015f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.387+0000 7fe6e50c1700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6e009e3f0 0x7fe6e015f5d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000c490 tx=0x7fe6d0007ea0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.387+0000 7fe6e50c1700 1 -- 172.21.15.27:0/45358201 shutdown_connections 2023-10-06T02:59:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.387+0000 7fe6e50c1700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe6cc060620 0x7fe6cc062ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.387+0000 7fe6e50c1700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6e014eb70 0x7fe6e009c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.387+0000 7fe6e50c1700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6e00a02a0 0x7fe6e0160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.387+0000 7fe6e50c1700 1 --2- 172.21.15.27:0/45358201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6e009e3f0 0x7fe6e015f5d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.387+0000 7fe6e50c1700 1 -- 172.21.15.27:0/45358201 >> 172.21.15.27:0/45358201 conn(0x7fe6e006e040 msgr2=0x7fe6e00bd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.387+0000 7fe6e50c1700 1 -- 172.21.15.27:0/45358201 shutdown_connections 2023-10-06T02:59:59.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.387+0000 7fe6e50c1700 1 -- 172.21.15.27:0/45358201 wait complete. 2023-10-06T02:59:59.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.391+0000 7f69e02a0700 1 -- 172.21.15.27:0/499123717 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f69c0005830 con 0x7f69d8068f20 2023-10-06T02:59:59.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.391+0000 7f69ce7fc700 1 -- 172.21.15.27:0/499123717 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69d402a020 con 0x7f69d8068f20 2023-10-06T02:59:59.397 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2023-10-06T02:59:59.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.395+0000 7f69e02a0700 1 -- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f69bc060550 msgr2=0x7f69bc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.395+0000 7f69e02a0700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f69bc060550 0x7f69bc062a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f69c8006fd0 tx=0x7f69c8008040 comp rx=0 tx=0).stop 2023-10-06T02:59:59.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.395+0000 7f69e02a0700 1 -- 172.21.15.27:0/499123717 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69d8068f20 msgr2=0x7f69d814ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.395+0000 7f69e02a0700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69d8068f20 0x7f69d814ebd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009290 tx=0x7f69d4016000 comp rx=0 tx=0).stop 2023-10-06T02:59:59.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.395+0000 7f69e02a0700 1 -- 172.21.15.27:0/499123717 shutdown_connections 2023-10-06T02:59:59.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.395+0000 7f69e02a0700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f69bc060550 0x7f69bc062a00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.395+0000 7f69e02a0700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69d814b9f0 0x7f69d81634c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.395+0000 7f69e02a0700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69d80b6ff0 0x7f69d8146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.395+0000 7f69e02a0700 1 --2- 172.21.15.27:0/499123717 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69d8068f20 0x7f69d814ebd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.395+0000 7f69e02a0700 1 -- 172.21.15.27:0/499123717 >> 172.21.15.27:0/499123717 conn(0x7f69d80bb0e0 msgr2=0x7f69d8146310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.395+0000 7f69e02a0700 1 -- 172.21.15.27:0/499123717 shutdown_connections 2023-10-06T02:59:59.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.395+0000 7f69e02a0700 1 -- 172.21.15.27:0/499123717 wait complete. 2023-10-06T02:59:59.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-06T02:59:59.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-06T02:59:59.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.407+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/393216240 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb9e4067d60 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.407+0000 7fb9cb7fe700 1 -- 172.21.15.27:0/393216240 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9dc051d10 con 0x7fb9e40bb7c0 2023-10-06T02:59:59.412 INFO:teuthology.orchestra.run.smithi027.stdout:55834574854 2023-10-06T02:59:59.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.407+0000 7fe9eb790700 1 -- 172.21.15.27:0/779205167 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe9c0005830 con 0x7fe9e406a8a0 2023-10-06T02:59:59.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.407+0000 7fe9d97fa700 1 -- 172.21.15.27:0/779205167 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9e004fe50 con 0x7fe9e406a8a0 2023-10-06T02:59:59.413 INFO:teuthology.orchestra.run.smithi027.stdout:55834574854 2023-10-06T02:59:59.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-10-06T02:59:59.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.407+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/393216240 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb9d0060580 msgr2=0x7fb9d0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.407+0000 7fb9e9c1f700 1 --2- 172.21.15.27:0/393216240 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb9d0060580 0x7fb9d0062a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80011e0 tx=0x7fb9d8001000 comp rx=0 tx=0).stop 2023-10-06T02:59:59.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.407+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/393216240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9e40bb7c0 msgr2=0x7fb9e4168770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.407+0000 7fb9e9c1f700 1 --2- 172.21.15.27:0/393216240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9e40bb7c0 0x7fb9e4168770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00b610 tx=0x7fb9dc017000 comp rx=0 tx=0).stop 2023-10-06T02:59:59.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/393216240 shutdown_connections 2023-10-06T02:59:59.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fb9e9c1f700 1 --2- 172.21.15.27:0/393216240 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb9d0060580 0x7fb9d0062a30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fb9e9c1f700 1 --2- 172.21.15.27:0/393216240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9e40bb7c0 0x7fb9e4168770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fb9e9c1f700 1 --2- 172.21.15.27:0/393216240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e40bb3f0 0x7fb9e41438e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fb9e9c1f700 1 --2- 172.21.15.27:0/393216240 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9e4068d60 0x7fb9e4147ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/393216240 >> 172.21.15.27:0/393216240 conn(0x7fb9e40c6e00 msgr2=0x7fb9e4148e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/393216240 shutdown_connections 2023-10-06T02:59:59.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fb9e9c1f700 1 -- 172.21.15.27:0/393216240 wait complete. 2023-10-06T02:59:59.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fe9eb790700 1 -- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe9c8060550 msgr2=0x7fe9c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fe9eb790700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe9c8060550 0x7fe9c8062a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe9e406ac90 tx=0x7fe9dc017000 comp rx=0 tx=0).stop 2023-10-06T02:59:59.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fe9eb790700 1 -- 172.21.15.27:0/779205167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e406a8a0 msgr2=0x7fe9e40a14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fe9eb790700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e406a8a0 0x7fe9e40a14b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000c5d0 tx=0x7fe9e0007f60 comp rx=0 tx=0).stop 2023-10-06T02:59:59.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fe9eb790700 1 -- 172.21.15.27:0/779205167 shutdown_connections 2023-10-06T02:59:59.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fe9eb790700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe9c8060550 0x7fe9c8062a00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fe9eb790700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e40a32f0 0x7fe9e414ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fe9eb790700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe9e409e6e0 0x7fe9e4162e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fe9eb790700 1 --2- 172.21.15.27:0/779205167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e406a8a0 0x7fe9e40a14b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fe9eb790700 1 -- 172.21.15.27:0/779205167 >> 172.21.15.27:0/779205167 conn(0x7fe9e40bb0e0 msgr2=0x7fe9e414e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fe9eb790700 1 -- 172.21.15.27:0/779205167 shutdown_connections 2023-10-06T02:59:59.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.411+0000 7fe9eb790700 1 -- 172.21.15.27:0/779205167 wait complete. 2023-10-06T02:59:59.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.415+0000 7f3d4f10a700 1 -- 172.21.15.27:0/1974041054 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3d480694f0 con 0x7f3d48143610 2023-10-06T02:59:59.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.415+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/1974041054 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d480694f0 con 0x7f3d48143610 2023-10-06T02:59:59.422 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2023-10-06T02:59:59.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f3d4f10a700 1 -- 172.21.15.27:0/1974041054 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3d2c060650 msgr2=0x7f3d2c062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f3d4f10a700 1 --2- 172.21.15.27:0/1974041054 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3d2c060650 0x7f3d2c062b00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d38001aa0 tx=0x7f3d38015000 comp rx=0 tx=0).stop 2023-10-06T02:59:59.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f3d4f10a700 1 -- 172.21.15.27:0/1974041054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d48143610 msgr2=0x7f3d48141610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f3d4f10a700 1 --2- 172.21.15.27:0/1974041054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d48143610 0x7f3d48141610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3d480704d0 tx=0x7f3d44008040 comp rx=0 tx=0).stop 2023-10-06T02:59:59.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f3d4f10a700 1 -- 172.21.15.27:0/1974041054 shutdown_connections 2023-10-06T02:59:59.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f3d4f10a700 1 --2- 172.21.15.27:0/1974041054 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3d2c060650 0x7f3d2c062b00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f3d4f10a700 1 --2- 172.21.15.27:0/1974041054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d48143610 0x7f3d48141610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f3d4f10a700 1 --2- 172.21.15.27:0/1974041054 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d4806b070 0x7f3d481430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f3d4f10a700 1 --2- 172.21.15.27:0/1974041054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d34003bf0 0x7f3d480697d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f3d4f10a700 1 -- 172.21.15.27:0/1974041054 >> 172.21.15.27:0/1974041054 conn(0x7f3d4806eb10 msgr2=0x7f3d480a2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f3d4f10a700 1 -- 172.21.15.27:0/1974041054 shutdown_connections 2023-10-06T02:59:59.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f3d4f10a700 1 -- 172.21.15.27:0/1974041054 wait complete. 2023-10-06T02:59:59.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f65c8955700 1 -- 172.21.15.27:0/269773198 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f65a8005560 con 0x7f65c4069570 2023-10-06T02:59:59.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.419+0000 7f65baffd700 1 -- 172.21.15.27:0/269773198 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f65ac029030 con 0x7f65c4069570 2023-10-06T02:59:59.426 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2023-10-06T02:59:59.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-10-06T02:59:59.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.423+0000 7f65c8955700 1 -- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f65a4060600 msgr2=0x7f65a4062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.423+0000 7f65c8955700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f65a4060600 0x7f65a4062ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f65c406c800 tx=0x7f65b4009250 comp rx=0 tx=0).stop 2023-10-06T02:59:59.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.423+0000 7f65c8955700 1 -- 172.21.15.27:0/269773198 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c4069570 msgr2=0x7f65c416c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.423+0000 7f65c8955700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c4069570 0x7f65c416c040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0093f0 tx=0x7f65ac016000 comp rx=0 tx=0).stop 2023-10-06T02:59:59.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.423+0000 7f65c8955700 1 -- 172.21.15.27:0/269773198 shutdown_connections 2023-10-06T02:59:59.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.423+0000 7f65c8955700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f65a4060600 0x7f65a4062ab0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.423+0000 7f65c8955700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65c414ed80 0x7f65c414e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.423+0000 7f65c8955700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65c406b1b0 0x7f65c4148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.423+0000 7f65c8955700 1 --2- 172.21.15.27:0/269773198 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c4069570 0x7f65c416c040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.423+0000 7f65c8955700 1 -- 172.21.15.27:0/269773198 >> 172.21.15.27:0/269773198 conn(0x7f65c40bdca0 msgr2=0x7f65c40be070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.423+0000 7f65c8955700 1 -- 172.21.15.27:0/269773198 shutdown_connections 2023-10-06T02:59:59.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T02:59:59.423+0000 7f65c8955700 1 -- 172.21.15.27:0/269773198 wait complete. 2023-10-06T02:59:59.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-10-06T02:59:59.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-10-06T02:59:59.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-10-06T03:00:00.243 INFO:tasks.ceph.mds.a.smithi027.stderr:2023-10-06T03:00:00.239+0000 7f8e2fdc6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:00:00.391 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T03:00:00.403 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T03:00:00.407 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T03:00:00.415 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T03:00:00.428 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T03:00:00.431 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T03:00:00.436 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T03:00:00.442 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T03:00:00.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe6a4a9700 1 Processor -- start 2023-10-06T03:00:00.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe6a4a9700 1 -- start start 2023-10-06T03:00:00.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe6a4a9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbe64069710 0x7fbe6406d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe6a4a9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe64148540 0x7fbe6406a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe6a4a9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6406a9a0 con 0x7fbe64069f60 2023-10-06T03:00:00.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe6a4a9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe64147910 con 0x7fbe64069710 2023-10-06T03:00:00.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe6a4a9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe64147600 con 0x7fbe64148540 2023-10-06T03:00:00.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe63fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbe64069710 0x7fbe6406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe63fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbe64069710 0x7fbe6406d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48868/0 (socket says 172.21.15.27:48868) 2023-10-06T03:00:00.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe63fff700 1 -- 172.21.15.27:0/3422033052 learned_addr learned my addr 172.21.15.27:0/3422033052 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:00.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe68a46700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe64148540 0x7fbe6406a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe68a46700 1 -- 172.21.15.27:0/3422033052 >> v2:172.21.15.27:3300/0 conn(0x7fbe64069710 msgr2=0x7fbe6406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:00.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe68a46700 1 --2- 172.21.15.27:0/3422033052 >> v2:172.21.15.27:3300/0 conn(0x7fbe64069710 0x7fbe6406d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe68a46700 1 -- 172.21.15.27:0/3422033052 >> v1:172.21.15.123:6789/0 conn(0x7fbe64069f60 legacy=0x7fbe64147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:00.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.527+0000 7fbe68a46700 1 -- 172.21.15.27:0/3422033052 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe640b3710 con 0x7fbe64148540 2023-10-06T03:00:00.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.531+0000 7fbe68a46700 1 --2- 172.21.15.27:0/3422033052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe64148540 0x7fbe6406a3b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbe640b4d60 tx=0x7fbe5800abc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1327aaca55dd5356 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.535+0000 7fbe62ffd700 1 -- 172.21.15.27:0/3422033052 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800f070 con 0x7fbe64148540 2023-10-06T03:00:00.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.535+0000 7fbe62ffd700 1 -- 172.21.15.27:0/3422033052 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe58008bf0 con 0x7fbe64148540 2023-10-06T03:00:00.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.535+0000 7fbe6a4a9700 1 -- 172.21.15.27:0/3422033052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe64148540 msgr2=0x7fbe6406a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.535+0000 7fbe6a4a9700 1 --2- 172.21.15.27:0/3422033052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe64148540 0x7fbe6406a3b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbe640b4d60 tx=0x7fbe5800abc0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.535+0000 7fbe6a4a9700 1 -- 172.21.15.27:0/3422033052 shutdown_connections 2023-10-06T03:00:00.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.535+0000 7fbe6a4a9700 1 --2- 172.21.15.27:0/3422033052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe64148540 0x7fbe6406a3b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.535+0000 7fbe6a4a9700 1 --2- 172.21.15.27:0/3422033052 >> v2:172.21.15.27:3300/0 conn(0x7fbe64069710 0x7fbe6406d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.535+0000 7fbe6a4a9700 1 -- 172.21.15.27:0/3422033052 >> 172.21.15.27:0/3422033052 conn(0x7fbe640bb0e0 msgr2=0x7fbe6406b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe6a4a9700 1 -- 172.21.15.27:0/3422033052 shutdown_connections 2023-10-06T03:00:00.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe6a4a9700 1 -- 172.21.15.27:0/3422033052 wait complete. 2023-10-06T03:00:00.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe6a4a9700 1 Processor -- start 2023-10-06T03:00:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe6a4a9700 1 -- start start 2023-10-06T03:00:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe6a4a9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbe64069710 0x7fbe64148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe6a4a9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe64069f60 0x7fbe640bcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe6a4a9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe640bd510 0x7fbe64145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe6a4a9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640bc9c0 con 0x7fbe64069f60 2023-10-06T03:00:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe6a4a9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640bc370 con 0x7fbe640bd510 2023-10-06T03:00:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe6a4a9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640bc650 con 0x7fbe64069710 2023-10-06T03:00:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe68a46700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe640bd510 0x7fbe64145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe68a46700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe640bd510 0x7fbe64145520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:54858/0 (socket says 172.21.15.27:54858) 2023-10-06T03:00:00.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe68a46700 1 -- 172.21.15.27:0/3332243779 learned_addr learned my addr 172.21.15.27:0/3332243779 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:00.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe637fe700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe64069f60 0x7fbe640bcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe63fff700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbe64069710 0x7fbe64148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe68a46700 1 -- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbe64069710 msgr2=0x7fbe64148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.543+0000 7fbe68a46700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbe64069710 0x7fbe64148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7fbe68a46700 1 -- 172.21.15.27:0/3332243779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe64069f60 msgr2=0x7fbe640bcfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7fbe68a46700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe64069f60 0x7fbe640bcfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7fbe68a46700 1 -- 172.21.15.27:0/3332243779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe64135f00 con 0x7fbe640bd510 2023-10-06T03:00:00.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7fbe637fe700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe64069f60 0x7fbe640bcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:00.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7fbe68a46700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe640bd510 0x7fbe64145520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe64147740 tx=0x7fbe58019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7fbe4bfff700 1 -- 172.21.15.27:0/3332243779 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe580079c0 con 0x7fbe640bd510 2023-10-06T03:00:00.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7fbe6a4a9700 1 -- 172.21.15.27:0/3332243779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe64145f80 con 0x7fbe640bd510 2023-10-06T03:00:00.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7fbe6a4a9700 1 -- 172.21.15.27:0/3332243779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe64149220 con 0x7fbe640bd510 2023-10-06T03:00:00.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7fbe4bfff700 1 -- 172.21.15.27:0/3332243779 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe58007b40 con 0x7fbe640bd510 2023-10-06T03:00:00.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7fbe4bfff700 1 -- 172.21.15.27:0/3332243779 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58008040 con 0x7fbe640bd510 2023-10-06T03:00:00.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7f6d84943700 1 Processor -- start 2023-10-06T03:00:00.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7f6d84943700 1 -- start start 2023-10-06T03:00:00.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7f6d84943700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6d800b9470 0x7f6d8006c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7f6d84943700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d800b99e0 0x7f6d8009dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7f6d84943700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d800ba1d0 con 0x7f6d8009ffd0 2023-10-06T03:00:00.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7f6d84943700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d80148210 con 0x7f6d800b9470 2023-10-06T03:00:00.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7f6d84943700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d800b9ef0 con 0x7f6d800b99e0 2023-10-06T03:00:00.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7f6d7e59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6d8009ffd0 0x7f6d8006b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44520/0 (socket says 172.21.15.27:44520) 2023-10-06T03:00:00.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7f6d7e59c700 1 -- 172.21.15.27:0/892463361 learned_addr learned my addr 172.21.15.27:0/892463361 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:00.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7fbe4bfff700 1 -- 172.21.15.27:0/3332243779 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbe580081a0 con 0x7fbe640bd510 2023-10-06T03:00:00.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7fbe4bfff700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fbe500606a0 0x7fbe50062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7fbe4bfff700 1 -- 172.21.15.27:0/3332243779 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbe5807d760 con 0x7fbe640bd510 2023-10-06T03:00:00.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.547+0000 7f6d7dd9b700 1 --2- 172.21.15.27:0/892463361 >> v2:172.21.15.27:3300/0 conn(0x7f6d800b9470 0x7f6d8006c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432836824 0 0) 0x7f6d800ba1d0 con 0x7f6d8009ffd0 2023-10-06T03:00:00.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d68004680 con 0x7f6d8009ffd0 2023-10-06T03:00:00.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7fbe63fff700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fbe500606a0 0x7fbe50062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3010430607 0 0) 0x7f6d68004680 con 0x7f6d8009ffd0 2023-10-06T03:00:00.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d800b99e0 msgr2=0x7f6d8009dab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:00:00.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 --2- 172.21.15.27:0/892463361 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d800b99e0 0x7f6d8009dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 >> v2:172.21.15.27:3300/0 conn(0x7f6d800b9470 msgr2=0x7f6d8006c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:00.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 --2- 172.21.15.27:0/892463361 >> v2:172.21.15.27:3300/0 conn(0x7f6d800b9470 0x7f6d8006c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8006c550 con 0x7f6d8009ffd0 2023-10-06T03:00:00.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1323929577 0 0) 0x7f6d78004ea0 con 0x7f6d8009ffd0 2023-10-06T03:00:00.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 >> v1:172.21.15.27:6789/0 conn(0x7f6d8009ffd0 legacy=0x7f6d8006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 --2- 172.21.15.27:0/892463361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d68004bf0 0x7f6d68005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 --2- 172.21.15.27:0/892463361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d68005920 0x7f6d68005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 --2- 172.21.15.27:0/892463361 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d680063f0 0x7f6d6800cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d80148210 con 0x7f6d68004bf0 2023-10-06T03:00:00.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d800b9ef0 con 0x7f6d68005920 2023-10-06T03:00:00.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6800d2c0 con 0x7f6d680063f0 2023-10-06T03:00:00.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7dd9b700 1 --2- 172.21.15.27:0/892463361 >> v2:172.21.15.27:3300/0 conn(0x7f6d800b9470 0x7f6d8006c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:00.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7e59c700 1 --2- 172.21.15.27:0/892463361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d68004bf0 0x7f6d68005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7dd9b700 1 --2- 172.21.15.27:0/892463361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d68005920 0x7f6d68005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7e59c700 1 -- 172.21.15.27:0/892463361 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d680063f0 msgr2=0x7f6d6800cb70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:00:00.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7e59c700 1 --2- 172.21.15.27:0/892463361 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d680063f0 0x7f6d6800cb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7e59c700 1 -- 172.21.15.27:0/892463361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d68005920 msgr2=0x7f6d68005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:00.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7e59c700 1 --2- 172.21.15.27:0/892463361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d68005920 0x7f6d68005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7e59c700 1 -- 172.21.15.27:0/892463361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8006c550 con 0x7f6d68004bf0 2023-10-06T03:00:00.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7e59c700 1 --2- 172.21.15.27:0/892463361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d68004bf0 0x7f6d68005000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d78001910 tx=0x7f6d78008990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd06b14ab0abc1d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78008cc0 con 0x7f6d68004bf0 2023-10-06T03:00:00.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d78008110 con 0x7f6d68004bf0 2023-10-06T03:00:00.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7f6d7d59a700 1 -- 172.21.15.27:0/892463361 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78006530 con 0x7f6d68004bf0 2023-10-06T03:00:00.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.551+0000 7fbe63fff700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fbe500606a0 0x7fbe50062b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00f570 tx=0x7fbe5c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f6d84943700 1 -- 172.21.15.27:0/892463361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d68004bf0 msgr2=0x7f6d68005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f6d84943700 1 --2- 172.21.15.27:0/892463361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d68004bf0 0x7f6d68005000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d78001910 tx=0x7f6d78008990 comp rx=0 tx=0).stop 2023-10-06T03:00:00.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f6d7ed9d700 1 -- 172.21.15.27:0/892463361 reap_dead start 2023-10-06T03:00:00.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f6d84943700 1 -- 172.21.15.27:0/892463361 shutdown_connections 2023-10-06T03:00:00.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f6d84943700 1 -- 172.21.15.27:0/892463361 >> 172.21.15.27:0/892463361 conn(0x7f6d800ba560 msgr2=0x7f6d800ba960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f6d84943700 1 -- 172.21.15.27:0/892463361 shutdown_connections 2023-10-06T03:00:00.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f6d84943700 1 -- 172.21.15.27:0/892463361 wait complete. 2023-10-06T03:00:00.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7fbe6a4a9700 1 -- 172.21.15.27:0/3332243779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe64067800 con 0x7fbe640bd510 2023-10-06T03:00:00.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f366ca9f700 1 Processor -- start 2023-10-06T03:00:00.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f366ca9f700 1 -- start start 2023-10-06T03:00:00.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f6d84943700 1 Processor -- start 2023-10-06T03:00:00.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f366ca9f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f366814eb70 0x7f366809fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f366ca9f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36680a02a0 0x7f366814ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f366ca9f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366809f5a0 con 0x7f366809e3f0 2023-10-06T03:00:00.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f366ca9f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366814f880 con 0x7f366814eb70 2023-10-06T03:00:00.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f366ca9f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366814f5a0 con 0x7f36680a02a0 2023-10-06T03:00:00.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f6d84943700 1 -- start start 2023-10-06T03:00:00.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f36677fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f366814eb70 0x7f366809fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f3667fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f366809e3f0 0x7f366806b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.27:49770/0 (socket says 172.21.15.27:49770) 2023-10-06T03:00:00.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f3667fff700 1 -- 172.21.15.27:0/2766376300 learned_addr learned my addr 172.21.15.27:0/2766376300 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:00.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.555+0000 7f3666ffd700 1 --2- 172.21.15.27:0/2766376300 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36680a02a0 0x7f366814ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f36677fe700 1 -- 172.21.15.27:0/2766376300 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36680a02a0 msgr2=0x7f366814ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:00.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f36677fe700 1 --2- 172.21.15.27:0/2766376300 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36680a02a0 0x7f366814ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f36677fe700 1 -- 172.21.15.27:0/2766376300 >> v1:172.21.15.123:6789/0 conn(0x7f366809e3f0 legacy=0x7f366806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d84943700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d68004bf0 0x7f6d80068680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d84943700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d800a3590 0x7f6d80146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d84943700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d8014eab0 0x7f6d80146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d84943700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d800a1bb0 con 0x7f6d8014eab0 2023-10-06T03:00:00.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d84943700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8014e620 con 0x7f6d68004bf0 2023-10-06T03:00:00.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d84943700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d80068bc0 con 0x7f6d800a3590 2023-10-06T03:00:00.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f36677fe700 1 -- 172.21.15.27:0/2766376300 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366806d020 con 0x7f366814eb70 2023-10-06T03:00:00.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d7ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d8014eab0 0x7f6d80146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d7ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d8014eab0 0x7f6d80146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48910/0 (socket says 172.21.15.27:48910) 2023-10-06T03:00:00.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d7ed9d700 1 -- 172.21.15.27:0/3607905530 learned_addr learned my addr 172.21.15.27:0/3607905530 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:00.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d7e59c700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d68004bf0 0x7f6d80068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d7dd9b700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d800a3590 0x7f6d80146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f36677fe700 1 --2- 172.21.15.27:0/2766376300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f366814eb70 0x7f366809fa30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3660009e60 tx=0x7f3660009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54d3174809eff06b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d7ed9d700 1 -- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d800a3590 msgr2=0x7f6d80146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d7ed9d700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d800a3590 0x7f6d80146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d7ed9d700 1 -- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d68004bf0 msgr2=0x7f6d80068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d7ed9d700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d68004bf0 0x7f6d80068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d7ed9d700 1 -- 172.21.15.27:0/3607905530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d801470b0 con 0x7f6d8014eab0 2023-10-06T03:00:00.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d7ed9d700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d8014eab0 0x7f6d80146b70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6d800b8f10 tx=0x7f6d74002be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d6e7fc700 1 -- 172.21.15.27:0/3607905530 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7400acc0 con 0x7f6d8014eab0 2023-10-06T03:00:00.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d84943700 1 -- 172.21.15.27:0/3607905530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d800a1de0 con 0x7f6d8014eab0 2023-10-06T03:00:00.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d84943700 1 -- 172.21.15.27:0/3607905530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d800a22d0 con 0x7f6d8014eab0 2023-10-06T03:00:00.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d6e7fc700 1 -- 172.21.15.27:0/3607905530 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7400ae60 con 0x7f6d8014eab0 2023-10-06T03:00:00.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d6e7fc700 1 -- 172.21.15.27:0/3607905530 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d74017430 con 0x7f6d8014eab0 2023-10-06T03:00:00.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.559+0000 7f6d6e7fc700 1 -- 172.21.15.27:0/3607905530 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6d74013020 con 0x7f6d8014eab0 2023-10-06T03:00:00.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.563+0000 7f6d6e7fc700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d60060580 0x7f6d60062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.563+0000 7f6d6e7fc700 1 -- 172.21.15.27:0/3607905530 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6d7407c420 con 0x7f6d8014eab0 2023-10-06T03:00:00.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.563+0000 7f6d7e59c700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d60060580 0x7f6d60062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.563+0000 7f6d7e59c700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d60060580 0x7f6d60062a30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6d780089d0 tx=0x7f6d78016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f36667fc700 1 -- 172.21.15.27:0/2766376300 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366000e070 con 0x7f366814eb70 2023-10-06T03:00:00.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f36667fc700 1 -- 172.21.15.27:0/2766376300 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366000bb60 con 0x7f366814eb70 2023-10-06T03:00:00.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f36667fc700 1 -- 172.21.15.27:0/2766376300 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660012430 con 0x7f366814eb70 2023-10-06T03:00:00.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7fbe4bfff700 1 -- 172.21.15.27:0/3332243779 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbe5804dbd0 con 0x7fbe640bd510 2023-10-06T03:00:00.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f6d84943700 1 -- 172.21.15.27:0/3607905530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d640052b0 con 0x7f6d8014eab0 2023-10-06T03:00:00.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f366ca9f700 1 -- 172.21.15.27:0/2766376300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f366814eb70 msgr2=0x7f366809fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f366ca9f700 1 --2- 172.21.15.27:0/2766376300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f366814eb70 0x7f366809fa30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3660009e60 tx=0x7f3660009780 comp rx=0 tx=0).stop 2023-10-06T03:00:00.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f366ca9f700 1 -- 172.21.15.27:0/2766376300 shutdown_connections 2023-10-06T03:00:00.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f366ca9f700 1 --2- 172.21.15.27:0/2766376300 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36680a02a0 0x7f366814ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f366ca9f700 1 --2- 172.21.15.27:0/2766376300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f366814eb70 0x7f366809fa30 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3660009e60 tx=0x7f3660009780 comp rx=0 tx=0).stop 2023-10-06T03:00:00.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f366ca9f700 1 -- 172.21.15.27:0/2766376300 >> 172.21.15.27:0/2766376300 conn(0x7f366806e040 msgr2=0x7f366806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f366ca9f700 1 -- 172.21.15.27:0/2766376300 shutdown_connections 2023-10-06T03:00:00.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f366ca9f700 1 -- 172.21.15.27:0/2766376300 wait complete. 2023-10-06T03:00:00.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f366ca9f700 1 Processor -- start 2023-10-06T03:00:00.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.567+0000 7f366ca9f700 1 -- start start 2023-10-06T03:00:00.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f366ca9f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f366809e3f0 0x7f36681684f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f366ca9f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36680a02a0 0x7f3668098420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f366ca9f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366809aa60 0x7f3668096a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f366ca9f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36680ba0c0 con 0x7f366809aa60 2023-10-06T03:00:00.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f366ca9f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366809c930 con 0x7f366809e3f0 2023-10-06T03:00:00.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f366ca9f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3668168a30 con 0x7f36680a02a0 2023-10-06T03:00:00.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f3667fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366809aa60 0x7f3668096a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f3667fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366809aa60 0x7f3668096a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48922/0 (socket says 172.21.15.27:48922) 2023-10-06T03:00:00.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f3667fff700 1 -- 172.21.15.27:0/3069530064 learned_addr learned my addr 172.21.15.27:0/3069530064 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:00.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f36677fe700 1 --2- 172.21.15.27:0/3069530064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f366809e3f0 0x7f36681684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f3667fff700 1 -- 172.21.15.27:0/3069530064 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36680a02a0 msgr2=0x7f3668098420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f3667fff700 1 --2- 172.21.15.27:0/3069530064 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36680a02a0 0x7f3668098420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f3667fff700 1 -- 172.21.15.27:0/3069530064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f366809e3f0 msgr2=0x7f36681684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f3667fff700 1 --2- 172.21.15.27:0/3069530064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f366809e3f0 0x7f36681684f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f3667fff700 1 -- 172.21.15.27:0/3069530064 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3660009a20 con 0x7f366809aa60 2023-10-06T03:00:00.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.571+0000 7f3667fff700 1 --2- 172.21.15.27:0/3069530064 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366809aa60 0x7f3668096a40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f365800c7f0 tx=0x7f3658007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.575+0000 7f6d6e7fc700 1 -- 172.21.15.27:0/3607905530 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6d7401c020 con 0x7f6d8014eab0 2023-10-06T03:00:00.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.579+0000 7f364f7fe700 1 -- 172.21.15.27:0/3069530064 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3658005b30 con 0x7f366809aa60 2023-10-06T03:00:00.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.579+0000 7f364f7fe700 1 -- 172.21.15.27:0/3069530064 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3658005cb0 con 0x7f366809aa60 2023-10-06T03:00:00.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.579+0000 7f364f7fe700 1 -- 172.21.15.27:0/3069530064 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3658007320 con 0x7f366809aa60 2023-10-06T03:00:00.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.583+0000 7f366ca9f700 1 -- 172.21.15.27:0/3069530064 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366809c2e0 con 0x7f366809aa60 2023-10-06T03:00:00.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.583+0000 7f366ca9f700 1 -- 172.21.15.27:0/3069530064 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366809cdc0 con 0x7f366809aa60 2023-10-06T03:00:00.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.583+0000 7f364f7fe700 1 -- 172.21.15.27:0/3069530064 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3658007690 con 0x7f366809aa60 2023-10-06T03:00:00.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.583+0000 7f364f7fe700 1 --2- 172.21.15.27:0/3069530064 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f36500606d0 0x7f3650062b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.583+0000 7f364f7fe700 1 -- 172.21.15.27:0/3069530064 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f365807bdc0 con 0x7f366809aa60 2023-10-06T03:00:00.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.583+0000 7f36677fe700 1 --2- 172.21.15.27:0/3069530064 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f36500606d0 0x7f3650062b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.583+0000 7f366ca9f700 1 -- 172.21.15.27:0/3069530064 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3668067790 con 0x7f366809aa60 2023-10-06T03:00:00.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7fb84b59e700 1 Processor -- start 2023-10-06T03:00:00.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7f36677fe700 1 --2- 172.21.15.27:0/3069530064 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f36500606d0 0x7f3650062b80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36680bb710 tx=0x7f3660019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7fb84b59e700 1 -- start start 2023-10-06T03:00:00.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7fb84b59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb84c0bb2c0 0x7fb84c0ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7fb84b59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84c09ef80 con 0x7fb84c0a3550 2023-10-06T03:00:00.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7fb84b59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84c0a39d0 con 0x7fb84c0b9c50 2023-10-06T03:00:00.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7fb84b59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84c0a0f20 con 0x7fb84c0bb2c0 2023-10-06T03:00:00.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7fb849d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb84c0bb2c0 0x7fb84c0ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7fb849d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb84c0bb2c0 0x7fb84c0ba020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48930/0 (socket says 172.21.15.27:48930) 2023-10-06T03:00:00.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7fb849d9b700 1 -- 172.21.15.27:0/282783617 learned_addr learned my addr 172.21.15.27:0/282783617 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:00.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7fb849d9b700 1 -- 172.21.15.27:0/282783617 >> v1:172.21.15.123:6789/0 conn(0x7fb84c0b9c50 legacy=0x7fb84c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7fb849d9b700 1 -- 172.21.15.27:0/282783617 >> v1:172.21.15.27:6789/0 conn(0x7fb84c0a3550 legacy=0x7fb84c09f410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:00:00.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7fb849d9b700 1 -- 172.21.15.27:0/282783617 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c0a2c50 con 0x7fb84c0bb2c0 2023-10-06T03:00:00.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.587+0000 7fb849d9b700 1 --2- 172.21.15.27:0/282783617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb84c0bb2c0 0x7fb84c0ba020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb84401aea0 tx=0x7fb84401a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1293cf4701fd127 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.591+0000 7f9f565eb700 1 Processor -- start 2023-10-06T03:00:00.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.591+0000 7f9f565eb700 1 -- start start 2023-10-06T03:00:00.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.591+0000 7f5073dc4700 1 Processor -- start 2023-10-06T03:00:00.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.591+0000 7f9f565eb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9f500a0260 0x7f9f5006cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5073dc4700 1 -- start start 2023-10-06T03:00:00.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.591+0000 7f9f565eb700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f500a3090 0x7f9f500a34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.591+0000 7f9f565eb700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f500a3a00 con 0x7f9f5014eae0 2023-10-06T03:00:00.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.591+0000 7f9f565eb700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f500ba380 con 0x7f9f500a0260 2023-10-06T03:00:00.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.591+0000 7f9f565eb700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5006c2c0 con 0x7f9f500a3090 2023-10-06T03:00:00.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.591+0000 7f9f54de8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9f500a0260 0x7f9f5006cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f54de8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9f500a0260 0x7f9f5006cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48946/0 (socket says 172.21.15.27:48946) 2023-10-06T03:00:00.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f54de8700 1 -- 172.21.15.27:0/3788191203 learned_addr learned my addr 172.21.15.27:0/3788191203 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:00.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f54de8700 1 -- 172.21.15.27:0/3788191203 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f500a3090 msgr2=0x7f9f500a34c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:00:00.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f54de8700 1 --2- 172.21.15.27:0/3788191203 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f500a3090 0x7f9f500a34c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f54de8700 1 -- 172.21.15.27:0/3788191203 >> v1:172.21.15.123:6789/0 conn(0x7f9f5014eae0 legacy=0x7f9f5014eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f54de8700 1 -- 172.21.15.27:0/3788191203 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5006c560 con 0x7f9f500a0260 2023-10-06T03:00:00.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f364f7fe700 1 -- 172.21.15.27:0/3069530064 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f365804c250 con 0x7f366809aa60 2023-10-06T03:00:00.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7fb84959a700 1 -- 172.21.15.27:0/282783617 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84401f070 con 0x7fb84c0bb2c0 2023-10-06T03:00:00.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7fb84959a700 1 -- 172.21.15.27:0/282783617 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84401c980 con 0x7fb84c0bb2c0 2023-10-06T03:00:00.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f54de8700 1 --2- 172.21.15.27:0/3788191203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f500a0260 0x7f9f5006cd60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009f20 tx=0x7f9f48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f1f79129a47081 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5073dc4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f506c14ed80 0x7f506c14f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5073dc4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f506c06b1b0 0x7f506c06c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5073dc4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c069090 con 0x7f506c069570 2023-10-06T03:00:00.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5073dc4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c06aa90 con 0x7f506c06b1b0 2023-10-06T03:00:00.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5073dc4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c14f840 con 0x7f506c14ed80 2023-10-06T03:00:00.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f507135f700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f506c069570 0x7f506c06b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.27:49786/0 (socket says 172.21.15.27:49786) 2023-10-06T03:00:00.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5072361700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f506c06b1b0 0x7f506c06c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5072361700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f506c06b1b0 0x7f506c06c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:54888/0 (socket says 172.21.15.27:54888) 2023-10-06T03:00:00.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5072361700 1 -- 172.21.15.27:0/2931712284 learned_addr learned my addr 172.21.15.27:0/2931712284 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:00.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5072361700 1 -- 172.21.15.27:0/2931712284 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f506c14ed80 msgr2=0x7f506c14f150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:00:00.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5072361700 1 --2- 172.21.15.27:0/2931712284 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f506c14ed80 0x7f506c14f150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5072361700 1 -- 172.21.15.27:0/2931712284 >> v1:172.21.15.123:6789/0 conn(0x7f506c069570 legacy=0x7f506c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5072361700 1 -- 172.21.15.27:0/2931712284 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c14fb20 con 0x7f506c06b1b0 2023-10-06T03:00:00.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7fb84b59e700 1 -- 172.21.15.27:0/282783617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb84c0bb2c0 msgr2=0x7fb84c0ba020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7fb84b59e700 1 --2- 172.21.15.27:0/282783617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb84c0bb2c0 0x7fb84c0ba020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb84401aea0 tx=0x7fb84401a840 comp rx=0 tx=0).stop 2023-10-06T03:00:00.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5072361700 1 --2- 172.21.15.27:0/2931712284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c06b1b0 0x7f506c06c010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f50680099b0 tx=0x7f5068009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b578004edce509d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f47fff700 1 -- 172.21.15.27:0/3788191203 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4800e070 con 0x7f9f500a0260 2023-10-06T03:00:00.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f47fff700 1 -- 172.21.15.27:0/3788191203 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4800ba80 con 0x7f9f500a0260 2023-10-06T03:00:00.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f47fff700 1 -- 172.21.15.27:0/3788191203 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f480092e0 con 0x7f9f500a0260 2023-10-06T03:00:00.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7fb84b59e700 1 -- 172.21.15.27:0/282783617 shutdown_connections 2023-10-06T03:00:00.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7fb84b59e700 1 --2- 172.21.15.27:0/282783617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb84c0bb2c0 0x7fb84c0ba020 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7fb84b59e700 1 -- 172.21.15.27:0/282783617 >> 172.21.15.27:0/282783617 conn(0x7fb84c06eb10 msgr2=0x7fb84c0ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5070b5e700 1 -- 172.21.15.27:0/2931712284 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506800b860 con 0x7f506c06b1b0 2023-10-06T03:00:00.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f565eb700 1 -- 172.21.15.27:0/3788191203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f500a0260 msgr2=0x7f9f5006cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f565eb700 1 --2- 172.21.15.27:0/3788191203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f500a0260 0x7f9f5006cd60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009f20 tx=0x7f9f48009840 comp rx=0 tx=0).stop 2023-10-06T03:00:00.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5070b5e700 1 -- 172.21.15.27:0/2931712284 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506800b9c0 con 0x7f506c06b1b0 2023-10-06T03:00:00.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5070b5e700 1 -- 172.21.15.27:0/2931712284 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506800bd60 con 0x7f506c06b1b0 2023-10-06T03:00:00.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5073dc4700 1 -- 172.21.15.27:0/2931712284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c06b1b0 msgr2=0x7f506c06c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f5073dc4700 1 --2- 172.21.15.27:0/2931712284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c06b1b0 0x7f506c06c010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f50680099b0 tx=0x7f5068009250 comp rx=0 tx=0).stop 2023-10-06T03:00:00.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f565eb700 1 -- 172.21.15.27:0/3788191203 shutdown_connections 2023-10-06T03:00:00.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f565eb700 1 --2- 172.21.15.27:0/3788191203 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f500a3090 0x7f9f500a34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f565eb700 1 --2- 172.21.15.27:0/3788191203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f500a0260 0x7f9f5006cd60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f565eb700 1 -- 172.21.15.27:0/3788191203 >> 172.21.15.27:0/3788191203 conn(0x7f9f5006e040 msgr2=0x7f9f5006e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7fb84b59e700 1 -- 172.21.15.27:0/282783617 shutdown_connections 2023-10-06T03:00:00.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f565eb700 1 -- 172.21.15.27:0/3788191203 shutdown_connections 2023-10-06T03:00:00.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7f9f565eb700 1 -- 172.21.15.27:0/3788191203 wait complete. 2023-10-06T03:00:00.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.595+0000 7fb84b59e700 1 -- 172.21.15.27:0/282783617 wait complete. 2023-10-06T03:00:00.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f565eb700 1 Processor -- start 2023-10-06T03:00:00.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84b59e700 1 Processor -- start 2023-10-06T03:00:00.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84b59e700 1 -- start start 2023-10-06T03:00:00.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f565eb700 1 -- start start 2023-10-06T03:00:00.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f565eb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f500a0260 0x7f9f500bcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f565eb700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f500a3090 0x7f9f5015e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f565eb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f5014eae0 0x7f9f50069a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f565eb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500b3480 con 0x7f9f5014eae0 2023-10-06T03:00:00.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f565eb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500b8f00 con 0x7f9f500a0260 2023-10-06T03:00:00.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f565eb700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5006afb0 con 0x7f9f500a3090 2023-10-06T03:00:00.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84b59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb84c0a3550 0x7fb84c14ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb84c0b9c50 0x7fb84c14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84b59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb84c0bb2c0 0x7fb84c14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84b59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c0b4ac0 con 0x7fb84c0bb2c0 2023-10-06T03:00:00.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84b59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c14cc40 con 0x7fb84c0b9c50 2023-10-06T03:00:00.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84b59e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c15a480 con 0x7fb84c0a3550 2023-10-06T03:00:00.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f55dea700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f5014eae0 0x7f9f50069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f555e9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f500a0260 0x7f9f500bcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f555e9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f500a0260 0x7f9f500bcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:54896/0 (socket says 172.21.15.27:54896) 2023-10-06T03:00:00.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f55dea700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f5014eae0 0x7f9f50069a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48948/0 (socket says 172.21.15.27:48948) 2023-10-06T03:00:00.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f555e9700 1 -- 172.21.15.27:0/3032121621 learned_addr learned my addr 172.21.15.27:0/3032121621 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:00.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84a59c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb84c0a3550 0x7fb84c14ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f54de8700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f500a3090 0x7f9f5015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb849d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb84c0b9c50 0x7fb84c14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84a59c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb84c0a3550 0x7fb84c14ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.27:54084/0 (socket says 172.21.15.27:54084) 2023-10-06T03:00:00.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84a59c700 1 -- 172.21.15.27:0/3127353308 learned_addr learned my addr 172.21.15.27:0/3127353308 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:00.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84ad9d700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb84c0bb2c0 0x7fb84c14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f54de8700 1 -- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f500a0260 msgr2=0x7f9f500bcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f54de8700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f500a0260 0x7f9f500bcd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f54de8700 1 -- 172.21.15.27:0/3032121621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f5014eae0 msgr2=0x7f9f50069a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f54de8700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f5014eae0 0x7f9f50069a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f54de8700 1 -- 172.21.15.27:0/3032121621 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f48009ae0 con 0x7f9f500a3090 2023-10-06T03:00:00.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7f9f55dea700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f5014eae0 0x7f9f50069a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:00.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84a59c700 1 -- 172.21.15.27:0/3127353308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb84c0b9c50 msgr2=0x7fb84c14d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84a59c700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb84c0b9c50 0x7fb84c14d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.599+0000 7fb84a59c700 1 -- 172.21.15.27:0/3127353308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb84c0bb2c0 msgr2=0x7fb84c14d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7fb84a59c700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb84c0bb2c0 0x7fb84c14d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7fb84a59c700 1 -- 172.21.15.27:0/3127353308 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84401aae0 con 0x7fb84c0a3550 2023-10-06T03:00:00.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7f9f54de8700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f500a3090 0x7f9f5015e610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f48015000 tx=0x7f9f48018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7fb84ad9d700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb84c0bb2c0 0x7fb84c14d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:00.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7fb84a59c700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb84c0a3550 0x7fb84c14ad50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00c840 tx=0x7fb83c007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7f9f457fa700 1 -- 172.21.15.27:0/3032121621 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48008a80 con 0x7f9f500a3090 2023-10-06T03:00:00.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7f9f565eb700 1 -- 172.21.15.27:0/3032121621 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f500bd2c0 con 0x7f9f500a3090 2023-10-06T03:00:00.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7f9f565eb700 1 -- 172.21.15.27:0/3032121621 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5015eb50 con 0x7f9f500a3090 2023-10-06T03:00:00.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7fb83a7fc700 1 -- 172.21.15.27:0/3127353308 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c011590 con 0x7fb84c0a3550 2023-10-06T03:00:00.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7fb83a7fc700 1 -- 172.21.15.27:0/3127353308 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c011710 con 0x7fb84c0a3550 2023-10-06T03:00:00.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7fb83a7fc700 1 -- 172.21.15.27:0/3127353308 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c011ad0 con 0x7fb84c0a3550 2023-10-06T03:00:00.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7fb84b59e700 1 -- 172.21.15.27:0/3127353308 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84c14ec00 con 0x7fb84c0a3550 2023-10-06T03:00:00.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7fb84b59e700 1 -- 172.21.15.27:0/3127353308 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84c158310 con 0x7fb84c0a3550 2023-10-06T03:00:00.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7f9f457fa700 1 -- 172.21.15.27:0/3032121621 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f48009940 con 0x7f9f500a3090 2023-10-06T03:00:00.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7f9f565eb700 1 -- 172.21.15.27:0/3032121621 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f300052b0 con 0x7f9f500a3090 2023-10-06T03:00:00.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7f9f457fa700 1 -- 172.21.15.27:0/3032121621 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48008a80 con 0x7f9f500a3090 2023-10-06T03:00:00.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.603+0000 7fb84b59e700 1 -- 172.21.15.27:0/3127353308 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84c0b99b0 con 0x7fb84c0a3550 2023-10-06T03:00:00.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 -- 172.21.15.27:0/2931712284 shutdown_connections 2023-10-06T03:00:00.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 --2- 172.21.15.27:0/2931712284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c06b1b0 0x7f506c06c010 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 --2- 172.21.15.27:0/2931712284 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f506c14ed80 0x7f506c14f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 -- 172.21.15.27:0/2931712284 >> 172.21.15.27:0/2931712284 conn(0x7f506c0bdca0 msgr2=0x7f506c0be0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7fb83a7fc700 1 -- 172.21.15.27:0/3127353308 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb83c01b3b0 con 0x7fb84c0a3550 2023-10-06T03:00:00.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7fb83a7fc700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb82c060650 0x7fb82c062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7fb83a7fc700 1 -- 172.21.15.27:0/3127353308 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb83c07bf00 con 0x7fb84c0a3550 2023-10-06T03:00:00.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7fb849d9b700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb82c060650 0x7fb82c062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 -- 172.21.15.27:0/2931712284 shutdown_connections 2023-10-06T03:00:00.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 -- 172.21.15.27:0/2931712284 wait complete. 2023-10-06T03:00:00.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 Processor -- start 2023-10-06T03:00:00.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f6d5759e700 1 Processor -- start 2023-10-06T03:00:00.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f6d5759e700 1 -- start start 2023-10-06T03:00:00.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 -- start start 2023-10-06T03:00:00.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f6d5759e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d5809f7a0 0x7f6d5809fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7fb849d9b700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb82c060650 0x7fb82c062b00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb84401a880 tx=0x7fb844027000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f6d5759e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d58149fc0 con 0x7f6d5806c6b0 2023-10-06T03:00:00.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f6d5759e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d58149970 con 0x7f6d5806b1d0 2023-10-06T03:00:00.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f6d5759e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580a3120 con 0x7f6d5809f7a0 2023-10-06T03:00:00.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f6d55d9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6d5806c6b0 0x7f6d58148990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44536/0 (socket says 172.21.15.27:44536) 2023-10-06T03:00:00.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f6d55d9b700 1 -- 172.21.15.27:0/3803009367 learned_addr learned my addr 172.21.15.27:0/3803009367 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:00.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f6d5659c700 1 --2- 172.21.15.27:0/3803009367 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d5809f7a0 0x7f6d5809fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c069570 0x7f506c0aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f506c06b1b0 0x7f506c0b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f506c14ed80 0x7f506c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0aa5b0 con 0x7f506c14ed80 2023-10-06T03:00:00.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0aaf80 con 0x7f506c069570 2023-10-06T03:00:00.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5073dc4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c15fcc0 con 0x7f506c06b1b0 2023-10-06T03:00:00.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5072361700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f506c14ed80 0x7f506c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f6d5659c700 1 -- 172.21.15.27:0/3803009367 >> v1:172.21.15.123:6789/0 conn(0x7f6d5806b1d0 legacy=0x7f6d581490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f6d5659c700 1 -- 172.21.15.27:0/3803009367 >> v1:172.21.15.27:6789/0 conn(0x7f6d5806c6b0 legacy=0x7f6d58148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f6d5659c700 1 -- 172.21.15.27:0/3803009367 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58149c50 con 0x7f6d5809f7a0 2023-10-06T03:00:00.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5072361700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f506c14ed80 0x7f506c0b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48970/0 (socket says 172.21.15.27:48970) 2023-10-06T03:00:00.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5071b60700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c069570 0x7f506c0aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5072361700 1 -- 172.21.15.27:0/3437857024 learned_addr learned my addr 172.21.15.27:0/3437857024 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:00.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f6d5659c700 1 --2- 172.21.15.27:0/3803009367 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d5809f7a0 0x7f6d5809fb70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009910 tx=0x7f6d480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0296ff2a046357c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f9f457fa700 1 -- 172.21.15.27:0/3032121621 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9f48003040 con 0x7f9f500a3090 2023-10-06T03:00:00.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.611+0000 7f9f457fa700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9f340605b0 0x7f9f34062a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.611+0000 7f9f457fa700 1 -- 172.21.15.27:0/3032121621 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9f4807e320 con 0x7f9f500a3090 2023-10-06T03:00:00.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5072361700 1 -- 172.21.15.27:0/3437857024 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f506c06b1b0 msgr2=0x7f506c0b5d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:00:00.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5072361700 1 --2- 172.21.15.27:0/3437857024 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f506c06b1b0 0x7f506c0b5d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5072361700 1 -- 172.21.15.27:0/3437857024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c069570 msgr2=0x7f506c0aaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5072361700 1 --2- 172.21.15.27:0/3437857024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c069570 0x7f506c0aaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.607+0000 7f5072361700 1 -- 172.21.15.27:0/3437857024 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50680094f0 con 0x7f506c14ed80 2023-10-06T03:00:00.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.611+0000 7f5072361700 1 --2- 172.21.15.27:0/3437857024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f506c14ed80 0x7f506c0b6260 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f506c0b8470 tx=0x7f5068017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.611+0000 7f9f555e9700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9f340605b0 0x7f9f34062a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.611+0000 7f9f555e9700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9f340605b0 0x7f9f34062a60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0078a0 tx=0x7f9f4c007830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.611+0000 7f9f457fa700 1 -- 172.21.15.27:0/3032121621 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9f4804e830 con 0x7f9f500a3090 2023-10-06T03:00:00.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.615+0000 7fb83a7fc700 1 -- 172.21.15.27:0/3127353308 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb84c0b99b0 con 0x7fb84c0a3550 2023-10-06T03:00:00.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.615+0000 7f5061ffb700 1 -- 172.21.15.27:0/3437857024 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068006bc0 con 0x7f506c14ed80 2023-10-06T03:00:00.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.615+0000 7f6d5559a700 1 -- 172.21.15.27:0/3803009367 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48009eb0 con 0x7f6d5809f7a0 2023-10-06T03:00:00.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.615+0000 7f6d5559a700 1 -- 172.21.15.27:0/3803009367 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4800b760 con 0x7f6d5809f7a0 2023-10-06T03:00:00.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.615+0000 7f5073dc4700 1 -- 172.21.15.27:0/3437857024 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c0aa240 con 0x7f506c14ed80 2023-10-06T03:00:00.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.615+0000 7f5073dc4700 1 -- 172.21.15.27:0/3437857024 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c0a8c70 con 0x7f506c14ed80 2023-10-06T03:00:00.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.615+0000 7f5061ffb700 1 -- 172.21.15.27:0/3437857024 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506801a630 con 0x7f506c14ed80 2023-10-06T03:00:00.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.615+0000 7f5061ffb700 1 -- 172.21.15.27:0/3437857024 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506801a9d0 con 0x7f506c14ed80 2023-10-06T03:00:00.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.619+0000 7f6d5759e700 1 -- 172.21.15.27:0/3803009367 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d5809f7a0 msgr2=0x7f6d5809fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.619+0000 7f6d5759e700 1 --2- 172.21.15.27:0/3803009367 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d5809f7a0 0x7f6d5809fb70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009910 tx=0x7f6d480091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.619+0000 7f6d5759e700 1 -- 172.21.15.27:0/3803009367 shutdown_connections 2023-10-06T03:00:00.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.619+0000 7f6d5759e700 1 --2- 172.21.15.27:0/3803009367 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d5809f7a0 0x7f6d5809fb70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.619+0000 7f6d5759e700 1 -- 172.21.15.27:0/3803009367 >> 172.21.15.27:0/3803009367 conn(0x7f6d5806e040 msgr2=0x7f6d5806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d5759e700 1 -- 172.21.15.27:0/3803009367 shutdown_connections 2023-10-06T03:00:00.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d5759e700 1 -- 172.21.15.27:0/3803009367 wait complete. 2023-10-06T03:00:00.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d5759e700 1 Processor -- start 2023-10-06T03:00:00.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f8780646700 1 Processor -- start 2023-10-06T03:00:00.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f8780646700 1 -- start start 2023-10-06T03:00:00.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f8780646700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f877806bef0 0x7f87780686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f8780646700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f877806c2c0 0x7f8778148090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f8780646700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f877814b790 0x7f87781485d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f8780646700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8778068c10 con 0x7f877806c2c0 2023-10-06T03:00:00.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f8780646700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877814bc70 con 0x7f877814b790 2023-10-06T03:00:00.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f8780646700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8778147890 con 0x7f877806bef0 2023-10-06T03:00:00.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d5759e700 1 -- start start 2023-10-06T03:00:00.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f877ebe3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f877814b790 0x7f87781485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f877ebe3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f877814b790 0x7f87781485d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:54918/0 (socket says 172.21.15.27:54918) 2023-10-06T03:00:00.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f877ebe3700 1 -- 172.21.15.27:0/2252582612 learned_addr learned my addr 172.21.15.27:0/2252582612 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:00.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f877ebe3700 1 -- 172.21.15.27:0/2252582612 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f877806bef0 msgr2=0x7f87780686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:00.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f877ebe3700 1 --2- 172.21.15.27:0/2252582612 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f877806bef0 0x7f87780686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f877ebe3700 1 -- 172.21.15.27:0/2252582612 >> v2:172.21.15.27:3300/0 conn(0x7f877806c2c0 msgr2=0x7f8778148090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:00:00.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f877ebe3700 1 --2- 172.21.15.27:0/2252582612 >> v2:172.21.15.27:3300/0 conn(0x7f877806c2c0 0x7f8778148090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f877ebe3700 1 -- 172.21.15.27:0/2252582612 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778147b70 con 0x7f877814b790 2023-10-06T03:00:00.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d5759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d5806b1d0 0x7f6d58142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d5759e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d5806c6b0 0x7f6d58148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d5759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d580bac60 0x7f6d58148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d5759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58167bf0 con 0x7f6d5806b1d0 2023-10-06T03:00:00.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d5759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580bb380 con 0x7f6d580bac60 2023-10-06T03:00:00.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d5759e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58143460 con 0x7f6d5806c6b0 2023-10-06T03:00:00.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f877ebe3700 1 --2- 172.21.15.27:0/2252582612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f877814b790 0x7f87781485d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f877806d7d0 tx=0x7f8770007690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dd0a2e4a1ab07e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d55d9b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d5806c6b0 0x7f6d58148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d55d9b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d5806c6b0 0x7f6d58148a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.27:54112/0 (socket says 172.21.15.27:54112) 2023-10-06T03:00:00.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d55d9b700 1 -- 172.21.15.27:0/1564838129 learned_addr learned my addr 172.21.15.27:0/1564838129 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:00.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d56d9d700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d580bac60 0x7f6d58148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d5659c700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d5806b1d0 0x7f6d58142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d55d9b700 1 -- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d580bac60 msgr2=0x7f6d58148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d55d9b700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d580bac60 0x7f6d58148f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d55d9b700 1 -- 172.21.15.27:0/1564838129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d5806b1d0 msgr2=0x7f6d58142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d55d9b700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d5806b1d0 0x7f6d58142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.623+0000 7f6d55d9b700 1 -- 172.21.15.27:0/1564838129 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d48009420 con 0x7f6d5806c6b0 2023-10-06T03:00:00.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.627+0000 7f6d55d9b700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d5806c6b0 0x7f6d58148a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000cdb0 tx=0x7f6d50001b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.627+0000 7f5073dc4700 1 -- 172.21.15.27:0/3437857024 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504c0052b0 con 0x7f506c14ed80 2023-10-06T03:00:00.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.631+0000 7f5061ffb700 1 -- 172.21.15.27:0/3437857024 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f506801ad40 con 0x7f506c14ed80 2023-10-06T03:00:00.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.631+0000 7f5061ffb700 1 --2- 172.21.15.27:0/3437857024 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f50500606a0 0x7f5050062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.631+0000 7f5061ffb700 1 -- 172.21.15.27:0/3437857024 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f506807e290 con 0x7f506c14ed80 2023-10-06T03:00:00.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.631+0000 7f5071b60700 1 --2- 172.21.15.27:0/3437857024 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f50500606a0 0x7f5050062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.631+0000 7f5071b60700 1 --2- 172.21.15.27:0/3437857024 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f50500606a0 0x7f5050062b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5064007600 tx=0x7f5064009780 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f877d3e0700 1 -- 172.21.15.27:0/2252582612 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877000de90 con 0x7f877814b790 2023-10-06T03:00:00.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f877d3e0700 1 -- 172.21.15.27:0/2252582612 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8770007b40 con 0x7f877814b790 2023-10-06T03:00:00.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f877d3e0700 1 -- 172.21.15.27:0/2252582612 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700124d0 con 0x7f877814b790 2023-10-06T03:00:00.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f8780646700 1 -- 172.21.15.27:0/2252582612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f877814b790 msgr2=0x7f87781485d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f8780646700 1 --2- 172.21.15.27:0/2252582612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f877814b790 0x7f87781485d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f877806d7d0 tx=0x7f8770007690 comp rx=0 tx=0).stop 2023-10-06T03:00:00.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f8780646700 1 -- 172.21.15.27:0/2252582612 shutdown_connections 2023-10-06T03:00:00.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f8780646700 1 --2- 172.21.15.27:0/2252582612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f877814b790 0x7f87781485d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f8780646700 1 --2- 172.21.15.27:0/2252582612 >> v2:172.21.15.27:3300/0 conn(0x7f877806c2c0 0x7f8778148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f8780646700 1 --2- 172.21.15.27:0/2252582612 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f877806bef0 0x7f87780686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f8780646700 1 -- 172.21.15.27:0/2252582612 >> 172.21.15.27:0/2252582612 conn(0x7f87780bdca0 msgr2=0x7f87780be0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f6d467fc700 1 -- 172.21.15.27:0/1564838129 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5000aa40 con 0x7f6d5806c6b0 2023-10-06T03:00:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f6d467fc700 1 -- 172.21.15.27:0/1564838129 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5000aba0 con 0x7f6d5806c6b0 2023-10-06T03:00:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f6d467fc700 1 -- 172.21.15.27:0/1564838129 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500070f0 con 0x7f6d5806c6b0 2023-10-06T03:00:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f8780646700 1 -- 172.21.15.27:0/2252582612 shutdown_connections 2023-10-06T03:00:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f5061ffb700 1 -- 172.21.15.27:0/3437857024 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f506804e780 con 0x7f506c14ed80 2023-10-06T03:00:00.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f8780646700 1 -- 172.21.15.27:0/2252582612 wait complete. 2023-10-06T03:00:00.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f8780646700 1 Processor -- start 2023-10-06T03:00:00.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.635+0000 7f8780646700 1 -- start start 2023-10-06T03:00:00.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f8780646700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f877806bef0 0x7f87781411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f8780646700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f877806c2c0 0x7f877815fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f8780646700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f877814b790 0x7f87780b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f8780646700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877815f7d0 con 0x7f877806bef0 2023-10-06T03:00:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f8780646700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8778141710 con 0x7f877814b790 2023-10-06T03:00:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f8780646700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877815f180 con 0x7f877806c2c0 2023-10-06T03:00:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f877dbe1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f877806c2c0 0x7f877815fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f877ebe3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f877814b790 0x7f87780b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f877dbe1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f877806c2c0 0x7f877815fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.27:54118/0 (socket says 172.21.15.27:54118) 2023-10-06T03:00:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f877dbe1700 1 -- 172.21.15.27:0/2236228073 learned_addr learned my addr 172.21.15.27:0/2236228073 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f877e3e2700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f877806bef0 0x7f87781411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f877dbe1700 1 -- 172.21.15.27:0/2236228073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f877814b790 msgr2=0x7f87780b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f877dbe1700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f877814b790 0x7f87780b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f877dbe1700 1 -- 172.21.15.27:0/2236228073 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f877806bef0 msgr2=0x7f87781411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f877dbe1700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f877806bef0 0x7f87781411d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f877dbe1700 1 -- 172.21.15.27:0/2236228073 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877000be70 con 0x7f877806c2c0 2023-10-06T03:00:00.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f6d5759e700 1 -- 172.21.15.27:0/1564838129 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d581445c0 con 0x7f6d5806c6b0 2023-10-06T03:00:00.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f6d5759e700 1 -- 172.21.15.27:0/1564838129 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5814b7e0 con 0x7f6d5806c6b0 2023-10-06T03:00:00.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f877e3e2700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f877806bef0 0x7f87781411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:00.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.639+0000 7f877dbe1700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f877806c2c0 0x7f877815fc60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f876800b810 tx=0x7f87680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.643+0000 7f6d467fc700 1 -- 172.21.15.27:0/1564838129 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6d50007520 con 0x7f6d5806c6b0 2023-10-06T03:00:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.643+0000 7f6d467fc700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d38060620 0x7f6d38062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.643+0000 7f6d467fc700 1 -- 172.21.15.27:0/1564838129 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6d5007cc60 con 0x7f6d5806c6b0 2023-10-06T03:00:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.643+0000 7f6d5659c700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d38060620 0x7f6d38062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.643+0000 7f6d5659c700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d38060620 0x7f6d38062ad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009860 tx=0x7f6d48017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.647+0000 7f876e7fc700 1 -- 172.21.15.27:0/2236228073 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876800f510 con 0x7f877806c2c0 2023-10-06T03:00:00.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.647+0000 7f876e7fc700 1 -- 172.21.15.27:0/2236228073 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876800f670 con 0x7f877806c2c0 2023-10-06T03:00:00.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.647+0000 7f876e7fc700 1 -- 172.21.15.27:0/2236228073 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876800f9f0 con 0x7f877806c2c0 2023-10-06T03:00:00.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.647+0000 7f8780646700 1 -- 172.21.15.27:0/2236228073 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877815f460 con 0x7f877806c2c0 2023-10-06T03:00:00.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.647+0000 7f8780646700 1 -- 172.21.15.27:0/2236228073 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8778142d40 con 0x7f877806c2c0 2023-10-06T03:00:00.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.647+0000 7f876e7fc700 1 -- 172.21.15.27:0/2236228073 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f876801a400 con 0x7f877806c2c0 2023-10-06T03:00:00.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.647+0000 7f876e7fc700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8764060800 0x7f8764062cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.647+0000 7f876e7fc700 1 -- 172.21.15.27:0/2236228073 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f876807c220 con 0x7f877806c2c0 2023-10-06T03:00:00.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.647+0000 7f877e3e2700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8764060800 0x7f8764062cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.651+0000 7f6d5759e700 1 -- 172.21.15.27:0/1564838129 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d58167d60 con 0x7f6d5806c6b0 2023-10-06T03:00:00.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.651+0000 7f877e3e2700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8764060800 0x7f8764062cb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8774009fd0 tx=0x7f87740091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.655+0000 7f8780646700 1 -- 172.21.15.27:0/2236228073 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87600052b0 con 0x7f877806c2c0 2023-10-06T03:00:00.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.663+0000 7f6d467fc700 1 -- 172.21.15.27:0/1564838129 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6d58167d60 con 0x7f6d5806c6b0 2023-10-06T03:00:00.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.675+0000 7f876e7fc700 1 -- 172.21.15.27:0/2236228073 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f876804c690 con 0x7f877806c2c0 2023-10-06T03:00:00.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.875+0000 7fbe6a4a9700 1 -- 172.21.15.27:0/3332243779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbe640bcc80 con 0x7fbe640bd510 2023-10-06T03:00:00.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.879+0000 7fbe4bfff700 1 -- 172.21.15.27:0/3332243779 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe5802b090 con 0x7fbe640bd510 2023-10-06T03:00:00.885 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2023-10-06T03:00:00.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.879+0000 7f366ca9f700 1 -- 172.21.15.27:0/3069530064 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f366809ca70 con 0x7f366809aa60 2023-10-06T03:00:00.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.879+0000 7f364f7fe700 1 -- 172.21.15.27:0/3069530064 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3658017020 con 0x7f366809aa60 2023-10-06T03:00:00.886 INFO:teuthology.orchestra.run.smithi027.stdout:55834574854 2023-10-06T03:00:00.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7fbe49ffb700 1 -- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fbe500606a0 msgr2=0x7fbe50062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7fbe49ffb700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fbe500606a0 0x7fbe50062b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00f570 tx=0x7fbe5c00b040 comp rx=0 tx=0).stop 2023-10-06T03:00:00.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7fbe49ffb700 1 -- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe640bd510 msgr2=0x7fbe64145520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7fbe49ffb700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe640bd510 0x7fbe64145520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe64147740 tx=0x7fbe58019000 comp rx=0 tx=0).stop 2023-10-06T03:00:00.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7fbe49ffb700 1 -- 172.21.15.27:0/3332243779 shutdown_connections 2023-10-06T03:00:00.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7fbe49ffb700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fbe500606a0 0x7fbe50062b50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7fbe49ffb700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe640bd510 0x7fbe64145520 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7fbe49ffb700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe64069f60 0x7fbe640bcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7fbe49ffb700 1 --2- 172.21.15.27:0/3332243779 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbe64069710 0x7fbe64148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7fbe49ffb700 1 -- 172.21.15.27:0/3332243779 >> 172.21.15.27:0/3332243779 conn(0x7fbe640bb0e0 msgr2=0x7fbe64142ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f6d84943700 1 -- 172.21.15.27:0/3607905530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6d64005830 con 0x7f6d8014eab0 2023-10-06T03:00:00.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7fbe49ffb700 1 -- 172.21.15.27:0/3332243779 shutdown_connections 2023-10-06T03:00:00.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7fbe49ffb700 1 -- 172.21.15.27:0/3332243779 wait complete. 2023-10-06T03:00:00.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f6d6e7fc700 1 -- 172.21.15.27:0/3607905530 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d7404c8d0 con 0x7f6d8014eab0 2023-10-06T03:00:00.891 INFO:teuthology.orchestra.run.smithi027.stdout:55834574854 2023-10-06T03:00:00.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f364d7fa700 1 -- 172.21.15.27:0/3069530064 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f36500606d0 msgr2=0x7f3650062b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f364d7fa700 1 --2- 172.21.15.27:0/3069530064 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f36500606d0 0x7f3650062b80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36680bb710 tx=0x7f3660019000 comp rx=0 tx=0).stop 2023-10-06T03:00:00.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.891+0000 7f6d84943700 1 -- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d60060580 msgr2=0x7f6d60062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.891+0000 7f6d84943700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d60060580 0x7f6d60062a30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6d780089d0 tx=0x7f6d78016000 comp rx=0 tx=0).stop 2023-10-06T03:00:00.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.891+0000 7f6d84943700 1 -- 172.21.15.27:0/3607905530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d8014eab0 msgr2=0x7f6d80146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.891+0000 7f6d84943700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d8014eab0 0x7f6d80146b70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6d800b8f10 tx=0x7f6d74002be0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.891+0000 7f6d84943700 1 -- 172.21.15.27:0/3607905530 shutdown_connections 2023-10-06T03:00:00.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f364d7fa700 1 -- 172.21.15.27:0/3069530064 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366809aa60 msgr2=0x7f3668096a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f364d7fa700 1 --2- 172.21.15.27:0/3069530064 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366809aa60 0x7f3668096a40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f365800c7f0 tx=0x7f3658007eb0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f364d7fa700 1 -- 172.21.15.27:0/3069530064 shutdown_connections 2023-10-06T03:00:00.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f364d7fa700 1 --2- 172.21.15.27:0/3069530064 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f36500606d0 0x7f3650062b80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f364d7fa700 1 --2- 172.21.15.27:0/3069530064 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366809aa60 0x7f3668096a40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.891+0000 7f6d84943700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d60060580 0x7f6d60062a30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f364d7fa700 1 --2- 172.21.15.27:0/3069530064 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36680a02a0 0x7f3668098420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f364d7fa700 1 --2- 172.21.15.27:0/3069530064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f366809e3f0 0x7f36681684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f364d7fa700 1 -- 172.21.15.27:0/3069530064 >> 172.21.15.27:0/3069530064 conn(0x7f366806e040 msgr2=0x7f366814bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f364d7fa700 1 -- 172.21.15.27:0/3069530064 shutdown_connections 2023-10-06T03:00:00.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.883+0000 7f364d7fa700 1 -- 172.21.15.27:0/3069530064 wait complete. 2023-10-06T03:00:00.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.891+0000 7f6d84943700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d8014eab0 0x7f6d80146b70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.891+0000 7f6d84943700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d800a3590 0x7f6d80146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.891+0000 7f6d84943700 1 --2- 172.21.15.27:0/3607905530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d68004bf0 0x7f6d80068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.891+0000 7f6d84943700 1 -- 172.21.15.27:0/3607905530 >> 172.21.15.27:0/3607905530 conn(0x7f6d800ba560 msgr2=0x7f6d800b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.891+0000 7f6d84943700 1 -- 172.21.15.27:0/3607905530 shutdown_connections 2023-10-06T03:00:00.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.891+0000 7f6d84943700 1 -- 172.21.15.27:0/3607905530 wait complete. 2023-10-06T03:00:00.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-10-06T03:00:00.903 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:00.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-06T03:00:00.908 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:00.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.903+0000 7f9f565eb700 1 -- 172.21.15.27:0/3032121621 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9f30005830 con 0x7f9f500a3090 2023-10-06T03:00:00.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.903+0000 7f9f457fa700 1 -- 172.21.15.27:0/3032121621 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f48051e50 con 0x7f9f500a3090 2023-10-06T03:00:00.910 INFO:teuthology.orchestra.run.smithi027.stdout:55834574856 2023-10-06T03:00:00.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.907+0000 7f9f565eb700 1 -- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9f340605b0 msgr2=0x7f9f34062a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.907+0000 7f9f565eb700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9f340605b0 0x7f9f34062a60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0078a0 tx=0x7f9f4c007830 comp rx=0 tx=0).stop 2023-10-06T03:00:00.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.907+0000 7f9f565eb700 1 -- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f500a3090 msgr2=0x7f9f5015e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.907+0000 7f9f565eb700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f500a3090 0x7f9f5015e610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f48015000 tx=0x7f9f48018000 comp rx=0 tx=0).stop 2023-10-06T03:00:00.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.907+0000 7f9f565eb700 1 -- 172.21.15.27:0/3032121621 shutdown_connections 2023-10-06T03:00:00.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.907+0000 7f9f565eb700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9f340605b0 0x7f9f34062a60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.907+0000 7f9f565eb700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f5014eae0 0x7f9f50069a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.907+0000 7f9f565eb700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f500a3090 0x7f9f5015e610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.907+0000 7f9f565eb700 1 --2- 172.21.15.27:0/3032121621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f500a0260 0x7f9f500bcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.907+0000 7f9f565eb700 1 -- 172.21.15.27:0/3032121621 >> 172.21.15.27:0/3032121621 conn(0x7f9f5006e040 msgr2=0x7f9f500ba4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.907+0000 7f9f565eb700 1 -- 172.21.15.27:0/3032121621 shutdown_connections 2023-10-06T03:00:00.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.907+0000 7f9f565eb700 1 -- 172.21.15.27:0/3032121621 wait complete. 2023-10-06T03:00:00.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-06T03:00:00.916 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:00.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-10-06T03:00:00.923 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:00.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.919+0000 7fb84b59e700 1 -- 172.21.15.27:0/3127353308 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb84c0b99b0 con 0x7fb84c0a3550 2023-10-06T03:00:00.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.919+0000 7fb83a7fc700 1 -- 172.21.15.27:0/3127353308 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb84c0b99b0 con 0x7fb84c0a3550 2023-10-06T03:00:00.924 INFO:teuthology.orchestra.run.smithi027.stdout:55834574856 2023-10-06T03:00:00.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.919+0000 7fb84b59e700 1 -- 172.21.15.27:0/3127353308 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb82c060650 msgr2=0x7fb82c062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.919+0000 7fb84b59e700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb82c060650 0x7fb82c062b00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb84401a880 tx=0x7fb844027000 comp rx=0 tx=0).stop 2023-10-06T03:00:00.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.919+0000 7fb84b59e700 1 -- 172.21.15.27:0/3127353308 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb84c0a3550 msgr2=0x7fb84c14ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.919+0000 7fb84b59e700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb84c0a3550 0x7fb84c14ad50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00c840 tx=0x7fb83c007f30 comp rx=0 tx=0).stop 2023-10-06T03:00:00.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.919+0000 7fb84b59e700 1 -- 172.21.15.27:0/3127353308 shutdown_connections 2023-10-06T03:00:00.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.919+0000 7fb84b59e700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb82c060650 0x7fb82c062b00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.919+0000 7fb84b59e700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb84c0bb2c0 0x7fb84c14d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.919+0000 7fb84b59e700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb84c0b9c50 0x7fb84c14d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.919+0000 7fb84b59e700 1 --2- 172.21.15.27:0/3127353308 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb84c0a3550 0x7fb84c14ad50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.919+0000 7fb84b59e700 1 -- 172.21.15.27:0/3127353308 >> 172.21.15.27:0/3127353308 conn(0x7fb84c06eb10 msgr2=0x7fb84c09f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.923+0000 7fb84b59e700 1 -- 172.21.15.27:0/3127353308 shutdown_connections 2023-10-06T03:00:00.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.923+0000 7fb84b59e700 1 -- 172.21.15.27:0/3127353308 wait complete. 2023-10-06T03:00:00.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-10-06T03:00:00.936 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.939+0000 7f6d5759e700 1 -- 172.21.15.27:0/1564838129 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6d58167d60 con 0x7f6d5806c6b0 2023-10-06T03:00:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.939+0000 7f6d467fc700 1 -- 172.21.15.27:0/1564838129 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d58167d60 con 0x7f6d5806c6b0 2023-10-06T03:00:00.945 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2023-10-06T03:00:00.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.939+0000 7f6d5759e700 1 -- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d38060620 msgr2=0x7f6d38062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.939+0000 7f6d5759e700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d38060620 0x7f6d38062ad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009860 tx=0x7f6d48017000 comp rx=0 tx=0).stop 2023-10-06T03:00:00.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.943+0000 7f6d5759e700 1 -- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d5806c6b0 msgr2=0x7f6d58148a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.943+0000 7f6d5759e700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d5806c6b0 0x7f6d58148a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000cdb0 tx=0x7f6d50001b00 comp rx=0 tx=0).stop 2023-10-06T03:00:00.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.943+0000 7f6d5759e700 1 -- 172.21.15.27:0/1564838129 shutdown_connections 2023-10-06T03:00:00.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.943+0000 7f6d5759e700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d38060620 0x7f6d38062ad0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.943+0000 7f6d5759e700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d580bac60 0x7f6d58148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.943+0000 7f6d5759e700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d5806c6b0 0x7f6d58148a30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.943+0000 7f6d5759e700 1 --2- 172.21.15.27:0/1564838129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d5806b1d0 0x7f6d58142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.943+0000 7f6d5759e700 1 -- 172.21.15.27:0/1564838129 >> 172.21.15.27:0/1564838129 conn(0x7f6d5806e040 msgr2=0x7f6d58068c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.943+0000 7f6d5759e700 1 -- 172.21.15.27:0/1564838129 shutdown_connections 2023-10-06T03:00:00.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.943+0000 7f6d5759e700 1 -- 172.21.15.27:0/1564838129 wait complete. 2023-10-06T03:00:00.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-10-06T03:00:00.956 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:00.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5073dc4700 1 -- 172.21.15.27:0/3437857024 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f504c005830 con 0x7f506c14ed80 2023-10-06T03:00:00.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5061ffb700 1 -- 172.21.15.27:0/3437857024 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5068015020 con 0x7f506c14ed80 2023-10-06T03:00:00.959 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2023-10-06T03:00:00.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5073dc4700 1 -- 172.21.15.27:0/3437857024 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f50500606a0 msgr2=0x7f5050062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5073dc4700 1 --2- 172.21.15.27:0/3437857024 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f50500606a0 0x7f5050062b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5064007600 tx=0x7f5064009780 comp rx=0 tx=0).stop 2023-10-06T03:00:00.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5073dc4700 1 -- 172.21.15.27:0/3437857024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f506c14ed80 msgr2=0x7f506c0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5073dc4700 1 --2- 172.21.15.27:0/3437857024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f506c14ed80 0x7f506c0b6260 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f506c0b8470 tx=0x7f5068017000 comp rx=0 tx=0).stop 2023-10-06T03:00:00.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5073dc4700 1 -- 172.21.15.27:0/3437857024 shutdown_connections 2023-10-06T03:00:00.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5073dc4700 1 --2- 172.21.15.27:0/3437857024 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f50500606a0 0x7f5050062b50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5073dc4700 1 --2- 172.21.15.27:0/3437857024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f506c14ed80 0x7f506c0b6260 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5073dc4700 1 --2- 172.21.15.27:0/3437857024 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f506c06b1b0 0x7f506c0b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5073dc4700 1 --2- 172.21.15.27:0/3437857024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c069570 0x7f506c0aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5073dc4700 1 -- 172.21.15.27:0/3437857024 >> 172.21.15.27:0/3437857024 conn(0x7f506c0bdca0 msgr2=0x7f506c14bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5073dc4700 1 -- 172.21.15.27:0/3437857024 shutdown_connections 2023-10-06T03:00:00.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.955+0000 7f5073dc4700 1 -- 172.21.15.27:0/3437857024 wait complete. 2023-10-06T03:00:00.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.967+0000 7f8780646700 1 -- 172.21.15.27:0/2236228073 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8760005560 con 0x7f877806c2c0 2023-10-06T03:00:00.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.967+0000 7f876e7fc700 1 -- 172.21.15.27:0/2236228073 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f876804fcb0 con 0x7f877806c2c0 2023-10-06T03:00:00.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-10-06T03:00:00.974 INFO:teuthology.orchestra.run.smithi027.stdout:55834574856 2023-10-06T03:00:00.974 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:00.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.971+0000 7f8780646700 1 -- 172.21.15.27:0/2236228073 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8764060800 msgr2=0x7f8764062cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.971+0000 7f8780646700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8764060800 0x7f8764062cb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8774009fd0 tx=0x7f87740091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.971+0000 7f8780646700 1 -- 172.21.15.27:0/2236228073 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f877806c2c0 msgr2=0x7f877815fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.971+0000 7f8780646700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f877806c2c0 0x7f877815fc60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f876800b810 tx=0x7f87680091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.971+0000 7f8780646700 1 -- 172.21.15.27:0/2236228073 shutdown_connections 2023-10-06T03:00:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.971+0000 7f8780646700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8764060800 0x7f8764062cb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.971+0000 7f8780646700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f877814b790 0x7f87780b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.971+0000 7f8780646700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f877806c2c0 0x7f877815fc60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.971+0000 7f8780646700 1 --2- 172.21.15.27:0/2236228073 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f877806bef0 0x7f87781411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.971+0000 7f8780646700 1 -- 172.21.15.27:0/2236228073 >> 172.21.15.27:0/2236228073 conn(0x7f87780bdca0 msgr2=0x7f877814ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.971+0000 7f8780646700 1 -- 172.21.15.27:0/2236228073 shutdown_connections 2023-10-06T03:00:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:00.971+0000 7f8780646700 1 -- 172.21.15.27:0/2236228073 wait complete. 2023-10-06T03:00:00.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-10-06T03:00:00.985 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:00.986 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:00:00.986 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:00:01.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 Processor -- start 2023-10-06T03:00:01.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 -- start start 2023-10-06T03:00:01.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7eff180bf550 0x7eff18148470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7eff180babe0 0x7eff181489b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7eff1806a400 0x7eff180b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1814b530 con 0x7eff1806a400 2023-10-06T03:00:01.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff18069f60 con 0x7eff180babe0 2023-10-06T03:00:01.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1806aa80 con 0x7eff180bf550 2023-10-06T03:00:01.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1e49d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7eff1806a400 0x7eff180b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1e49d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7eff1806a400 0x7eff180b3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48986/0 (socket says 172.21.15.27:48986) 2023-10-06T03:00:01.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1e49d700 1 -- 172.21.15.27:0/480345315 learned_addr learned my addr 172.21.15.27:0/480345315 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:01.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1dc9c700 1 --2- 172.21.15.27:0/480345315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7eff180bf550 0x7eff18148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1d49b700 1 --2- 172.21.15.27:0/480345315 >> v2:172.21.15.123:3300/0 conn(0x7eff180babe0 0x7eff181489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1e49d700 1 -- 172.21.15.27:0/480345315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7eff180bf550 msgr2=0x7eff18148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:01.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1e49d700 1 --2- 172.21.15.27:0/480345315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7eff180bf550 0x7eff18148470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1e49d700 1 -- 172.21.15.27:0/480345315 >> v2:172.21.15.123:3300/0 conn(0x7eff180babe0 msgr2=0x7eff181489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:01.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1e49d700 1 --2- 172.21.15.27:0/480345315 >> v2:172.21.15.123:3300/0 conn(0x7eff180babe0 0x7eff181489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1e49d700 1 -- 172.21.15.27:0/480345315 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff180bb160 con 0x7eff1806a400 2023-10-06T03:00:01.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1e49d700 1 --2- 172.21.15.27:0/480345315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff1806a400 0x7eff180b3c10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7eff1806b190 tx=0x7eff10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea19b798d47c6ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1cc9a700 1 -- 172.21.15.27:0/480345315 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000e070 con 0x7eff1806a400 2023-10-06T03:00:01.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1cc9a700 1 -- 172.21.15.27:0/480345315 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1000ba50 con 0x7eff1806a400 2023-10-06T03:00:01.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1cc9a700 1 -- 172.21.15.27:0/480345315 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100092e0 con 0x7eff1806a400 2023-10-06T03:00:01.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 -- 172.21.15.27:0/480345315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff1806a400 msgr2=0x7eff180b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 --2- 172.21.15.27:0/480345315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff1806a400 0x7eff180b3c10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7eff1806b190 tx=0x7eff10009840 comp rx=0 tx=0).stop 2023-10-06T03:00:01.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 -- 172.21.15.27:0/480345315 shutdown_connections 2023-10-06T03:00:01.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 --2- 172.21.15.27:0/480345315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff1806a400 0x7eff180b3c10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 --2- 172.21.15.27:0/480345315 >> v2:172.21.15.123:3300/0 conn(0x7eff180babe0 0x7eff181489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 --2- 172.21.15.27:0/480345315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7eff180bf550 0x7eff18148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 -- 172.21.15.27:0/480345315 >> 172.21.15.27:0/480345315 conn(0x7eff18067b30 msgr2=0x7eff180bec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:01.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 -- 172.21.15.27:0/480345315 shutdown_connections 2023-10-06T03:00:01.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.083+0000 7eff1ec9e700 1 -- 172.21.15.27:0/480345315 wait complete. 2023-10-06T03:00:01.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1ec9e700 1 Processor -- start 2023-10-06T03:00:01.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1ec9e700 1 -- start start 2023-10-06T03:00:01.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1ec9e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff1806a400 0x7eff18140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1ec9e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7eff180babe0 0x7eff1815fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1ec9e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff180bf550 0x7eff1806ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1ec9e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff181512a0 con 0x7eff1806a400 2023-10-06T03:00:01.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1ec9e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff181413e0 con 0x7eff180bf550 2023-10-06T03:00:01.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1ec9e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff181415f0 con 0x7eff180babe0 2023-10-06T03:00:01.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1dc9c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff1806a400 0x7eff18140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1dc9c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff1806a400 0x7eff18140710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48988/0 (socket says 172.21.15.27:48988) 2023-10-06T03:00:01.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1dc9c700 1 -- 172.21.15.27:0/1990664125 learned_addr learned my addr 172.21.15.27:0/1990664125 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:01.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1e49d700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff180bf550 0x7eff1806ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1d49b700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7eff180babe0 0x7eff1815fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1dc9c700 1 -- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7eff180babe0 msgr2=0x7eff1815fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1dc9c700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7eff180babe0 0x7eff1815fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1dc9c700 1 -- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff180bf550 msgr2=0x7eff1806ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1dc9c700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff180bf550 0x7eff1806ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1dc9c700 1 -- 172.21.15.27:0/1990664125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10009ae0 con 0x7eff1806a400 2023-10-06T03:00:01.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1dc9c700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff1806a400 0x7eff18140710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7eff1400d860 tx=0x7eff14008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff0dffb700 1 -- 172.21.15.27:0/1990664125 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140125f0 con 0x7eff1806a400 2023-10-06T03:00:01.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff0dffb700 1 -- 172.21.15.27:0/1990664125 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14012770 con 0x7eff1806a400 2023-10-06T03:00:01.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1ec9e700 1 -- 172.21.15.27:0/1990664125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1814f650 con 0x7eff1806a400 2023-10-06T03:00:01.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff0dffb700 1 -- 172.21.15.27:0/1990664125 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14012b30 con 0x7eff1806a400 2023-10-06T03:00:01.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.087+0000 7eff1ec9e700 1 -- 172.21.15.27:0/1990664125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff18143380 con 0x7eff1806a400 2023-10-06T03:00:01.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.091+0000 7eff1ec9e700 1 -- 172.21.15.27:0/1990664125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1814f890 con 0x7eff1806a400 2023-10-06T03:00:01.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.091+0000 7eff0dffb700 1 -- 172.21.15.27:0/1990664125 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7eff14013480 con 0x7eff1806a400 2023-10-06T03:00:01.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.091+0000 7eff0dffb700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7efefc060550 0x7efefc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.091+0000 7eff0dffb700 1 -- 172.21.15.27:0/1990664125 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff1407cd10 con 0x7eff1806a400 2023-10-06T03:00:01.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.091+0000 7eff1d49b700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7efefc060550 0x7efefc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.091+0000 7eff1d49b700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7efefc060550 0x7efefc062a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff181482b0 tx=0x7eff08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.099+0000 7eff0dffb700 1 -- 172.21.15.27:0/1990664125 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7eff1814f890 con 0x7eff1806a400 2023-10-06T03:00:01.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.251+0000 7eff1ec9e700 1 -- 172.21.15.27:0/1990664125 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff18160140 con 0x7efefc060550 2023-10-06T03:00:01.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.267+0000 7eff0dffb700 1 -- 172.21.15.27:0/1990664125 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286527 (secure 0 0 0) 0x7eff18160140 con 0x7efefc060550 2023-10-06T03:00:01.277 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:00:01.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.271+0000 7eff1ec9e700 1 -- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7efefc060550 msgr2=0x7efefc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.271+0000 7eff1ec9e700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7efefc060550 0x7efefc062a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff181482b0 tx=0x7eff08008040 comp rx=0 tx=0).stop 2023-10-06T03:00:01.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.271+0000 7eff1ec9e700 1 -- 172.21.15.27:0/1990664125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff1806a400 msgr2=0x7eff18140710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.271+0000 7eff1ec9e700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff1806a400 0x7eff18140710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7eff1400d860 tx=0x7eff14008040 comp rx=0 tx=0).stop 2023-10-06T03:00:01.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.271+0000 7eff1ec9e700 1 -- 172.21.15.27:0/1990664125 shutdown_connections 2023-10-06T03:00:01.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.271+0000 7eff1ec9e700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7efefc060550 0x7efefc062a00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.271+0000 7eff1ec9e700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff180bf550 0x7eff1806ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.271+0000 7eff1ec9e700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7eff180babe0 0x7eff1815fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.271+0000 7eff1ec9e700 1 --2- 172.21.15.27:0/1990664125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff1806a400 0x7eff18140710 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.271+0000 7eff1ec9e700 1 -- 172.21.15.27:0/1990664125 >> 172.21.15.27:0/1990664125 conn(0x7eff18067b30 msgr2=0x7eff18141b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:01.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.271+0000 7eff1ec9e700 1 -- 172.21.15.27:0/1990664125 shutdown_connections 2023-10-06T03:00:01.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.271+0000 7eff1ec9e700 1 -- 172.21.15.27:0/1990664125 wait complete. 2023-10-06T03:00:01.281 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-10-06T03:00:01.291 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-06T03:00:00.963186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381512,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593208,"statfs":{"total":773094113280,"available":770655444992,"internally_reserved":0,"allocated":3284992,"data_stored":1937172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.690814"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684810+0000","last_change":"2023-10-06T02:59:53.681789+0000","last_active":"2023-10-06T02:59:53.684810+0000","last_peered":"2023-10-06T02:59:53.684810+0000","last_clean":"2023-10-06T02:59:53.684810+0000","last_became_active":"2023-10-06T02:59:53.681495+0000","last_became_peered":"2023-10-06T02:59:53.681495+0000","last_unstale":"2023-10-06T02:59:53.684810+0000","last_undegraded":"2023-10-06T02:59:53.684810+0000","last_fullsized":"2023-10-06T02:59:53.684810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:19.626429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.685709+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T02:59:53.685709+0000","last_peered":"2023-10-06T02:59:53.685709+0000","last_clean":"2023-10-06T02:59:53.685709+0000","last_became_active":"2023-10-06T02:59:53.681849+0000","last_became_peered":"2023-10-06T02:59:53.681849+0000","last_unstale":"2023-10-06T02:59:53.685709+0000","last_undegraded":"2023-10-06T02:59:53.685709+0000","last_fullsized":"2023-10-06T02:59:53.685709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684784+0000","last_change":"2023-10-06T02:59:53.679536+0000","last_active":"2023-10-06T02:59:53.684784+0000","last_peered":"2023-10-06T02:59:53.684784+0000","last_clean":"2023-10-06T02:59:53.684784+0000","last_became_active":"2023-10-06T02:59:53.678264+0000","last_became_peered":"2023-10-06T02:59:53.678264+0000","last_unstale":"2023-10-06T02:59:53.684784+0000","last_undegraded":"2023-10-06T02:59:53.684784+0000","last_fullsized":"2023-10-06T02:59:53.684784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:18.566933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.678088+0000","last_change":"2023-10-06T02:59:53.671821+0000","last_active":"2023-10-06T02:59:53.678088+0000","last_peered":"2023-10-06T02:59:53.678088+0000","last_clean":"2023-10-06T02:59:53.678088+0000","last_became_active":"2023-10-06T02:59:53.671555+0000","last_became_peered":"2023-10-06T02:59:53.671555+0000","last_unstale":"2023-10-06T02:59:53.678088+0000","last_undegraded":"2023-10-06T02:59:53.678088+0000","last_fullsized":"2023-10-06T02:59:53.678088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:36:28.006545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684527+0000","last_change":"2023-10-06T02:59:53.682691+0000","last_active":"2023-10-06T02:59:53.684527+0000","last_peered":"2023-10-06T02:59:53.684527+0000","last_clean":"2023-10-06T02:59:53.684527+0000","last_became_active":"2023-10-06T02:59:53.682399+0000","last_became_peered":"2023-10-06T02:59:53.682399+0000","last_unstale":"2023-10-06T02:59:53.684527+0000","last_undegraded":"2023-10-06T02:59:53.684527+0000","last_fullsized":"2023-10-06T02:59:53.684527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683184+0000","last_change":"2023-10-06T02:59:53.678208+0000","last_active":"2023-10-06T02:59:53.683184+0000","last_peered":"2023-10-06T02:59:53.683184+0000","last_clean":"2023-10-06T02:59:53.683184+0000","last_became_active":"2023-10-06T02:59:53.676481+0000","last_became_peered":"2023-10-06T02:59:53.676481+0000","last_unstale":"2023-10-06T02:59:53.683184+0000","last_undegraded":"2023-10-06T02:59:53.683184+0000","last_fullsized":"2023-10-06T02:59:53.683184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:42.767531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688401+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T02:59:53.688401+0000","last_peered":"2023-10-06T02:59:53.688401+0000","last_clean":"2023-10-06T02:59:53.688401+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T02:59:53.688401+0000","last_undegraded":"2023-10-06T02:59:53.688401+0000","last_fullsized":"2023-10-06T02:59:53.688401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688329+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T02:59:53.688329+0000","last_peered":"2023-10-06T02:59:53.688329+0000","last_clean":"2023-10-06T02:59:53.688329+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T02:59:53.688329+0000","last_undegraded":"2023-10-06T02:59:53.688329+0000","last_fullsized":"2023-10-06T02:59:53.688329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682066+0000","last_change":"2023-10-06T02:59:53.680395+0000","last_active":"2023-10-06T02:59:53.682066+0000","last_peered":"2023-10-06T02:59:53.682066+0000","last_clean":"2023-10-06T02:59:53.682066+0000","last_became_active":"2023-10-06T02:59:53.680086+0000","last_became_peered":"2023-10-06T02:59:53.680086+0000","last_unstale":"2023-10-06T02:59:53.682066+0000","last_undegraded":"2023-10-06T02:59:53.682066+0000","last_fullsized":"2023-10-06T02:59:53.682066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.680410+0000","last_change":"2023-10-06T02:59:53.675582+0000","last_active":"2023-10-06T02:59:53.680410+0000","last_peered":"2023-10-06T02:59:53.680410+0000","last_clean":"2023-10-06T02:59:53.680410+0000","last_became_active":"2023-10-06T02:59:53.675243+0000","last_became_peered":"2023-10-06T02:59:53.675243+0000","last_unstale":"2023-10-06T02:59:53.680410+0000","last_undegraded":"2023-10-06T02:59:53.680410+0000","last_fullsized":"2023-10-06T02:59:53.680410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684759+0000","last_change":"2023-10-06T02:59:53.679489+0000","last_active":"2023-10-06T02:59:53.684759+0000","last_peered":"2023-10-06T02:59:53.684759+0000","last_clean":"2023-10-06T02:59:53.684759+0000","last_became_active":"2023-10-06T02:59:53.678985+0000","last_became_peered":"2023-10-06T02:59:53.678985+0000","last_unstale":"2023-10-06T02:59:53.684759+0000","last_undegraded":"2023-10-06T02:59:53.684759+0000","last_fullsized":"2023-10-06T02:59:53.684759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:12.576010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684951+0000","last_change":"2023-10-06T02:59:53.682799+0000","last_active":"2023-10-06T02:59:53.684951+0000","last_peered":"2023-10-06T02:59:53.684951+0000","last_clean":"2023-10-06T02:59:53.684951+0000","last_became_active":"2023-10-06T02:59:53.682464+0000","last_became_peered":"2023-10-06T02:59:53.682464+0000","last_unstale":"2023-10-06T02:59:53.684951+0000","last_undegraded":"2023-10-06T02:59:53.684951+0000","last_fullsized":"2023-10-06T02:59:53.684951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:06.403449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683827+0000","last_change":"2023-10-06T02:59:53.678968+0000","last_active":"2023-10-06T02:59:53.683827+0000","last_peered":"2023-10-06T02:59:53.683827+0000","last_clean":"2023-10-06T02:59:53.683827+0000","last_became_active":"2023-10-06T02:59:53.678562+0000","last_became_peered":"2023-10-06T02:59:53.678562+0000","last_unstale":"2023-10-06T02:59:53.683827+0000","last_undegraded":"2023-10-06T02:59:53.683827+0000","last_fullsized":"2023-10-06T02:59:53.683827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:46.305158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.674814+0000","last_change":"2023-10-06T02:59:53.673321+0000","last_active":"2023-10-06T02:59:53.674814+0000","last_peered":"2023-10-06T02:59:53.674814+0000","last_clean":"2023-10-06T02:59:53.674814+0000","last_became_active":"2023-10-06T02:59:53.672957+0000","last_became_peered":"2023-10-06T02:59:53.672957+0000","last_unstale":"2023-10-06T02:59:53.674814+0000","last_undegraded":"2023-10-06T02:59:53.674814+0000","last_fullsized":"2023-10-06T02:59:53.674814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.689370+0000","last_change":"2023-10-06T02:59:53.686669+0000","last_active":"2023-10-06T02:59:53.689370+0000","last_peered":"2023-10-06T02:59:53.689370+0000","last_clean":"2023-10-06T02:59:53.689370+0000","last_became_active":"2023-10-06T02:59:53.686352+0000","last_became_peered":"2023-10-06T02:59:53.686352+0000","last_unstale":"2023-10-06T02:59:53.689370+0000","last_undegraded":"2023-10-06T02:59:53.689370+0000","last_fullsized":"2023-10-06T02:59:53.689370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684827+0000","last_change":"2023-10-06T02:59:53.680975+0000","last_active":"2023-10-06T02:59:53.684827+0000","last_peered":"2023-10-06T02:59:53.684827+0000","last_clean":"2023-10-06T02:59:53.684827+0000","last_became_active":"2023-10-06T02:59:53.678449+0000","last_became_peered":"2023-10-06T02:59:53.678449+0000","last_unstale":"2023-10-06T02:59:53.684827+0000","last_undegraded":"2023-10-06T02:59:53.684827+0000","last_fullsized":"2023-10-06T02:59:53.684827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:18.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682046+0000","last_change":"2023-10-06T02:59:53.680344+0000","last_active":"2023-10-06T02:59:53.682046+0000","last_peered":"2023-10-06T02:59:53.682046+0000","last_clean":"2023-10-06T02:59:53.682046+0000","last_became_active":"2023-10-06T02:59:53.680028+0000","last_became_peered":"2023-10-06T02:59:53.680028+0000","last_unstale":"2023-10-06T02:59:53.682046+0000","last_undegraded":"2023-10-06T02:59:53.682046+0000","last_fullsized":"2023-10-06T02:59:53.682046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682183+0000","last_change":"2023-10-06T02:59:53.678143+0000","last_active":"2023-10-06T02:59:53.682183+0000","last_peered":"2023-10-06T02:59:53.682183+0000","last_clean":"2023-10-06T02:59:53.682183+0000","last_became_active":"2023-10-06T02:59:53.676602+0000","last_became_peered":"2023-10-06T02:59:53.676602+0000","last_unstale":"2023-10-06T02:59:53.682183+0000","last_undegraded":"2023-10-06T02:59:53.682183+0000","last_fullsized":"2023-10-06T02:59:53.682183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:29.621147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.677525+0000","last_change":"2023-10-06T02:59:53.675935+0000","last_active":"2023-10-06T02:59:53.677525+0000","last_peered":"2023-10-06T02:59:53.677525+0000","last_clean":"2023-10-06T02:59:53.677525+0000","last_became_active":"2023-10-06T02:59:53.675657+0000","last_became_peered":"2023-10-06T02:59:53.675657+0000","last_unstale":"2023-10-06T02:59:53.677525+0000","last_undegraded":"2023-10-06T02:59:53.677525+0000","last_fullsized":"2023-10-06T02:59:53.677525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:56.862647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681975+0000","last_change":"2023-10-06T02:59:53.673043+0000","last_active":"2023-10-06T02:59:53.681975+0000","last_peered":"2023-10-06T02:59:53.681975+0000","last_clean":"2023-10-06T02:59:53.681975+0000","last_became_active":"2023-10-06T02:59:53.672690+0000","last_became_peered":"2023-10-06T02:59:53.672690+0000","last_unstale":"2023-10-06T02:59:53.681975+0000","last_undegraded":"2023-10-06T02:59:53.681975+0000","last_fullsized":"2023-10-06T02:59:53.681975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688445+0000","last_change":"2023-10-06T02:59:53.684492+0000","last_active":"2023-10-06T02:59:53.688445+0000","last_peered":"2023-10-06T02:59:53.688445+0000","last_clean":"2023-10-06T02:59:53.688445+0000","last_became_active":"2023-10-06T02:59:53.684145+0000","last_became_peered":"2023-10-06T02:59:53.684145+0000","last_unstale":"2023-10-06T02:59:53.688445+0000","last_undegraded":"2023-10-06T02:59:53.688445+0000","last_fullsized":"2023-10-06T02:59:53.688445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687097+0000","last_change":"2023-10-06T02:59:53.683256+0000","last_active":"2023-10-06T02:59:53.687097+0000","last_peered":"2023-10-06T02:59:53.687097+0000","last_clean":"2023-10-06T02:59:53.687097+0000","last_became_active":"2023-10-06T02:59:53.682948+0000","last_became_peered":"2023-10-06T02:59:53.682948+0000","last_unstale":"2023-10-06T02:59:53.687097+0000","last_undegraded":"2023-10-06T02:59:53.687097+0000","last_fullsized":"2023-10-06T02:59:53.687097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681303+0000","last_change":"2023-10-06T02:59:53.675936+0000","last_active":"2023-10-06T02:59:53.681303+0000","last_peered":"2023-10-06T02:59:53.681303+0000","last_clean":"2023-10-06T02:59:53.681303+0000","last_became_active":"2023-10-06T02:59:53.675319+0000","last_became_peered":"2023-10-06T02:59:53.675319+0000","last_unstale":"2023-10-06T02:59:53.681303+0000","last_undegraded":"2023-10-06T02:59:53.681303+0000","last_fullsized":"2023-10-06T02:59:53.681303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.689381+0000","last_change":"2023-10-06T02:59:53.686758+0000","last_active":"2023-10-06T02:59:53.689381+0000","last_peered":"2023-10-06T02:59:53.689381+0000","last_clean":"2023-10-06T02:59:53.689381+0000","last_became_active":"2023-10-06T02:59:53.686007+0000","last_became_peered":"2023-10-06T02:59:53.686007+0000","last_unstale":"2023-10-06T02:59:53.689381+0000","last_undegraded":"2023-10-06T02:59:53.689381+0000","last_fullsized":"2023-10-06T02:59:53.689381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.686023+0000","last_change":"2023-10-06T02:59:53.682853+0000","last_active":"2023-10-06T02:59:53.686023+0000","last_peered":"2023-10-06T02:59:53.686023+0000","last_clean":"2023-10-06T02:59:53.686023+0000","last_became_active":"2023-10-06T02:59:53.682511+0000","last_became_peered":"2023-10-06T02:59:53.682511+0000","last_unstale":"2023-10-06T02:59:53.686023+0000","last_undegraded":"2023-10-06T02:59:53.686023+0000","last_fullsized":"2023-10-06T02:59:53.686023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.685842+0000","last_change":"2023-10-06T02:59:53.682001+0000","last_active":"2023-10-06T02:59:53.685842+0000","last_peered":"2023-10-06T02:59:53.685842+0000","last_clean":"2023-10-06T02:59:53.685842+0000","last_became_active":"2023-10-06T02:59:53.681732+0000","last_became_peered":"2023-10-06T02:59:53.681732+0000","last_unstale":"2023-10-06T02:59:53.685842+0000","last_undegraded":"2023-10-06T02:59:53.685842+0000","last_fullsized":"2023-10-06T02:59:53.685842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.680523+0000","last_change":"2023-10-06T02:59:53.676598+0000","last_active":"2023-10-06T02:59:53.680523+0000","last_peered":"2023-10-06T02:59:53.680523+0000","last_clean":"2023-10-06T02:59:53.680523+0000","last_became_active":"2023-10-06T02:59:53.676284+0000","last_became_peered":"2023-10-06T02:59:53.676284+0000","last_unstale":"2023-10-06T02:59:53.680523+0000","last_undegraded":"2023-10-06T02:59:53.680523+0000","last_fullsized":"2023-10-06T02:59:53.680523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.690178+0000","last_change":"2023-10-06T02:59:53.687275+0000","last_active":"2023-10-06T02:59:53.690178+0000","last_peered":"2023-10-06T02:59:53.690178+0000","last_clean":"2023-10-06T02:59:53.690178+0000","last_became_active":"2023-10-06T02:59:53.686912+0000","last_became_peered":"2023-10-06T02:59:53.686912+0000","last_unstale":"2023-10-06T02:59:53.690178+0000","last_undegraded":"2023-10-06T02:59:53.690178+0000","last_fullsized":"2023-10-06T02:59:53.690178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687065+0000","last_change":"2023-10-06T02:59:53.685421+0000","last_active":"2023-10-06T02:59:53.687065+0000","last_peered":"2023-10-06T02:59:53.687065+0000","last_clean":"2023-10-06T02:59:53.687065+0000","last_became_active":"2023-10-06T02:59:53.684806+0000","last_became_peered":"2023-10-06T02:59:53.684806+0000","last_unstale":"2023-10-06T02:59:53.687065+0000","last_undegraded":"2023-10-06T02:59:53.687065+0000","last_fullsized":"2023-10-06T02:59:53.687065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682303+0000","last_change":"2023-10-06T02:59:53.676085+0000","last_active":"2023-10-06T02:59:53.682303+0000","last_peered":"2023-10-06T02:59:53.682303+0000","last_clean":"2023-10-06T02:59:53.682303+0000","last_became_active":"2023-10-06T02:59:53.675718+0000","last_became_peered":"2023-10-06T02:59:53.675718+0000","last_unstale":"2023-10-06T02:59:53.682303+0000","last_undegraded":"2023-10-06T02:59:53.682303+0000","last_fullsized":"2023-10-06T02:59:53.682303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:00.548441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681322+0000","last_change":"2023-10-06T02:59:53.676118+0000","last_active":"2023-10-06T02:59:53.681322+0000","last_peered":"2023-10-06T02:59:53.681322+0000","last_clean":"2023-10-06T02:59:53.681322+0000","last_became_active":"2023-10-06T02:59:53.675682+0000","last_became_peered":"2023-10-06T02:59:53.675682+0000","last_unstale":"2023-10-06T02:59:53.681322+0000","last_undegraded":"2023-10-06T02:59:53.681322+0000","last_fullsized":"2023-10-06T02:59:53.681322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.678043+0000","last_change":"2023-10-06T02:59:53.673225+0000","last_active":"2023-10-06T02:59:53.678043+0000","last_peered":"2023-10-06T02:59:53.678043+0000","last_clean":"2023-10-06T02:59:53.678043+0000","last_became_active":"2023-10-06T02:59:53.672930+0000","last_became_peered":"2023-10-06T02:59:53.672930+0000","last_unstale":"2023-10-06T02:59:53.678043+0000","last_undegraded":"2023-10-06T02:59:53.678043+0000","last_fullsized":"2023-10-06T02:59:53.678043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:02.845187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683926+0000","last_change":"2023-10-06T02:59:53.678742+0000","last_active":"2023-10-06T02:59:53.683926+0000","last_peered":"2023-10-06T02:59:53.683926+0000","last_clean":"2023-10-06T02:59:53.683926+0000","last_became_active":"2023-10-06T02:59:53.678471+0000","last_became_peered":"2023-10-06T02:59:53.678471+0000","last_unstale":"2023-10-06T02:59:53.683926+0000","last_undegraded":"2023-10-06T02:59:53.683926+0000","last_fullsized":"2023-10-06T02:59:53.683926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292803+0000","last_change":"2023-10-06T02:59:53.297136+0000","last_active":"2023-10-06T02:59:54.292803+0000","last_peered":"2023-10-06T02:59:54.292803+0000","last_clean":"2023-10-06T02:59:54.292803+0000","last_became_active":"2023-10-06T02:59:53.296816+0000","last_became_peered":"2023-10-06T02:59:53.296816+0000","last_unstale":"2023-10-06T02:59:54.292803+0000","last_undegraded":"2023-10-06T02:59:54.292803+0000","last_fullsized":"2023-10-06T02:59:54.292803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:58.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688369+0000","last_change":"2023-10-06T02:59:53.684876+0000","last_active":"2023-10-06T02:59:53.688369+0000","last_peered":"2023-10-06T02:59:53.688369+0000","last_clean":"2023-10-06T02:59:53.688369+0000","last_became_active":"2023-10-06T02:59:53.684522+0000","last_became_peered":"2023-10-06T02:59:53.684522+0000","last_unstale":"2023-10-06T02:59:53.688369+0000","last_undegraded":"2023-10-06T02:59:53.688369+0000","last_fullsized":"2023-10-06T02:59:53.688369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668295+0000","last_change":"2023-10-06T02:59:53.292700+0000","last_active":"2023-10-06T02:59:53.668295+0000","last_peered":"2023-10-06T02:59:53.668295+0000","last_clean":"2023-10-06T02:59:53.668295+0000","last_became_active":"2023-10-06T02:59:53.292378+0000","last_became_peered":"2023-10-06T02:59:53.292378+0000","last_unstale":"2023-10-06T02:59:53.668295+0000","last_undegraded":"2023-10-06T02:59:53.668295+0000","last_fullsized":"2023-10-06T02:59:53.668295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.677456+0000","last_change":"2023-10-06T02:59:53.675542+0000","last_active":"2023-10-06T02:59:53.677456+0000","last_peered":"2023-10-06T02:59:53.677456+0000","last_clean":"2023-10-06T02:59:53.677456+0000","last_became_active":"2023-10-06T02:59:53.675219+0000","last_became_peered":"2023-10-06T02:59:53.675219+0000","last_unstale":"2023-10-06T02:59:53.677456+0000","last_undegraded":"2023-10-06T02:59:53.677456+0000","last_fullsized":"2023-10-06T02:59:53.677456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.670933+0000","last_change":"2023-10-06T02:59:53.302122+0000","last_active":"2023-10-06T02:59:53.670933+0000","last_peered":"2023-10-06T02:59:53.670933+0000","last_clean":"2023-10-06T02:59:53.670933+0000","last_became_active":"2023-10-06T02:59:53.301737+0000","last_became_peered":"2023-10-06T02:59:53.301737+0000","last_unstale":"2023-10-06T02:59:53.670933+0000","last_undegraded":"2023-10-06T02:59:53.670933+0000","last_fullsized":"2023-10-06T02:59:53.670933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.686222+0000","last_change":"2023-10-06T02:59:53.684854+0000","last_active":"2023-10-06T02:59:53.686222+0000","last_peered":"2023-10-06T02:59:53.686222+0000","last_clean":"2023-10-06T02:59:53.686222+0000","last_became_active":"2023-10-06T02:59:53.684527+0000","last_became_peered":"2023-10-06T02:59:53.684527+0000","last_unstale":"2023-10-06T02:59:53.686222+0000","last_undegraded":"2023-10-06T02:59:53.686222+0000","last_fullsized":"2023-10-06T02:59:53.686222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.295747+0000","last_change":"2023-10-06T02:59:53.294103+0000","last_active":"2023-10-06T02:59:54.295747+0000","last_peered":"2023-10-06T02:59:54.295747+0000","last_clean":"2023-10-06T02:59:54.295747+0000","last_became_active":"2023-10-06T02:59:53.293707+0000","last_became_peered":"2023-10-06T02:59:53.293707+0000","last_unstale":"2023-10-06T02:59:54.295747+0000","last_undegraded":"2023-10-06T02:59:54.295747+0000","last_fullsized":"2023-10-06T02:59:54.295747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292846+0000","last_change":"2023-10-06T02:59:53.296507+0000","last_active":"2023-10-06T02:59:54.292846+0000","last_peered":"2023-10-06T02:59:54.292846+0000","last_clean":"2023-10-06T02:59:54.292846+0000","last_became_active":"2023-10-06T02:59:53.296230+0000","last_became_peered":"2023-10-06T02:59:53.296230+0000","last_unstale":"2023-10-06T02:59:54.292846+0000","last_undegraded":"2023-10-06T02:59:54.292846+0000","last_fullsized":"2023-10-06T02:59:54.292846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688349+0000","last_change":"2023-10-06T02:59:53.684046+0000","last_active":"2023-10-06T02:59:53.688349+0000","last_peered":"2023-10-06T02:59:53.688349+0000","last_clean":"2023-10-06T02:59:53.688349+0000","last_became_active":"2023-10-06T02:59:53.683705+0000","last_became_peered":"2023-10-06T02:59:53.683705+0000","last_unstale":"2023-10-06T02:59:53.688349+0000","last_undegraded":"2023-10-06T02:59:53.688349+0000","last_fullsized":"2023-10-06T02:59:53.688349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292725+0000","last_change":"2023-10-06T02:59:53.296465+0000","last_active":"2023-10-06T02:59:54.292725+0000","last_peered":"2023-10-06T02:59:54.292725+0000","last_clean":"2023-10-06T02:59:54.292725+0000","last_became_active":"2023-10-06T02:59:53.296225+0000","last_became_peered":"2023-10-06T02:59:53.296225+0000","last_unstale":"2023-10-06T02:59:54.292725+0000","last_undegraded":"2023-10-06T02:59:54.292725+0000","last_fullsized":"2023-10-06T02:59:54.292725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688679+0000","last_change":"2023-10-06T02:59:53.683216+0000","last_active":"2023-10-06T02:59:53.688679+0000","last_peered":"2023-10-06T02:59:53.688679+0000","last_clean":"2023-10-06T02:59:53.688679+0000","last_became_active":"2023-10-06T02:59:53.682938+0000","last_became_peered":"2023-10-06T02:59:53.682938+0000","last_unstale":"2023-10-06T02:59:53.688679+0000","last_undegraded":"2023-10-06T02:59:53.688679+0000","last_fullsized":"2023-10-06T02:59:53.688679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292905+0000","last_change":"2023-10-06T02:59:53.293929+0000","last_active":"2023-10-06T02:59:54.292905+0000","last_peered":"2023-10-06T02:59:54.292905+0000","last_clean":"2023-10-06T02:59:54.292905+0000","last_became_active":"2023-10-06T02:59:53.293602+0000","last_became_peered":"2023-10-06T02:59:53.293602+0000","last_unstale":"2023-10-06T02:59:54.292905+0000","last_undegraded":"2023-10-06T02:59:54.292905+0000","last_fullsized":"2023-10-06T02:59:54.292905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.677911+0000","last_change":"2023-10-06T02:59:53.672111+0000","last_active":"2023-10-06T02:59:53.677911+0000","last_peered":"2023-10-06T02:59:53.677911+0000","last_clean":"2023-10-06T02:59:53.677911+0000","last_became_active":"2023-10-06T02:59:53.671511+0000","last_became_peered":"2023-10-06T02:59:53.671511+0000","last_unstale":"2023-10-06T02:59:53.677911+0000","last_undegraded":"2023-10-06T02:59:53.677911+0000","last_fullsized":"2023-10-06T02:59:53.677911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668804+0000","last_change":"2023-10-06T02:59:53.300059+0000","last_active":"2023-10-06T02:59:53.668804+0000","last_peered":"2023-10-06T02:59:53.668804+0000","last_clean":"2023-10-06T02:59:53.668804+0000","last_became_active":"2023-10-06T02:59:53.299715+0000","last_became_peered":"2023-10-06T02:59:53.299715+0000","last_unstale":"2023-10-06T02:59:53.668804+0000","last_undegraded":"2023-10-06T02:59:53.668804+0000","last_fullsized":"2023-10-06T02:59:53.668804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687172+0000","last_change":"2023-10-06T02:59:53.683331+0000","last_active":"2023-10-06T02:59:53.687172+0000","last_peered":"2023-10-06T02:59:53.687172+0000","last_clean":"2023-10-06T02:59:53.687172+0000","last_became_active":"2023-10-06T02:59:53.682994+0000","last_became_peered":"2023-10-06T02:59:53.682994+0000","last_unstale":"2023-10-06T02:59:53.687172+0000","last_undegraded":"2023-10-06T02:59:53.687172+0000","last_fullsized":"2023-10-06T02:59:53.687172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.288613+0000","last_change":"2023-10-06T02:59:53.301126+0000","last_active":"2023-10-06T02:59:54.288613+0000","last_peered":"2023-10-06T02:59:54.288613+0000","last_clean":"2023-10-06T02:59:54.288613+0000","last_became_active":"2023-10-06T02:59:53.300850+0000","last_became_peered":"2023-10-06T02:59:53.300850+0000","last_unstale":"2023-10-06T02:59:54.288613+0000","last_undegraded":"2023-10-06T02:59:54.288613+0000","last_fullsized":"2023-10-06T02:59:54.288613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684480+0000","last_change":"2023-10-06T02:59:53.678930+0000","last_active":"2023-10-06T02:59:53.684480+0000","last_peered":"2023-10-06T02:59:53.684480+0000","last_clean":"2023-10-06T02:59:53.684480+0000","last_became_active":"2023-10-06T02:59:53.678630+0000","last_became_peered":"2023-10-06T02:59:53.678630+0000","last_unstale":"2023-10-06T02:59:53.684480+0000","last_undegraded":"2023-10-06T02:59:53.684480+0000","last_fullsized":"2023-10-06T02:59:53.684480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:14.961350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.662824+0000","last_change":"2023-10-06T02:59:53.291521+0000","last_active":"2023-10-06T02:59:53.662824+0000","last_peered":"2023-10-06T02:59:53.662824+0000","last_clean":"2023-10-06T02:59:53.662824+0000","last_became_active":"2023-10-06T02:59:53.290773+0000","last_became_peered":"2023-10-06T02:59:53.290773+0000","last_unstale":"2023-10-06T02:59:53.662824+0000","last_undegraded":"2023-10-06T02:59:53.662824+0000","last_fullsized":"2023-10-06T02:59:53.662824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682164+0000","last_change":"2023-10-06T02:59:53.678188+0000","last_active":"2023-10-06T02:59:53.682164+0000","last_peered":"2023-10-06T02:59:53.682164+0000","last_clean":"2023-10-06T02:59:53.682164+0000","last_became_active":"2023-10-06T02:59:53.676507+0000","last_became_peered":"2023-10-06T02:59:53.676507+0000","last_unstale":"2023-10-06T02:59:53.682164+0000","last_undegraded":"2023-10-06T02:59:53.682164+0000","last_fullsized":"2023-10-06T02:59:53.682164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.672575+0000","last_change":"2023-10-06T02:59:53.289980+0000","last_active":"2023-10-06T02:59:53.672575+0000","last_peered":"2023-10-06T02:59:53.672575+0000","last_clean":"2023-10-06T02:59:53.672575+0000","last_became_active":"2023-10-06T02:59:53.288601+0000","last_became_peered":"2023-10-06T02:59:53.288601+0000","last_unstale":"2023-10-06T02:59:53.672575+0000","last_undegraded":"2023-10-06T02:59:53.672575+0000","last_fullsized":"2023-10-06T02:59:53.672575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:54.630392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681947+0000","last_change":"2023-10-06T02:59:53.675456+0000","last_active":"2023-10-06T02:59:53.681947+0000","last_peered":"2023-10-06T02:59:53.681947+0000","last_clean":"2023-10-06T02:59:53.681947+0000","last_became_active":"2023-10-06T02:59:53.673268+0000","last_became_peered":"2023-10-06T02:59:53.673268+0000","last_unstale":"2023-10-06T02:59:53.681947+0000","last_undegraded":"2023-10-06T02:59:53.681947+0000","last_fullsized":"2023-10-06T02:59:53.681947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.658166+0000","last_change":"2023-10-06T02:59:53.298398+0000","last_active":"2023-10-06T02:59:53.658166+0000","last_peered":"2023-10-06T02:59:53.658166+0000","last_clean":"2023-10-06T02:59:53.658166+0000","last_became_active":"2023-10-06T02:59:53.297896+0000","last_became_peered":"2023-10-06T02:59:53.297896+0000","last_unstale":"2023-10-06T02:59:53.658166+0000","last_undegraded":"2023-10-06T02:59:53.658166+0000","last_fullsized":"2023-10-06T02:59:53.658166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684745+0000","last_change":"2023-10-06T02:59:53.679712+0000","last_active":"2023-10-06T02:59:53.684745+0000","last_peered":"2023-10-06T02:59:53.684745+0000","last_clean":"2023-10-06T02:59:53.684745+0000","last_became_active":"2023-10-06T02:59:53.679390+0000","last_became_peered":"2023-10-06T02:59:53.679390+0000","last_unstale":"2023-10-06T02:59:53.684745+0000","last_undegraded":"2023-10-06T02:59:53.684745+0000","last_fullsized":"2023-10-06T02:59:53.684745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.674991+0000","last_change":"2023-10-06T02:59:44.074625+0000","last_active":"2023-10-06T02:59:53.674991+0000","last_peered":"2023-10-06T02:59:53.674991+0000","last_clean":"2023-10-06T02:59:53.674991+0000","last_became_active":"2023-10-06T02:59:44.072854+0000","last_became_peered":"2023-10-06T02:59:44.072854+0000","last_unstale":"2023-10-06T02:59:53.674991+0000","last_undegraded":"2023-10-06T02:59:53.674991+0000","last_fullsized":"2023-10-06T02:59:53.674991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_clean_scrub_stamp":"2023-10-06T02:59:43.039151+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:04.936706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668581+0000","last_change":"2023-10-06T02:59:49.107090+0000","last_active":"2023-10-06T02:59:53.668581+0000","last_peered":"2023-10-06T02:59:53.668581+0000","last_clean":"2023-10-06T02:59:53.668581+0000","last_became_active":"2023-10-06T02:59:49.106619+0000","last_became_peered":"2023-10-06T02:59:49.106619+0000","last_unstale":"2023-10-06T02:59:53.668581+0000","last_undegraded":"2023-10-06T02:59:53.668581+0000","last_fullsized":"2023-10-06T02:59:53.668581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.658030+0000","last_change":"2023-10-06T02:59:53.298769+0000","last_active":"2023-10-06T02:59:53.658030+0000","last_peered":"2023-10-06T02:59:53.658030+0000","last_clean":"2023-10-06T02:59:53.658030+0000","last_became_active":"2023-10-06T02:59:53.298012+0000","last_became_peered":"2023-10-06T02:59:53.298012+0000","last_unstale":"2023-10-06T02:59:53.658030+0000","last_undegraded":"2023-10-06T02:59:53.658030+0000","last_fullsized":"2023-10-06T02:59:53.658030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681729+0000","last_change":"2023-10-06T02:59:53.679625+0000","last_active":"2023-10-06T02:59:53.681729+0000","last_peered":"2023-10-06T02:59:53.681729+0000","last_clean":"2023-10-06T02:59:53.681729+0000","last_became_active":"2023-10-06T02:59:53.679200+0000","last_became_peered":"2023-10-06T02:59:53.679200+0000","last_unstale":"2023-10-06T02:59:53.681729+0000","last_undegraded":"2023-10-06T02:59:53.681729+0000","last_fullsized":"2023-10-06T02:59:53.681729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:59.309901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.671317+0000","last_change":"2023-10-06T02:59:49.107231+0000","last_active":"2023-10-06T02:59:53.671317+0000","last_peered":"2023-10-06T02:59:53.671317+0000","last_clean":"2023-10-06T02:59:53.671317+0000","last_became_active":"2023-10-06T02:59:49.106878+0000","last_became_peered":"2023-10-06T02:59:49.106878+0000","last_unstale":"2023-10-06T02:59:53.671317+0000","last_undegraded":"2023-10-06T02:59:53.671317+0000","last_fullsized":"2023-10-06T02:59:53.671317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668411+0000","last_change":"2023-10-06T02:59:53.296937+0000","last_active":"2023-10-06T02:59:53.668411+0000","last_peered":"2023-10-06T02:59:53.668411+0000","last_clean":"2023-10-06T02:59:53.668411+0000","last_became_active":"2023-10-06T02:59:53.296171+0000","last_became_peered":"2023-10-06T02:59:53.296171+0000","last_unstale":"2023-10-06T02:59:53.668411+0000","last_undegraded":"2023-10-06T02:59:53.668411+0000","last_fullsized":"2023-10-06T02:59:53.668411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684479+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T02:59:53.684479+0000","last_peered":"2023-10-06T02:59:53.684479+0000","last_clean":"2023-10-06T02:59:53.684479+0000","last_became_active":"2023-10-06T02:59:53.681786+0000","last_became_peered":"2023-10-06T02:59:53.681786+0000","last_unstale":"2023-10-06T02:59:53.684479+0000","last_undegraded":"2023-10-06T02:59:53.684479+0000","last_fullsized":"2023-10-06T02:59:53.684479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669847+0000","last_change":"2023-10-06T02:59:49.115200+0000","last_active":"2023-10-06T02:59:53.669847+0000","last_peered":"2023-10-06T02:59:53.669847+0000","last_clean":"2023-10-06T02:59:53.669847+0000","last_became_active":"2023-10-06T02:59:49.114769+0000","last_became_peered":"2023-10-06T02:59:49.114769+0000","last_unstale":"2023-10-06T02:59:53.669847+0000","last_undegraded":"2023-10-06T02:59:53.669847+0000","last_fullsized":"2023-10-06T02:59:53.669847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:37.773233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.665174+0000","last_change":"2023-10-06T02:59:53.298658+0000","last_active":"2023-10-06T02:59:53.665174+0000","last_peered":"2023-10-06T02:59:53.665174+0000","last_clean":"2023-10-06T02:59:53.665174+0000","last_became_active":"2023-10-06T02:59:53.298054+0000","last_became_peered":"2023-10-06T02:59:53.298054+0000","last_unstale":"2023-10-06T02:59:53.665174+0000","last_undegraded":"2023-10-06T02:59:53.665174+0000","last_fullsized":"2023-10-06T02:59:53.665174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681569+0000","last_change":"2023-10-06T02:59:53.673950+0000","last_active":"2023-10-06T02:59:53.681569+0000","last_peered":"2023-10-06T02:59:53.681569+0000","last_clean":"2023-10-06T02:59:53.681569+0000","last_became_active":"2023-10-06T02:59:53.673677+0000","last_became_peered":"2023-10-06T02:59:53.673677+0000","last_unstale":"2023-10-06T02:59:53.681569+0000","last_undegraded":"2023-10-06T02:59:53.681569+0000","last_fullsized":"2023-10-06T02:59:53.681569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668455+0000","last_change":"2023-10-06T02:59:49.107944+0000","last_active":"2023-10-06T02:59:53.668455+0000","last_peered":"2023-10-06T02:59:53.668455+0000","last_clean":"2023-10-06T02:59:53.668455+0000","last_became_active":"2023-10-06T02:59:49.107560+0000","last_became_peered":"2023-10-06T02:59:49.107560+0000","last_unstale":"2023-10-06T02:59:53.668455+0000","last_undegraded":"2023-10-06T02:59:53.668455+0000","last_fullsized":"2023-10-06T02:59:53.668455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.671674+0000","last_change":"2023-10-06T02:59:53.300945+0000","last_active":"2023-10-06T02:59:53.671674+0000","last_peered":"2023-10-06T02:59:53.671674+0000","last_clean":"2023-10-06T02:59:53.671674+0000","last_became_active":"2023-10-06T02:59:53.300609+0000","last_became_peered":"2023-10-06T02:59:53.300609+0000","last_unstale":"2023-10-06T02:59:53.671674+0000","last_undegraded":"2023-10-06T02:59:53.671674+0000","last_fullsized":"2023-10-06T02:59:53.671674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682292+0000","last_change":"2023-10-06T02:59:53.677554+0000","last_active":"2023-10-06T02:59:53.682292+0000","last_peered":"2023-10-06T02:59:53.682292+0000","last_clean":"2023-10-06T02:59:53.682292+0000","last_became_active":"2023-10-06T02:59:53.677245+0000","last_became_peered":"2023-10-06T02:59:53.677245+0000","last_unstale":"2023-10-06T02:59:53.682292+0000","last_undegraded":"2023-10-06T02:59:53.682292+0000","last_fullsized":"2023-10-06T02:59:53.682292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668605+0000","last_change":"2023-10-06T02:59:53.301191+0000","last_active":"2023-10-06T02:59:53.668605+0000","last_peered":"2023-10-06T02:59:53.668605+0000","last_clean":"2023-10-06T02:59:53.668605+0000","last_became_active":"2023-10-06T02:59:53.300919+0000","last_became_peered":"2023-10-06T02:59:53.300919+0000","last_unstale":"2023-10-06T02:59:53.668605+0000","last_undegraded":"2023-10-06T02:59:53.668605+0000","last_fullsized":"2023-10-06T02:59:53.668605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669826+0000","last_change":"2023-10-06T02:59:49.108499+0000","last_active":"2023-10-06T02:59:53.669826+0000","last_peered":"2023-10-06T02:59:53.669826+0000","last_clean":"2023-10-06T02:59:53.669826+0000","last_became_active":"2023-10-06T02:59:49.107967+0000","last_became_peered":"2023-10-06T02:59:49.107967+0000","last_unstale":"2023-10-06T02:59:53.669826+0000","last_undegraded":"2023-10-06T02:59:53.669826+0000","last_fullsized":"2023-10-06T02:59:53.669826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682251+0000","last_change":"2023-10-06T02:59:53.676753+0000","last_active":"2023-10-06T02:59:53.682251+0000","last_peered":"2023-10-06T02:59:53.682251+0000","last_clean":"2023-10-06T02:59:53.682251+0000","last_became_active":"2023-10-06T02:59:53.676385+0000","last_became_peered":"2023-10-06T02:59:53.676385+0000","last_unstale":"2023-10-06T02:59:53.682251+0000","last_undegraded":"2023-10-06T02:59:53.682251+0000","last_fullsized":"2023-10-06T02:59:53.682251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669538+0000","last_change":"2023-10-06T02:59:53.303221+0000","last_active":"2023-10-06T02:59:53.669538+0000","last_peered":"2023-10-06T02:59:53.669538+0000","last_clean":"2023-10-06T02:59:53.669538+0000","last_became_active":"2023-10-06T02:59:53.302890+0000","last_became_peered":"2023-10-06T02:59:53.302890+0000","last_unstale":"2023-10-06T02:59:53.669538+0000","last_undegraded":"2023-10-06T02:59:53.669538+0000","last_fullsized":"2023-10-06T02:59:53.669538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.670899+0000","last_change":"2023-10-06T02:59:49.102005+0000","last_active":"2023-10-06T02:59:53.670899+0000","last_peered":"2023-10-06T02:59:53.670899+0000","last_clean":"2023-10-06T02:59:53.670899+0000","last_became_active":"2023-10-06T02:59:49.101530+0000","last_became_peered":"2023-10-06T02:59:49.101530+0000","last_unstale":"2023-10-06T02:59:53.670899+0000","last_undegraded":"2023-10-06T02:59:53.670899+0000","last_fullsized":"2023-10-06T02:59:53.670899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.675026+0000","last_change":"2023-10-06T02:59:53.672581+0000","last_active":"2023-10-06T02:59:53.675026+0000","last_peered":"2023-10-06T02:59:53.675026+0000","last_clean":"2023-10-06T02:59:53.675026+0000","last_became_active":"2023-10-06T02:59:53.672299+0000","last_became_peered":"2023-10-06T02:59:53.672299+0000","last_unstale":"2023-10-06T02:59:53.675026+0000","last_undegraded":"2023-10-06T02:59:53.675026+0000","last_fullsized":"2023-10-06T02:59:53.675026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.293712+0000","last_change":"2023-10-06T02:59:53.300135+0000","last_active":"2023-10-06T02:59:54.293712+0000","last_peered":"2023-10-06T02:59:54.293712+0000","last_clean":"2023-10-06T02:59:54.293712+0000","last_became_active":"2023-10-06T02:59:53.299271+0000","last_became_peered":"2023-10-06T02:59:53.299271+0000","last_unstale":"2023-10-06T02:59:54.293712+0000","last_undegraded":"2023-10-06T02:59:54.293712+0000","last_fullsized":"2023-10-06T02:59:54.293712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.672088+0000","last_change":"2023-10-06T02:59:49.100171+0000","last_active":"2023-10-06T02:59:53.672088+0000","last_peered":"2023-10-06T02:59:53.672088+0000","last_clean":"2023-10-06T02:59:53.672088+0000","last_became_active":"2023-10-06T02:59:49.099689+0000","last_became_peered":"2023-10-06T02:59:49.099689+0000","last_unstale":"2023-10-06T02:59:53.672088+0000","last_undegraded":"2023-10-06T02:59:53.672088+0000","last_fullsized":"2023-10-06T02:59:53.672088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687100+0000","last_change":"2023-10-06T02:59:53.685270+0000","last_active":"2023-10-06T02:59:53.687100+0000","last_peered":"2023-10-06T02:59:53.687100+0000","last_clean":"2023-10-06T02:59:53.687100+0000","last_became_active":"2023-10-06T02:59:53.684983+0000","last_became_peered":"2023-10-06T02:59:53.684983+0000","last_unstale":"2023-10-06T02:59:53.687100+0000","last_undegraded":"2023-10-06T02:59:53.687100+0000","last_fullsized":"2023-10-06T02:59:53.687100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:49.904101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668939+0000","last_change":"2023-10-06T02:59:53.301048+0000","last_active":"2023-10-06T02:59:53.668939+0000","last_peered":"2023-10-06T02:59:53.668939+0000","last_clean":"2023-10-06T02:59:53.668939+0000","last_became_active":"2023-10-06T02:59:53.300086+0000","last_became_peered":"2023-10-06T02:59:53.300086+0000","last_unstale":"2023-10-06T02:59:53.668939+0000","last_undegraded":"2023-10-06T02:59:53.668939+0000","last_fullsized":"2023-10-06T02:59:53.668939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.663390+0000","last_change":"2023-10-06T02:59:49.102935+0000","last_active":"2023-10-06T02:59:53.663390+0000","last_peered":"2023-10-06T02:59:53.663390+0000","last_clean":"2023-10-06T02:59:53.663390+0000","last_became_active":"2023-10-06T02:59:49.102397+0000","last_became_peered":"2023-10-06T02:59:49.102397+0000","last_unstale":"2023-10-06T02:59:53.663390+0000","last_undegraded":"2023-10-06T02:59:53.663390+0000","last_fullsized":"2023-10-06T02:59:53.663390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683104+0000","last_change":"2023-10-06T02:59:53.676229+0000","last_active":"2023-10-06T02:59:53.683104+0000","last_peered":"2023-10-06T02:59:53.683104+0000","last_clean":"2023-10-06T02:59:53.683104+0000","last_became_active":"2023-10-06T02:59:53.675895+0000","last_became_peered":"2023-10-06T02:59:53.675895+0000","last_unstale":"2023-10-06T02:59:53.683104+0000","last_undegraded":"2023-10-06T02:59:53.683104+0000","last_fullsized":"2023-10-06T02:59:53.683104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:03.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682155+0000","last_change":"2023-10-06T02:59:53.676843+0000","last_active":"2023-10-06T02:59:53.682155+0000","last_peered":"2023-10-06T02:59:53.682155+0000","last_clean":"2023-10-06T02:59:53.682155+0000","last_became_active":"2023-10-06T02:59:53.676528+0000","last_became_peered":"2023-10-06T02:59:53.676528+0000","last_unstale":"2023-10-06T02:59:53.682155+0000","last_undegraded":"2023-10-06T02:59:53.682155+0000","last_fullsized":"2023-10-06T02:59:53.682155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.296186+0000","last_change":"2023-10-06T02:59:53.294557+0000","last_active":"2023-10-06T02:59:54.296186+0000","last_peered":"2023-10-06T02:59:54.296186+0000","last_clean":"2023-10-06T02:59:54.296186+0000","last_became_active":"2023-10-06T02:59:53.291434+0000","last_became_peered":"2023-10-06T02:59:53.291434+0000","last_unstale":"2023-10-06T02:59:54.296186+0000","last_undegraded":"2023-10-06T02:59:54.296186+0000","last_fullsized":"2023-10-06T02:59:54.296186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684770+0000","last_change":"2023-10-06T02:59:53.678204+0000","last_active":"2023-10-06T02:59:53.684770+0000","last_peered":"2023-10-06T02:59:53.684770+0000","last_clean":"2023-10-06T02:59:53.684770+0000","last_became_active":"2023-10-06T02:59:53.677924+0000","last_became_peered":"2023-10-06T02:59:53.677924+0000","last_unstale":"2023-10-06T02:59:53.684770+0000","last_undegraded":"2023-10-06T02:59:53.684770+0000","last_fullsized":"2023-10-06T02:59:53.684770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292832+0000","last_change":"2023-10-06T02:59:53.301253+0000","last_active":"2023-10-06T02:59:54.292832+0000","last_peered":"2023-10-06T02:59:54.292832+0000","last_clean":"2023-10-06T02:59:54.292832+0000","last_became_active":"2023-10-06T02:59:53.300926+0000","last_became_peered":"2023-10-06T02:59:53.300926+0000","last_unstale":"2023-10-06T02:59:54.292832+0000","last_undegraded":"2023-10-06T02:59:54.292832+0000","last_fullsized":"2023-10-06T02:59:54.292832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:21.432516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668818+0000","last_change":"2023-10-06T02:59:53.292844+0000","last_active":"2023-10-06T02:59:53.668818+0000","last_peered":"2023-10-06T02:59:53.668818+0000","last_clean":"2023-10-06T02:59:53.668818+0000","last_became_active":"2023-10-06T02:59:53.292493+0000","last_became_peered":"2023-10-06T02:59:53.292493+0000","last_unstale":"2023-10-06T02:59:53.668818+0000","last_undegraded":"2023-10-06T02:59:53.668818+0000","last_fullsized":"2023-10-06T02:59:53.668818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681376+0000","last_change":"2023-10-06T02:59:53.676684+0000","last_active":"2023-10-06T02:59:53.681376+0000","last_peered":"2023-10-06T02:59:53.681376+0000","last_clean":"2023-10-06T02:59:53.681376+0000","last_became_active":"2023-10-06T02:59:53.676410+0000","last_became_peered":"2023-10-06T02:59:53.676410+0000","last_unstale":"2023-10-06T02:59:53.681376+0000","last_undegraded":"2023-10-06T02:59:53.681376+0000","last_fullsized":"2023-10-06T02:59:53.681376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668711+0000","last_change":"2023-10-06T02:59:53.293924+0000","last_active":"2023-10-06T02:59:53.668711+0000","last_peered":"2023-10-06T02:59:53.668711+0000","last_clean":"2023-10-06T02:59:53.668711+0000","last_became_active":"2023-10-06T02:59:53.293596+0000","last_became_peered":"2023-10-06T02:59:53.293596+0000","last_unstale":"2023-10-06T02:59:53.668711+0000","last_undegraded":"2023-10-06T02:59:53.668711+0000","last_fullsized":"2023-10-06T02:59:53.668711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681521+0000","last_change":"2023-10-06T02:59:53.673847+0000","last_active":"2023-10-06T02:59:53.681521+0000","last_peered":"2023-10-06T02:59:53.681521+0000","last_clean":"2023-10-06T02:59:53.681521+0000","last_became_active":"2023-10-06T02:59:53.673559+0000","last_became_peered":"2023-10-06T02:59:53.673559+0000","last_unstale":"2023-10-06T02:59:53.681521+0000","last_undegraded":"2023-10-06T02:59:53.681521+0000","last_fullsized":"2023-10-06T02:59:53.681521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.678028+0000","last_change":"2023-10-06T02:59:53.674388+0000","last_active":"2023-10-06T02:59:53.678028+0000","last_peered":"2023-10-06T02:59:53.678028+0000","last_clean":"2023-10-06T02:59:53.678028+0000","last_became_active":"2023-10-06T02:59:53.674086+0000","last_became_peered":"2023-10-06T02:59:53.674086+0000","last_unstale":"2023-10-06T02:59:53.678028+0000","last_undegraded":"2023-10-06T02:59:53.678028+0000","last_fullsized":"2023-10-06T02:59:53.678028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.658043+0000","last_change":"2023-10-06T02:59:53.296871+0000","last_active":"2023-10-06T02:59:53.658043+0000","last_peered":"2023-10-06T02:59:53.658043+0000","last_clean":"2023-10-06T02:59:53.658043+0000","last_became_active":"2023-10-06T02:59:53.296550+0000","last_became_peered":"2023-10-06T02:59:53.296550+0000","last_unstale":"2023-10-06T02:59:53.658043+0000","last_undegraded":"2023-10-06T02:59:53.658043+0000","last_fullsized":"2023-10-06T02:59:53.658043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687227+0000","last_change":"2023-10-06T02:59:53.683771+0000","last_active":"2023-10-06T02:59:53.687227+0000","last_peered":"2023-10-06T02:59:53.687227+0000","last_clean":"2023-10-06T02:59:53.687227+0000","last_became_active":"2023-10-06T02:59:53.683458+0000","last_became_peered":"2023-10-06T02:59:53.683458+0000","last_unstale":"2023-10-06T02:59:53.687227+0000","last_undegraded":"2023-10-06T02:59:53.687227+0000","last_fullsized":"2023-10-06T02:59:53.687227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669694+0000","last_change":"2023-10-06T02:59:53.301158+0000","last_active":"2023-10-06T02:59:53.669694+0000","last_peered":"2023-10-06T02:59:53.669694+0000","last_clean":"2023-10-06T02:59:53.669694+0000","last_became_active":"2023-10-06T02:59:53.300797+0000","last_became_peered":"2023-10-06T02:59:53.300797+0000","last_unstale":"2023-10-06T02:59:53.669694+0000","last_undegraded":"2023-10-06T02:59:53.669694+0000","last_fullsized":"2023-10-06T02:59:53.669694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.686119+0000","last_change":"2023-10-06T02:59:53.683576+0000","last_active":"2023-10-06T02:59:53.686119+0000","last_peered":"2023-10-06T02:59:53.686119+0000","last_clean":"2023-10-06T02:59:53.686119+0000","last_became_active":"2023-10-06T02:59:53.683301+0000","last_became_peered":"2023-10-06T02:59:53.683301+0000","last_unstale":"2023-10-06T02:59:53.686119+0000","last_undegraded":"2023-10-06T02:59:53.686119+0000","last_fullsized":"2023-10-06T02:59:53.686119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.290397+0000","last_change":"2023-10-06T02:59:53.297975+0000","last_active":"2023-10-06T02:59:54.290397+0000","last_peered":"2023-10-06T02:59:54.290397+0000","last_clean":"2023-10-06T02:59:54.290397+0000","last_became_active":"2023-10-06T02:59:53.297724+0000","last_became_peered":"2023-10-06T02:59:53.297724+0000","last_unstale":"2023-10-06T02:59:54.290397+0000","last_undegraded":"2023-10-06T02:59:54.290397+0000","last_fullsized":"2023-10-06T02:59:54.290397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.689406+0000","last_change":"2023-10-06T02:59:53.684667+0000","last_active":"2023-10-06T02:59:53.689406+0000","last_peered":"2023-10-06T02:59:53.689406+0000","last_clean":"2023-10-06T02:59:53.689406+0000","last_became_active":"2023-10-06T02:59:53.684378+0000","last_became_peered":"2023-10-06T02:59:53.684378+0000","last_unstale":"2023-10-06T02:59:53.689406+0000","last_undegraded":"2023-10-06T02:59:53.689406+0000","last_fullsized":"2023-10-06T02:59:53.689406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:40.914600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.288809+0000","last_change":"2023-10-06T02:59:53.298276+0000","last_active":"2023-10-06T02:59:54.288809+0000","last_peered":"2023-10-06T02:59:54.288809+0000","last_clean":"2023-10-06T02:59:54.288809+0000","last_became_active":"2023-10-06T02:59:53.297471+0000","last_became_peered":"2023-10-06T02:59:53.297471+0000","last_unstale":"2023-10-06T02:59:54.288809+0000","last_undegraded":"2023-10-06T02:59:54.288809+0000","last_fullsized":"2023-10-06T02:59:54.288809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684717+0000","last_change":"2023-10-06T02:59:53.679138+0000","last_active":"2023-10-06T02:59:53.684717+0000","last_peered":"2023-10-06T02:59:53.684717+0000","last_clean":"2023-10-06T02:59:53.684717+0000","last_became_active":"2023-10-06T02:59:53.678831+0000","last_became_peered":"2023-10-06T02:59:53.678831+0000","last_unstale":"2023-10-06T02:59:53.684717+0000","last_undegraded":"2023-10-06T02:59:53.684717+0000","last_fullsized":"2023-10-06T02:59:53.684717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:25.273960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292430+0000","last_change":"2023-10-06T02:59:53.295949+0000","last_active":"2023-10-06T02:59:54.292430+0000","last_peered":"2023-10-06T02:59:54.292430+0000","last_clean":"2023-10-06T02:59:54.292430+0000","last_became_active":"2023-10-06T02:59:53.295697+0000","last_became_peered":"2023-10-06T02:59:53.295697+0000","last_unstale":"2023-10-06T02:59:54.292430+0000","last_undegraded":"2023-10-06T02:59:54.292430+0000","last_fullsized":"2023-10-06T02:59:54.292430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682283+0000","last_change":"2023-10-06T02:59:53.673079+0000","last_active":"2023-10-06T02:59:53.682283+0000","last_peered":"2023-10-06T02:59:53.682283+0000","last_clean":"2023-10-06T02:59:53.682283+0000","last_became_active":"2023-10-06T02:59:53.672629+0000","last_became_peered":"2023-10-06T02:59:53.672629+0000","last_unstale":"2023-10-06T02:59:53.682283+0000","last_undegraded":"2023-10-06T02:59:53.682283+0000","last_fullsized":"2023-10-06T02:59:53.682283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292559+0000","last_change":"2023-10-06T02:59:53.297170+0000","last_active":"2023-10-06T02:59:54.292559+0000","last_peered":"2023-10-06T02:59:54.292559+0000","last_clean":"2023-10-06T02:59:54.292559+0000","last_became_active":"2023-10-06T02:59:53.296843+0000","last_became_peered":"2023-10-06T02:59:53.296843+0000","last_unstale":"2023-10-06T02:59:54.292559+0000","last_undegraded":"2023-10-06T02:59:54.292559+0000","last_fullsized":"2023-10-06T02:59:54.292559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681280+0000","last_change":"2023-10-06T02:59:53.675030+0000","last_active":"2023-10-06T02:59:53.681280+0000","last_peered":"2023-10-06T02:59:53.681280+0000","last_clean":"2023-10-06T02:59:53.681280+0000","last_became_active":"2023-10-06T02:59:53.673662+0000","last_became_peered":"2023-10-06T02:59:53.673662+0000","last_unstale":"2023-10-06T02:59:53.681280+0000","last_undegraded":"2023-10-06T02:59:53.681280+0000","last_fullsized":"2023-10-06T02:59:53.681280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.294000+0000","last_change":"2023-10-06T02:59:53.299596+0000","last_active":"2023-10-06T02:59:54.294000+0000","last_peered":"2023-10-06T02:59:54.294000+0000","last_clean":"2023-10-06T02:59:54.294000+0000","last_became_active":"2023-10-06T02:59:53.298881+0000","last_became_peered":"2023-10-06T02:59:53.298881+0000","last_unstale":"2023-10-06T02:59:54.294000+0000","last_undegraded":"2023-10-06T02:59:54.294000+0000","last_fullsized":"2023-10-06T02:59:54.294000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681995+0000","last_change":"2023-10-06T02:59:53.675391+0000","last_active":"2023-10-06T02:59:53.681995+0000","last_peered":"2023-10-06T02:59:53.681995+0000","last_clean":"2023-10-06T02:59:53.681995+0000","last_became_active":"2023-10-06T02:59:53.675092+0000","last_became_peered":"2023-10-06T02:59:53.675092+0000","last_unstale":"2023-10-06T02:59:53.681995+0000","last_undegraded":"2023-10-06T02:59:53.681995+0000","last_fullsized":"2023-10-06T02:59:53.681995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292391+0000","last_change":"2023-10-06T02:59:53.294074+0000","last_active":"2023-10-06T02:59:54.292391+0000","last_peered":"2023-10-06T02:59:54.292391+0000","last_clean":"2023-10-06T02:59:54.292391+0000","last_became_active":"2023-10-06T02:59:53.293752+0000","last_became_peered":"2023-10-06T02:59:53.293752+0000","last_unstale":"2023-10-06T02:59:54.292391+0000","last_undegraded":"2023-10-06T02:59:54.292391+0000","last_fullsized":"2023-10-06T02:59:54.292391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":686098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":94602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":95570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":94068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":684900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:00:01.299 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:00:01.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 Processor -- start 2023-10-06T03:00:01.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 -- start start 2023-10-06T03:00:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fed6c0b9c50 0x7fed6c0ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed6c0bb2c0 0x7fed6c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c09ef80 con 0x7fed6c06c910 2023-10-06T03:00:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6c0a0f20 con 0x7fed6c0b9c50 2023-10-06T03:00:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6c0a2c50 con 0x7fed6c0bb2c0 2023-10-06T03:00:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fed6c0b9c50 0x7fed6c0ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fed6c0b9c50 0x7fed6c0ba020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48996/0 (socket says 172.21.15.27:48996) 2023-10-06T03:00:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6affd700 1 -- 172.21.15.27:0/2825904449 learned_addr learned my addr 172.21.15.27:0/2825904449 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6a7fc700 1 --2- 172.21.15.27:0/2825904449 >> v2:172.21.15.123:3300/0 conn(0x7fed6c0bb2c0 0x7fed6c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6affd700 1 -- 172.21.15.27:0/2825904449 >> v2:172.21.15.123:3300/0 conn(0x7fed6c0bb2c0 msgr2=0x7fed6c0a3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6affd700 1 --2- 172.21.15.27:0/2825904449 >> v2:172.21.15.123:3300/0 conn(0x7fed6c0bb2c0 0x7fed6c0a3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6affd700 1 -- 172.21.15.27:0/2825904449 >> v1:172.21.15.123:6789/0 conn(0x7fed6c06c910 legacy=0x7fed6c09f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6affd700 1 -- 172.21.15.27:0/2825904449 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c0a2f30 con 0x7fed6c0b9c50 2023-10-06T03:00:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6a7fc700 1 --2- 172.21.15.27:0/2825904449 >> v2:172.21.15.123:3300/0 conn(0x7fed6c0bb2c0 0x7fed6c0a3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6affd700 1 --2- 172.21.15.27:0/2825904449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed6c0b9c50 0x7fed6c0ba020 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0badd0 tx=0x7fed54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaaebb9a4085cb60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed69ffb700 1 -- 172.21.15.27:0/2825904449 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400b860 con 0x7fed6c0b9c50 2023-10-06T03:00:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed69ffb700 1 -- 172.21.15.27:0/2825904449 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5400b9c0 con 0x7fed6c0b9c50 2023-10-06T03:00:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed69ffb700 1 -- 172.21.15.27:0/2825904449 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400bd60 con 0x7fed6c0b9c50 2023-10-06T03:00:01.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 -- 172.21.15.27:0/2825904449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed6c0b9c50 msgr2=0x7fed6c0ba020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 --2- 172.21.15.27:0/2825904449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed6c0b9c50 0x7fed6c0ba020 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0badd0 tx=0x7fed54009250 comp rx=0 tx=0).stop 2023-10-06T03:00:01.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 -- 172.21.15.27:0/2825904449 shutdown_connections 2023-10-06T03:00:01.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 --2- 172.21.15.27:0/2825904449 >> v2:172.21.15.123:3300/0 conn(0x7fed6c0bb2c0 0x7fed6c0a3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 --2- 172.21.15.27:0/2825904449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed6c0b9c50 0x7fed6c0ba020 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 -- 172.21.15.27:0/2825904449 >> 172.21.15.27:0/2825904449 conn(0x7fed6c06eb10 msgr2=0x7fed6c0ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:01.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 -- 172.21.15.27:0/2825904449 shutdown_connections 2023-10-06T03:00:01.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.399+0000 7fed6bfff700 1 -- 172.21.15.27:0/2825904449 wait complete. 2023-10-06T03:00:01.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6bfff700 1 Processor -- start 2023-10-06T03:00:01.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6bfff700 1 -- start start 2023-10-06T03:00:01.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed6c06c910 0x7fed6c163770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed6c0b9c50 0x7fed6c1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed6c0bb2c0 0x7fed6c145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6bfff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c068d70 con 0x7fed6c0bb2c0 2023-10-06T03:00:01.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6bfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c163cb0 con 0x7fed6c0b9c50 2023-10-06T03:00:01.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6bfff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0686f0 con 0x7fed6c06c910 2023-10-06T03:00:01.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed6c0b9c50 0x7fed6c1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed6c0bb2c0 0x7fed6c145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6affd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed6c06c910 0x7fed6c163770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6affd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed6c06c910 0x7fed6c163770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.27:54144/0 (socket says 172.21.15.27:54144) 2023-10-06T03:00:01.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6affd700 1 -- 172.21.15.27:0/2888243130 learned_addr learned my addr 172.21.15.27:0/2888243130 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:01.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6b7fe700 1 -- 172.21.15.27:0/2888243130 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed6c06c910 msgr2=0x7fed6c163770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6b7fe700 1 --2- 172.21.15.27:0/2888243130 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed6c06c910 0x7fed6c163770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6b7fe700 1 -- 172.21.15.27:0/2888243130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed6c0b9c50 msgr2=0x7fed6c1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6b7fe700 1 --2- 172.21.15.27:0/2888243130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed6c0b9c50 0x7fed6c1542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6b7fe700 1 -- 172.21.15.27:0/2888243130 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540094f0 con 0x7fed6c0bb2c0 2023-10-06T03:00:01.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6affd700 1 --2- 172.21.15.27:0/2888243130 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed6c06c910 0x7fed6c163770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:01.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6b7fe700 1 --2- 172.21.15.27:0/2888243130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed6c0bb2c0 0x7fed6c145640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00c4b0 tx=0x7fed5c007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed62ffd700 1 -- 172.21.15.27:0/2888243130 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c00ce60 con 0x7fed6c0bb2c0 2023-10-06T03:00:01.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed62ffd700 1 -- 172.21.15.27:0/2888243130 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c011590 con 0x7fed6c0bb2c0 2023-10-06T03:00:01.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6bfff700 1 -- 172.21.15.27:0/2888243130 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6c154800 con 0x7fed6c0bb2c0 2023-10-06T03:00:01.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed62ffd700 1 -- 172.21.15.27:0/2888243130 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c011950 con 0x7fed6c0bb2c0 2023-10-06T03:00:01.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.403+0000 7fed6bfff700 1 -- 172.21.15.27:0/2888243130 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6c14b8c0 con 0x7fed6c0bb2c0 2023-10-06T03:00:01.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.407+0000 7fed6bfff700 1 -- 172.21.15.27:0/2888243130 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6c068550 con 0x7fed6c0bb2c0 2023-10-06T03:00:01.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.407+0000 7fed62ffd700 1 -- 172.21.15.27:0/2888243130 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fed5c011cc0 con 0x7fed6c0bb2c0 2023-10-06T03:00:01.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.407+0000 7fed62ffd700 1 --2- 172.21.15.27:0/2888243130 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fed4c060550 0x7fed4c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.407+0000 7fed62ffd700 1 -- 172.21.15.27:0/2888243130 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fed5c07bc70 con 0x7fed6c0bb2c0 2023-10-06T03:00:01.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.407+0000 7fed6affd700 1 --2- 172.21.15.27:0/2888243130 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fed4c060550 0x7fed4c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.411+0000 7fed6affd700 1 --2- 172.21.15.27:0/2888243130 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fed4c060550 0x7fed4c062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fed5400c010 tx=0x7fed54017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.415+0000 7fed62ffd700 1 -- 172.21.15.27:0/2888243130 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fed6c068550 con 0x7fed6c0bb2c0 2023-10-06T03:00:01.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.563+0000 7fed6bfff700 1 -- 172.21.15.27:0/2888243130 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed6c068b30 con 0x7fed4c060550 2023-10-06T03:00:01.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.583+0000 7fed62ffd700 1 -- 172.21.15.27:0/2888243130 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286527 (secure 0 0 0) 0x7fed6c068b30 con 0x7fed4c060550 2023-10-06T03:00:01.592 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:00:01.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.587+0000 7fed6bfff700 1 -- 172.21.15.27:0/2888243130 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fed4c060550 msgr2=0x7fed4c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.587+0000 7fed6bfff700 1 --2- 172.21.15.27:0/2888243130 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fed4c060550 0x7fed4c062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fed5400c010 tx=0x7fed54017000 comp rx=0 tx=0).stop 2023-10-06T03:00:01.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.587+0000 7fed6bfff700 1 -- 172.21.15.27:0/2888243130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed6c0bb2c0 msgr2=0x7fed6c145640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.587+0000 7fed6bfff700 1 --2- 172.21.15.27:0/2888243130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed6c0bb2c0 0x7fed6c145640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00c4b0 tx=0x7fed5c007e60 comp rx=0 tx=0).stop 2023-10-06T03:00:01.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.587+0000 7fed6bfff700 1 -- 172.21.15.27:0/2888243130 shutdown_connections 2023-10-06T03:00:01.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.587+0000 7fed6bfff700 1 --2- 172.21.15.27:0/2888243130 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fed4c060550 0x7fed4c062a00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.587+0000 7fed6bfff700 1 --2- 172.21.15.27:0/2888243130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed6c0bb2c0 0x7fed6c145640 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.587+0000 7fed6bfff700 1 --2- 172.21.15.27:0/2888243130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed6c0b9c50 0x7fed6c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.587+0000 7fed6bfff700 1 --2- 172.21.15.27:0/2888243130 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed6c06c910 0x7fed6c163770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.587+0000 7fed6bfff700 1 -- 172.21.15.27:0/2888243130 >> 172.21.15.27:0/2888243130 conn(0x7fed6c06eb10 msgr2=0x7fed6c09f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:01.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.587+0000 7fed6bfff700 1 -- 172.21.15.27:0/2888243130 shutdown_connections 2023-10-06T03:00:01.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.587+0000 7fed6bfff700 1 -- 172.21.15.27:0/2888243130 wait complete. 2023-10-06T03:00:01.596 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-10-06T03:00:01.607 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-06T03:00:00.963186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381512,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593208,"statfs":{"total":773094113280,"available":770655444992,"internally_reserved":0,"allocated":3284992,"data_stored":1937172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.690814"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684810+0000","last_change":"2023-10-06T02:59:53.681789+0000","last_active":"2023-10-06T02:59:53.684810+0000","last_peered":"2023-10-06T02:59:53.684810+0000","last_clean":"2023-10-06T02:59:53.684810+0000","last_became_active":"2023-10-06T02:59:53.681495+0000","last_became_peered":"2023-10-06T02:59:53.681495+0000","last_unstale":"2023-10-06T02:59:53.684810+0000","last_undegraded":"2023-10-06T02:59:53.684810+0000","last_fullsized":"2023-10-06T02:59:53.684810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:19.626429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.685709+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T02:59:53.685709+0000","last_peered":"2023-10-06T02:59:53.685709+0000","last_clean":"2023-10-06T02:59:53.685709+0000","last_became_active":"2023-10-06T02:59:53.681849+0000","last_became_peered":"2023-10-06T02:59:53.681849+0000","last_unstale":"2023-10-06T02:59:53.685709+0000","last_undegraded":"2023-10-06T02:59:53.685709+0000","last_fullsized":"2023-10-06T02:59:53.685709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684784+0000","last_change":"2023-10-06T02:59:53.679536+0000","last_active":"2023-10-06T02:59:53.684784+0000","last_peered":"2023-10-06T02:59:53.684784+0000","last_clean":"2023-10-06T02:59:53.684784+0000","last_became_active":"2023-10-06T02:59:53.678264+0000","last_became_peered":"2023-10-06T02:59:53.678264+0000","last_unstale":"2023-10-06T02:59:53.684784+0000","last_undegraded":"2023-10-06T02:59:53.684784+0000","last_fullsized":"2023-10-06T02:59:53.684784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:18.566933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.678088+0000","last_change":"2023-10-06T02:59:53.671821+0000","last_active":"2023-10-06T02:59:53.678088+0000","last_peered":"2023-10-06T02:59:53.678088+0000","last_clean":"2023-10-06T02:59:53.678088+0000","last_became_active":"2023-10-06T02:59:53.671555+0000","last_became_peered":"2023-10-06T02:59:53.671555+0000","last_unstale":"2023-10-06T02:59:53.678088+0000","last_undegraded":"2023-10-06T02:59:53.678088+0000","last_fullsized":"2023-10-06T02:59:53.678088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:36:28.006545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684527+0000","last_change":"2023-10-06T02:59:53.682691+0000","last_active":"2023-10-06T02:59:53.684527+0000","last_peered":"2023-10-06T02:59:53.684527+0000","last_clean":"2023-10-06T02:59:53.684527+0000","last_became_active":"2023-10-06T02:59:53.682399+0000","last_became_peered":"2023-10-06T02:59:53.682399+0000","last_unstale":"2023-10-06T02:59:53.684527+0000","last_undegraded":"2023-10-06T02:59:53.684527+0000","last_fullsized":"2023-10-06T02:59:53.684527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683184+0000","last_change":"2023-10-06T02:59:53.678208+0000","last_active":"2023-10-06T02:59:53.683184+0000","last_peered":"2023-10-06T02:59:53.683184+0000","last_clean":"2023-10-06T02:59:53.683184+0000","last_became_active":"2023-10-06T02:59:53.676481+0000","last_became_peered":"2023-10-06T02:59:53.676481+0000","last_unstale":"2023-10-06T02:59:53.683184+0000","last_undegraded":"2023-10-06T02:59:53.683184+0000","last_fullsized":"2023-10-06T02:59:53.683184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:42.767531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688401+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T02:59:53.688401+0000","last_peered":"2023-10-06T02:59:53.688401+0000","last_clean":"2023-10-06T02:59:53.688401+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T02:59:53.688401+0000","last_undegraded":"2023-10-06T02:59:53.688401+0000","last_fullsized":"2023-10-06T02:59:53.688401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688329+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T02:59:53.688329+0000","last_peered":"2023-10-06T02:59:53.688329+0000","last_clean":"2023-10-06T02:59:53.688329+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T02:59:53.688329+0000","last_undegraded":"2023-10-06T02:59:53.688329+0000","last_fullsized":"2023-10-06T02:59:53.688329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682066+0000","last_change":"2023-10-06T02:59:53.680395+0000","last_active":"2023-10-06T02:59:53.682066+0000","last_peered":"2023-10-06T02:59:53.682066+0000","last_clean":"2023-10-06T02:59:53.682066+0000","last_became_active":"2023-10-06T02:59:53.680086+0000","last_became_peered":"2023-10-06T02:59:53.680086+0000","last_unstale":"2023-10-06T02:59:53.682066+0000","last_undegraded":"2023-10-06T02:59:53.682066+0000","last_fullsized":"2023-10-06T02:59:53.682066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.680410+0000","last_change":"2023-10-06T02:59:53.675582+0000","last_active":"2023-10-06T02:59:53.680410+0000","last_peered":"2023-10-06T02:59:53.680410+0000","last_clean":"2023-10-06T02:59:53.680410+0000","last_became_active":"2023-10-06T02:59:53.675243+0000","last_became_peered":"2023-10-06T02:59:53.675243+0000","last_unstale":"2023-10-06T02:59:53.680410+0000","last_undegraded":"2023-10-06T02:59:53.680410+0000","last_fullsized":"2023-10-06T02:59:53.680410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684759+0000","last_change":"2023-10-06T02:59:53.679489+0000","last_active":"2023-10-06T02:59:53.684759+0000","last_peered":"2023-10-06T02:59:53.684759+0000","last_clean":"2023-10-06T02:59:53.684759+0000","last_became_active":"2023-10-06T02:59:53.678985+0000","last_became_peered":"2023-10-06T02:59:53.678985+0000","last_unstale":"2023-10-06T02:59:53.684759+0000","last_undegraded":"2023-10-06T02:59:53.684759+0000","last_fullsized":"2023-10-06T02:59:53.684759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:12.576010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684951+0000","last_change":"2023-10-06T02:59:53.682799+0000","last_active":"2023-10-06T02:59:53.684951+0000","last_peered":"2023-10-06T02:59:53.684951+0000","last_clean":"2023-10-06T02:59:53.684951+0000","last_became_active":"2023-10-06T02:59:53.682464+0000","last_became_peered":"2023-10-06T02:59:53.682464+0000","last_unstale":"2023-10-06T02:59:53.684951+0000","last_undegraded":"2023-10-06T02:59:53.684951+0000","last_fullsized":"2023-10-06T02:59:53.684951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:06.403449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683827+0000","last_change":"2023-10-06T02:59:53.678968+0000","last_active":"2023-10-06T02:59:53.683827+0000","last_peered":"2023-10-06T02:59:53.683827+0000","last_clean":"2023-10-06T02:59:53.683827+0000","last_became_active":"2023-10-06T02:59:53.678562+0000","last_became_peered":"2023-10-06T02:59:53.678562+0000","last_unstale":"2023-10-06T02:59:53.683827+0000","last_undegraded":"2023-10-06T02:59:53.683827+0000","last_fullsized":"2023-10-06T02:59:53.683827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:46.305158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.674814+0000","last_change":"2023-10-06T02:59:53.673321+0000","last_active":"2023-10-06T02:59:53.674814+0000","last_peered":"2023-10-06T02:59:53.674814+0000","last_clean":"2023-10-06T02:59:53.674814+0000","last_became_active":"2023-10-06T02:59:53.672957+0000","last_became_peered":"2023-10-06T02:59:53.672957+0000","last_unstale":"2023-10-06T02:59:53.674814+0000","last_undegraded":"2023-10-06T02:59:53.674814+0000","last_fullsized":"2023-10-06T02:59:53.674814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.689370+0000","last_change":"2023-10-06T02:59:53.686669+0000","last_active":"2023-10-06T02:59:53.689370+0000","last_peered":"2023-10-06T02:59:53.689370+0000","last_clean":"2023-10-06T02:59:53.689370+0000","last_became_active":"2023-10-06T02:59:53.686352+0000","last_became_peered":"2023-10-06T02:59:53.686352+0000","last_unstale":"2023-10-06T02:59:53.689370+0000","last_undegraded":"2023-10-06T02:59:53.689370+0000","last_fullsized":"2023-10-06T02:59:53.689370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684827+0000","last_change":"2023-10-06T02:59:53.680975+0000","last_active":"2023-10-06T02:59:53.684827+0000","last_peered":"2023-10-06T02:59:53.684827+0000","last_clean":"2023-10-06T02:59:53.684827+0000","last_became_active":"2023-10-06T02:59:53.678449+0000","last_became_peered":"2023-10-06T02:59:53.678449+0000","last_unstale":"2023-10-06T02:59:53.684827+0000","last_undegraded":"2023-10-06T02:59:53.684827+0000","last_fullsized":"2023-10-06T02:59:53.684827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:18.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682046+0000","last_change":"2023-10-06T02:59:53.680344+0000","last_active":"2023-10-06T02:59:53.682046+0000","last_peered":"2023-10-06T02:59:53.682046+0000","last_clean":"2023-10-06T02:59:53.682046+0000","last_became_active":"2023-10-06T02:59:53.680028+0000","last_became_peered":"2023-10-06T02:59:53.680028+0000","last_unstale":"2023-10-06T02:59:53.682046+0000","last_undegraded":"2023-10-06T02:59:53.682046+0000","last_fullsized":"2023-10-06T02:59:53.682046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682183+0000","last_change":"2023-10-06T02:59:53.678143+0000","last_active":"2023-10-06T02:59:53.682183+0000","last_peered":"2023-10-06T02:59:53.682183+0000","last_clean":"2023-10-06T02:59:53.682183+0000","last_became_active":"2023-10-06T02:59:53.676602+0000","last_became_peered":"2023-10-06T02:59:53.676602+0000","last_unstale":"2023-10-06T02:59:53.682183+0000","last_undegraded":"2023-10-06T02:59:53.682183+0000","last_fullsized":"2023-10-06T02:59:53.682183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:29.621147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.677525+0000","last_change":"2023-10-06T02:59:53.675935+0000","last_active":"2023-10-06T02:59:53.677525+0000","last_peered":"2023-10-06T02:59:53.677525+0000","last_clean":"2023-10-06T02:59:53.677525+0000","last_became_active":"2023-10-06T02:59:53.675657+0000","last_became_peered":"2023-10-06T02:59:53.675657+0000","last_unstale":"2023-10-06T02:59:53.677525+0000","last_undegraded":"2023-10-06T02:59:53.677525+0000","last_fullsized":"2023-10-06T02:59:53.677525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:56.862647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681975+0000","last_change":"2023-10-06T02:59:53.673043+0000","last_active":"2023-10-06T02:59:53.681975+0000","last_peered":"2023-10-06T02:59:53.681975+0000","last_clean":"2023-10-06T02:59:53.681975+0000","last_became_active":"2023-10-06T02:59:53.672690+0000","last_became_peered":"2023-10-06T02:59:53.672690+0000","last_unstale":"2023-10-06T02:59:53.681975+0000","last_undegraded":"2023-10-06T02:59:53.681975+0000","last_fullsized":"2023-10-06T02:59:53.681975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688445+0000","last_change":"2023-10-06T02:59:53.684492+0000","last_active":"2023-10-06T02:59:53.688445+0000","last_peered":"2023-10-06T02:59:53.688445+0000","last_clean":"2023-10-06T02:59:53.688445+0000","last_became_active":"2023-10-06T02:59:53.684145+0000","last_became_peered":"2023-10-06T02:59:53.684145+0000","last_unstale":"2023-10-06T02:59:53.688445+0000","last_undegraded":"2023-10-06T02:59:53.688445+0000","last_fullsized":"2023-10-06T02:59:53.688445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687097+0000","last_change":"2023-10-06T02:59:53.683256+0000","last_active":"2023-10-06T02:59:53.687097+0000","last_peered":"2023-10-06T02:59:53.687097+0000","last_clean":"2023-10-06T02:59:53.687097+0000","last_became_active":"2023-10-06T02:59:53.682948+0000","last_became_peered":"2023-10-06T02:59:53.682948+0000","last_unstale":"2023-10-06T02:59:53.687097+0000","last_undegraded":"2023-10-06T02:59:53.687097+0000","last_fullsized":"2023-10-06T02:59:53.687097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681303+0000","last_change":"2023-10-06T02:59:53.675936+0000","last_active":"2023-10-06T02:59:53.681303+0000","last_peered":"2023-10-06T02:59:53.681303+0000","last_clean":"2023-10-06T02:59:53.681303+0000","last_became_active":"2023-10-06T02:59:53.675319+0000","last_became_peered":"2023-10-06T02:59:53.675319+0000","last_unstale":"2023-10-06T02:59:53.681303+0000","last_undegraded":"2023-10-06T02:59:53.681303+0000","last_fullsized":"2023-10-06T02:59:53.681303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.689381+0000","last_change":"2023-10-06T02:59:53.686758+0000","last_active":"2023-10-06T02:59:53.689381+0000","last_peered":"2023-10-06T02:59:53.689381+0000","last_clean":"2023-10-06T02:59:53.689381+0000","last_became_active":"2023-10-06T02:59:53.686007+0000","last_became_peered":"2023-10-06T02:59:53.686007+0000","last_unstale":"2023-10-06T02:59:53.689381+0000","last_undegraded":"2023-10-06T02:59:53.689381+0000","last_fullsized":"2023-10-06T02:59:53.689381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.686023+0000","last_change":"2023-10-06T02:59:53.682853+0000","last_active":"2023-10-06T02:59:53.686023+0000","last_peered":"2023-10-06T02:59:53.686023+0000","last_clean":"2023-10-06T02:59:53.686023+0000","last_became_active":"2023-10-06T02:59:53.682511+0000","last_became_peered":"2023-10-06T02:59:53.682511+0000","last_unstale":"2023-10-06T02:59:53.686023+0000","last_undegraded":"2023-10-06T02:59:53.686023+0000","last_fullsized":"2023-10-06T02:59:53.686023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.685842+0000","last_change":"2023-10-06T02:59:53.682001+0000","last_active":"2023-10-06T02:59:53.685842+0000","last_peered":"2023-10-06T02:59:53.685842+0000","last_clean":"2023-10-06T02:59:53.685842+0000","last_became_active":"2023-10-06T02:59:53.681732+0000","last_became_peered":"2023-10-06T02:59:53.681732+0000","last_unstale":"2023-10-06T02:59:53.685842+0000","last_undegraded":"2023-10-06T02:59:53.685842+0000","last_fullsized":"2023-10-06T02:59:53.685842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.680523+0000","last_change":"2023-10-06T02:59:53.676598+0000","last_active":"2023-10-06T02:59:53.680523+0000","last_peered":"2023-10-06T02:59:53.680523+0000","last_clean":"2023-10-06T02:59:53.680523+0000","last_became_active":"2023-10-06T02:59:53.676284+0000","last_became_peered":"2023-10-06T02:59:53.676284+0000","last_unstale":"2023-10-06T02:59:53.680523+0000","last_undegraded":"2023-10-06T02:59:53.680523+0000","last_fullsized":"2023-10-06T02:59:53.680523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.690178+0000","last_change":"2023-10-06T02:59:53.687275+0000","last_active":"2023-10-06T02:59:53.690178+0000","last_peered":"2023-10-06T02:59:53.690178+0000","last_clean":"2023-10-06T02:59:53.690178+0000","last_became_active":"2023-10-06T02:59:53.686912+0000","last_became_peered":"2023-10-06T02:59:53.686912+0000","last_unstale":"2023-10-06T02:59:53.690178+0000","last_undegraded":"2023-10-06T02:59:53.690178+0000","last_fullsized":"2023-10-06T02:59:53.690178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687065+0000","last_change":"2023-10-06T02:59:53.685421+0000","last_active":"2023-10-06T02:59:53.687065+0000","last_peered":"2023-10-06T02:59:53.687065+0000","last_clean":"2023-10-06T02:59:53.687065+0000","last_became_active":"2023-10-06T02:59:53.684806+0000","last_became_peered":"2023-10-06T02:59:53.684806+0000","last_unstale":"2023-10-06T02:59:53.687065+0000","last_undegraded":"2023-10-06T02:59:53.687065+0000","last_fullsized":"2023-10-06T02:59:53.687065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682303+0000","last_change":"2023-10-06T02:59:53.676085+0000","last_active":"2023-10-06T02:59:53.682303+0000","last_peered":"2023-10-06T02:59:53.682303+0000","last_clean":"2023-10-06T02:59:53.682303+0000","last_became_active":"2023-10-06T02:59:53.675718+0000","last_became_peered":"2023-10-06T02:59:53.675718+0000","last_unstale":"2023-10-06T02:59:53.682303+0000","last_undegraded":"2023-10-06T02:59:53.682303+0000","last_fullsized":"2023-10-06T02:59:53.682303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:00.548441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681322+0000","last_change":"2023-10-06T02:59:53.676118+0000","last_active":"2023-10-06T02:59:53.681322+0000","last_peered":"2023-10-06T02:59:53.681322+0000","last_clean":"2023-10-06T02:59:53.681322+0000","last_became_active":"2023-10-06T02:59:53.675682+0000","last_became_peered":"2023-10-06T02:59:53.675682+0000","last_unstale":"2023-10-06T02:59:53.681322+0000","last_undegraded":"2023-10-06T02:59:53.681322+0000","last_fullsized":"2023-10-06T02:59:53.681322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.678043+0000","last_change":"2023-10-06T02:59:53.673225+0000","last_active":"2023-10-06T02:59:53.678043+0000","last_peered":"2023-10-06T02:59:53.678043+0000","last_clean":"2023-10-06T02:59:53.678043+0000","last_became_active":"2023-10-06T02:59:53.672930+0000","last_became_peered":"2023-10-06T02:59:53.672930+0000","last_unstale":"2023-10-06T02:59:53.678043+0000","last_undegraded":"2023-10-06T02:59:53.678043+0000","last_fullsized":"2023-10-06T02:59:53.678043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:02.845187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683926+0000","last_change":"2023-10-06T02:59:53.678742+0000","last_active":"2023-10-06T02:59:53.683926+0000","last_peered":"2023-10-06T02:59:53.683926+0000","last_clean":"2023-10-06T02:59:53.683926+0000","last_became_active":"2023-10-06T02:59:53.678471+0000","last_became_peered":"2023-10-06T02:59:53.678471+0000","last_unstale":"2023-10-06T02:59:53.683926+0000","last_undegraded":"2023-10-06T02:59:53.683926+0000","last_fullsized":"2023-10-06T02:59:53.683926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292803+0000","last_change":"2023-10-06T02:59:53.297136+0000","last_active":"2023-10-06T02:59:54.292803+0000","last_peered":"2023-10-06T02:59:54.292803+0000","last_clean":"2023-10-06T02:59:54.292803+0000","last_became_active":"2023-10-06T02:59:53.296816+0000","last_became_peered":"2023-10-06T02:59:53.296816+0000","last_unstale":"2023-10-06T02:59:54.292803+0000","last_undegraded":"2023-10-06T02:59:54.292803+0000","last_fullsized":"2023-10-06T02:59:54.292803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:58.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688369+0000","last_change":"2023-10-06T02:59:53.684876+0000","last_active":"2023-10-06T02:59:53.688369+0000","last_peered":"2023-10-06T02:59:53.688369+0000","last_clean":"2023-10-06T02:59:53.688369+0000","last_became_active":"2023-10-06T02:59:53.684522+0000","last_became_peered":"2023-10-06T02:59:53.684522+0000","last_unstale":"2023-10-06T02:59:53.688369+0000","last_undegraded":"2023-10-06T02:59:53.688369+0000","last_fullsized":"2023-10-06T02:59:53.688369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668295+0000","last_change":"2023-10-06T02:59:53.292700+0000","last_active":"2023-10-06T02:59:53.668295+0000","last_peered":"2023-10-06T02:59:53.668295+0000","last_clean":"2023-10-06T02:59:53.668295+0000","last_became_active":"2023-10-06T02:59:53.292378+0000","last_became_peered":"2023-10-06T02:59:53.292378+0000","last_unstale":"2023-10-06T02:59:53.668295+0000","last_undegraded":"2023-10-06T02:59:53.668295+0000","last_fullsized":"2023-10-06T02:59:53.668295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.677456+0000","last_change":"2023-10-06T02:59:53.675542+0000","last_active":"2023-10-06T02:59:53.677456+0000","last_peered":"2023-10-06T02:59:53.677456+0000","last_clean":"2023-10-06T02:59:53.677456+0000","last_became_active":"2023-10-06T02:59:53.675219+0000","last_became_peered":"2023-10-06T02:59:53.675219+0000","last_unstale":"2023-10-06T02:59:53.677456+0000","last_undegraded":"2023-10-06T02:59:53.677456+0000","last_fullsized":"2023-10-06T02:59:53.677456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.670933+0000","last_change":"2023-10-06T02:59:53.302122+0000","last_active":"2023-10-06T02:59:53.670933+0000","last_peered":"2023-10-06T02:59:53.670933+0000","last_clean":"2023-10-06T02:59:53.670933+0000","last_became_active":"2023-10-06T02:59:53.301737+0000","last_became_peered":"2023-10-06T02:59:53.301737+0000","last_unstale":"2023-10-06T02:59:53.670933+0000","last_undegraded":"2023-10-06T02:59:53.670933+0000","last_fullsized":"2023-10-06T02:59:53.670933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.686222+0000","last_change":"2023-10-06T02:59:53.684854+0000","last_active":"2023-10-06T02:59:53.686222+0000","last_peered":"2023-10-06T02:59:53.686222+0000","last_clean":"2023-10-06T02:59:53.686222+0000","last_became_active":"2023-10-06T02:59:53.684527+0000","last_became_peered":"2023-10-06T02:59:53.684527+0000","last_unstale":"2023-10-06T02:59:53.686222+0000","last_undegraded":"2023-10-06T02:59:53.686222+0000","last_fullsized":"2023-10-06T02:59:53.686222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.295747+0000","last_change":"2023-10-06T02:59:53.294103+0000","last_active":"2023-10-06T02:59:54.295747+0000","last_peered":"2023-10-06T02:59:54.295747+0000","last_clean":"2023-10-06T02:59:54.295747+0000","last_became_active":"2023-10-06T02:59:53.293707+0000","last_became_peered":"2023-10-06T02:59:53.293707+0000","last_unstale":"2023-10-06T02:59:54.295747+0000","last_undegraded":"2023-10-06T02:59:54.295747+0000","last_fullsized":"2023-10-06T02:59:54.295747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292846+0000","last_change":"2023-10-06T02:59:53.296507+0000","last_active":"2023-10-06T02:59:54.292846+0000","last_peered":"2023-10-06T02:59:54.292846+0000","last_clean":"2023-10-06T02:59:54.292846+0000","last_became_active":"2023-10-06T02:59:53.296230+0000","last_became_peered":"2023-10-06T02:59:53.296230+0000","last_unstale":"2023-10-06T02:59:54.292846+0000","last_undegraded":"2023-10-06T02:59:54.292846+0000","last_fullsized":"2023-10-06T02:59:54.292846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688349+0000","last_change":"2023-10-06T02:59:53.684046+0000","last_active":"2023-10-06T02:59:53.688349+0000","last_peered":"2023-10-06T02:59:53.688349+0000","last_clean":"2023-10-06T02:59:53.688349+0000","last_became_active":"2023-10-06T02:59:53.683705+0000","last_became_peered":"2023-10-06T02:59:53.683705+0000","last_unstale":"2023-10-06T02:59:53.688349+0000","last_undegraded":"2023-10-06T02:59:53.688349+0000","last_fullsized":"2023-10-06T02:59:53.688349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292725+0000","last_change":"2023-10-06T02:59:53.296465+0000","last_active":"2023-10-06T02:59:54.292725+0000","last_peered":"2023-10-06T02:59:54.292725+0000","last_clean":"2023-10-06T02:59:54.292725+0000","last_became_active":"2023-10-06T02:59:53.296225+0000","last_became_peered":"2023-10-06T02:59:53.296225+0000","last_unstale":"2023-10-06T02:59:54.292725+0000","last_undegraded":"2023-10-06T02:59:54.292725+0000","last_fullsized":"2023-10-06T02:59:54.292725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.688679+0000","last_change":"2023-10-06T02:59:53.683216+0000","last_active":"2023-10-06T02:59:53.688679+0000","last_peered":"2023-10-06T02:59:53.688679+0000","last_clean":"2023-10-06T02:59:53.688679+0000","last_became_active":"2023-10-06T02:59:53.682938+0000","last_became_peered":"2023-10-06T02:59:53.682938+0000","last_unstale":"2023-10-06T02:59:53.688679+0000","last_undegraded":"2023-10-06T02:59:53.688679+0000","last_fullsized":"2023-10-06T02:59:53.688679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292905+0000","last_change":"2023-10-06T02:59:53.293929+0000","last_active":"2023-10-06T02:59:54.292905+0000","last_peered":"2023-10-06T02:59:54.292905+0000","last_clean":"2023-10-06T02:59:54.292905+0000","last_became_active":"2023-10-06T02:59:53.293602+0000","last_became_peered":"2023-10-06T02:59:53.293602+0000","last_unstale":"2023-10-06T02:59:54.292905+0000","last_undegraded":"2023-10-06T02:59:54.292905+0000","last_fullsized":"2023-10-06T02:59:54.292905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.677911+0000","last_change":"2023-10-06T02:59:53.672111+0000","last_active":"2023-10-06T02:59:53.677911+0000","last_peered":"2023-10-06T02:59:53.677911+0000","last_clean":"2023-10-06T02:59:53.677911+0000","last_became_active":"2023-10-06T02:59:53.671511+0000","last_became_peered":"2023-10-06T02:59:53.671511+0000","last_unstale":"2023-10-06T02:59:53.677911+0000","last_undegraded":"2023-10-06T02:59:53.677911+0000","last_fullsized":"2023-10-06T02:59:53.677911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668804+0000","last_change":"2023-10-06T02:59:53.300059+0000","last_active":"2023-10-06T02:59:53.668804+0000","last_peered":"2023-10-06T02:59:53.668804+0000","last_clean":"2023-10-06T02:59:53.668804+0000","last_became_active":"2023-10-06T02:59:53.299715+0000","last_became_peered":"2023-10-06T02:59:53.299715+0000","last_unstale":"2023-10-06T02:59:53.668804+0000","last_undegraded":"2023-10-06T02:59:53.668804+0000","last_fullsized":"2023-10-06T02:59:53.668804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687172+0000","last_change":"2023-10-06T02:59:53.683331+0000","last_active":"2023-10-06T02:59:53.687172+0000","last_peered":"2023-10-06T02:59:53.687172+0000","last_clean":"2023-10-06T02:59:53.687172+0000","last_became_active":"2023-10-06T02:59:53.682994+0000","last_became_peered":"2023-10-06T02:59:53.682994+0000","last_unstale":"2023-10-06T02:59:53.687172+0000","last_undegraded":"2023-10-06T02:59:53.687172+0000","last_fullsized":"2023-10-06T02:59:53.687172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.288613+0000","last_change":"2023-10-06T02:59:53.301126+0000","last_active":"2023-10-06T02:59:54.288613+0000","last_peered":"2023-10-06T02:59:54.288613+0000","last_clean":"2023-10-06T02:59:54.288613+0000","last_became_active":"2023-10-06T02:59:53.300850+0000","last_became_peered":"2023-10-06T02:59:53.300850+0000","last_unstale":"2023-10-06T02:59:54.288613+0000","last_undegraded":"2023-10-06T02:59:54.288613+0000","last_fullsized":"2023-10-06T02:59:54.288613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684480+0000","last_change":"2023-10-06T02:59:53.678930+0000","last_active":"2023-10-06T02:59:53.684480+0000","last_peered":"2023-10-06T02:59:53.684480+0000","last_clean":"2023-10-06T02:59:53.684480+0000","last_became_active":"2023-10-06T02:59:53.678630+0000","last_became_peered":"2023-10-06T02:59:53.678630+0000","last_unstale":"2023-10-06T02:59:53.684480+0000","last_undegraded":"2023-10-06T02:59:53.684480+0000","last_fullsized":"2023-10-06T02:59:53.684480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:14.961350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.662824+0000","last_change":"2023-10-06T02:59:53.291521+0000","last_active":"2023-10-06T02:59:53.662824+0000","last_peered":"2023-10-06T02:59:53.662824+0000","last_clean":"2023-10-06T02:59:53.662824+0000","last_became_active":"2023-10-06T02:59:53.290773+0000","last_became_peered":"2023-10-06T02:59:53.290773+0000","last_unstale":"2023-10-06T02:59:53.662824+0000","last_undegraded":"2023-10-06T02:59:53.662824+0000","last_fullsized":"2023-10-06T02:59:53.662824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682164+0000","last_change":"2023-10-06T02:59:53.678188+0000","last_active":"2023-10-06T02:59:53.682164+0000","last_peered":"2023-10-06T02:59:53.682164+0000","last_clean":"2023-10-06T02:59:53.682164+0000","last_became_active":"2023-10-06T02:59:53.676507+0000","last_became_peered":"2023-10-06T02:59:53.676507+0000","last_unstale":"2023-10-06T02:59:53.682164+0000","last_undegraded":"2023-10-06T02:59:53.682164+0000","last_fullsized":"2023-10-06T02:59:53.682164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.672575+0000","last_change":"2023-10-06T02:59:53.289980+0000","last_active":"2023-10-06T02:59:53.672575+0000","last_peered":"2023-10-06T02:59:53.672575+0000","last_clean":"2023-10-06T02:59:53.672575+0000","last_became_active":"2023-10-06T02:59:53.288601+0000","last_became_peered":"2023-10-06T02:59:53.288601+0000","last_unstale":"2023-10-06T02:59:53.672575+0000","last_undegraded":"2023-10-06T02:59:53.672575+0000","last_fullsized":"2023-10-06T02:59:53.672575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:54.630392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681947+0000","last_change":"2023-10-06T02:59:53.675456+0000","last_active":"2023-10-06T02:59:53.681947+0000","last_peered":"2023-10-06T02:59:53.681947+0000","last_clean":"2023-10-06T02:59:53.681947+0000","last_became_active":"2023-10-06T02:59:53.673268+0000","last_became_peered":"2023-10-06T02:59:53.673268+0000","last_unstale":"2023-10-06T02:59:53.681947+0000","last_undegraded":"2023-10-06T02:59:53.681947+0000","last_fullsized":"2023-10-06T02:59:53.681947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.658166+0000","last_change":"2023-10-06T02:59:53.298398+0000","last_active":"2023-10-06T02:59:53.658166+0000","last_peered":"2023-10-06T02:59:53.658166+0000","last_clean":"2023-10-06T02:59:53.658166+0000","last_became_active":"2023-10-06T02:59:53.297896+0000","last_became_peered":"2023-10-06T02:59:53.297896+0000","last_unstale":"2023-10-06T02:59:53.658166+0000","last_undegraded":"2023-10-06T02:59:53.658166+0000","last_fullsized":"2023-10-06T02:59:53.658166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684745+0000","last_change":"2023-10-06T02:59:53.679712+0000","last_active":"2023-10-06T02:59:53.684745+0000","last_peered":"2023-10-06T02:59:53.684745+0000","last_clean":"2023-10-06T02:59:53.684745+0000","last_became_active":"2023-10-06T02:59:53.679390+0000","last_became_peered":"2023-10-06T02:59:53.679390+0000","last_unstale":"2023-10-06T02:59:53.684745+0000","last_undegraded":"2023-10-06T02:59:53.684745+0000","last_fullsized":"2023-10-06T02:59:53.684745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.674991+0000","last_change":"2023-10-06T02:59:44.074625+0000","last_active":"2023-10-06T02:59:53.674991+0000","last_peered":"2023-10-06T02:59:53.674991+0000","last_clean":"2023-10-06T02:59:53.674991+0000","last_became_active":"2023-10-06T02:59:44.072854+0000","last_became_peered":"2023-10-06T02:59:44.072854+0000","last_unstale":"2023-10-06T02:59:53.674991+0000","last_undegraded":"2023-10-06T02:59:53.674991+0000","last_fullsized":"2023-10-06T02:59:53.674991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_clean_scrub_stamp":"2023-10-06T02:59:43.039151+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:04.936706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668581+0000","last_change":"2023-10-06T02:59:49.107090+0000","last_active":"2023-10-06T02:59:53.668581+0000","last_peered":"2023-10-06T02:59:53.668581+0000","last_clean":"2023-10-06T02:59:53.668581+0000","last_became_active":"2023-10-06T02:59:49.106619+0000","last_became_peered":"2023-10-06T02:59:49.106619+0000","last_unstale":"2023-10-06T02:59:53.668581+0000","last_undegraded":"2023-10-06T02:59:53.668581+0000","last_fullsized":"2023-10-06T02:59:53.668581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.658030+0000","last_change":"2023-10-06T02:59:53.298769+0000","last_active":"2023-10-06T02:59:53.658030+0000","last_peered":"2023-10-06T02:59:53.658030+0000","last_clean":"2023-10-06T02:59:53.658030+0000","last_became_active":"2023-10-06T02:59:53.298012+0000","last_became_peered":"2023-10-06T02:59:53.298012+0000","last_unstale":"2023-10-06T02:59:53.658030+0000","last_undegraded":"2023-10-06T02:59:53.658030+0000","last_fullsized":"2023-10-06T02:59:53.658030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681729+0000","last_change":"2023-10-06T02:59:53.679625+0000","last_active":"2023-10-06T02:59:53.681729+0000","last_peered":"2023-10-06T02:59:53.681729+0000","last_clean":"2023-10-06T02:59:53.681729+0000","last_became_active":"2023-10-06T02:59:53.679200+0000","last_became_peered":"2023-10-06T02:59:53.679200+0000","last_unstale":"2023-10-06T02:59:53.681729+0000","last_undegraded":"2023-10-06T02:59:53.681729+0000","last_fullsized":"2023-10-06T02:59:53.681729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:59.309901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.671317+0000","last_change":"2023-10-06T02:59:49.107231+0000","last_active":"2023-10-06T02:59:53.671317+0000","last_peered":"2023-10-06T02:59:53.671317+0000","last_clean":"2023-10-06T02:59:53.671317+0000","last_became_active":"2023-10-06T02:59:49.106878+0000","last_became_peered":"2023-10-06T02:59:49.106878+0000","last_unstale":"2023-10-06T02:59:53.671317+0000","last_undegraded":"2023-10-06T02:59:53.671317+0000","last_fullsized":"2023-10-06T02:59:53.671317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668411+0000","last_change":"2023-10-06T02:59:53.296937+0000","last_active":"2023-10-06T02:59:53.668411+0000","last_peered":"2023-10-06T02:59:53.668411+0000","last_clean":"2023-10-06T02:59:53.668411+0000","last_became_active":"2023-10-06T02:59:53.296171+0000","last_became_peered":"2023-10-06T02:59:53.296171+0000","last_unstale":"2023-10-06T02:59:53.668411+0000","last_undegraded":"2023-10-06T02:59:53.668411+0000","last_fullsized":"2023-10-06T02:59:53.668411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684479+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T02:59:53.684479+0000","last_peered":"2023-10-06T02:59:53.684479+0000","last_clean":"2023-10-06T02:59:53.684479+0000","last_became_active":"2023-10-06T02:59:53.681786+0000","last_became_peered":"2023-10-06T02:59:53.681786+0000","last_unstale":"2023-10-06T02:59:53.684479+0000","last_undegraded":"2023-10-06T02:59:53.684479+0000","last_fullsized":"2023-10-06T02:59:53.684479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669847+0000","last_change":"2023-10-06T02:59:49.115200+0000","last_active":"2023-10-06T02:59:53.669847+0000","last_peered":"2023-10-06T02:59:53.669847+0000","last_clean":"2023-10-06T02:59:53.669847+0000","last_became_active":"2023-10-06T02:59:49.114769+0000","last_became_peered":"2023-10-06T02:59:49.114769+0000","last_unstale":"2023-10-06T02:59:53.669847+0000","last_undegraded":"2023-10-06T02:59:53.669847+0000","last_fullsized":"2023-10-06T02:59:53.669847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:37.773233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.665174+0000","last_change":"2023-10-06T02:59:53.298658+0000","last_active":"2023-10-06T02:59:53.665174+0000","last_peered":"2023-10-06T02:59:53.665174+0000","last_clean":"2023-10-06T02:59:53.665174+0000","last_became_active":"2023-10-06T02:59:53.298054+0000","last_became_peered":"2023-10-06T02:59:53.298054+0000","last_unstale":"2023-10-06T02:59:53.665174+0000","last_undegraded":"2023-10-06T02:59:53.665174+0000","last_fullsized":"2023-10-06T02:59:53.665174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681569+0000","last_change":"2023-10-06T02:59:53.673950+0000","last_active":"2023-10-06T02:59:53.681569+0000","last_peered":"2023-10-06T02:59:53.681569+0000","last_clean":"2023-10-06T02:59:53.681569+0000","last_became_active":"2023-10-06T02:59:53.673677+0000","last_became_peered":"2023-10-06T02:59:53.673677+0000","last_unstale":"2023-10-06T02:59:53.681569+0000","last_undegraded":"2023-10-06T02:59:53.681569+0000","last_fullsized":"2023-10-06T02:59:53.681569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668455+0000","last_change":"2023-10-06T02:59:49.107944+0000","last_active":"2023-10-06T02:59:53.668455+0000","last_peered":"2023-10-06T02:59:53.668455+0000","last_clean":"2023-10-06T02:59:53.668455+0000","last_became_active":"2023-10-06T02:59:49.107560+0000","last_became_peered":"2023-10-06T02:59:49.107560+0000","last_unstale":"2023-10-06T02:59:53.668455+0000","last_undegraded":"2023-10-06T02:59:53.668455+0000","last_fullsized":"2023-10-06T02:59:53.668455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.671674+0000","last_change":"2023-10-06T02:59:53.300945+0000","last_active":"2023-10-06T02:59:53.671674+0000","last_peered":"2023-10-06T02:59:53.671674+0000","last_clean":"2023-10-06T02:59:53.671674+0000","last_became_active":"2023-10-06T02:59:53.300609+0000","last_became_peered":"2023-10-06T02:59:53.300609+0000","last_unstale":"2023-10-06T02:59:53.671674+0000","last_undegraded":"2023-10-06T02:59:53.671674+0000","last_fullsized":"2023-10-06T02:59:53.671674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682292+0000","last_change":"2023-10-06T02:59:53.677554+0000","last_active":"2023-10-06T02:59:53.682292+0000","last_peered":"2023-10-06T02:59:53.682292+0000","last_clean":"2023-10-06T02:59:53.682292+0000","last_became_active":"2023-10-06T02:59:53.677245+0000","last_became_peered":"2023-10-06T02:59:53.677245+0000","last_unstale":"2023-10-06T02:59:53.682292+0000","last_undegraded":"2023-10-06T02:59:53.682292+0000","last_fullsized":"2023-10-06T02:59:53.682292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668605+0000","last_change":"2023-10-06T02:59:53.301191+0000","last_active":"2023-10-06T02:59:53.668605+0000","last_peered":"2023-10-06T02:59:53.668605+0000","last_clean":"2023-10-06T02:59:53.668605+0000","last_became_active":"2023-10-06T02:59:53.300919+0000","last_became_peered":"2023-10-06T02:59:53.300919+0000","last_unstale":"2023-10-06T02:59:53.668605+0000","last_undegraded":"2023-10-06T02:59:53.668605+0000","last_fullsized":"2023-10-06T02:59:53.668605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669826+0000","last_change":"2023-10-06T02:59:49.108499+0000","last_active":"2023-10-06T02:59:53.669826+0000","last_peered":"2023-10-06T02:59:53.669826+0000","last_clean":"2023-10-06T02:59:53.669826+0000","last_became_active":"2023-10-06T02:59:49.107967+0000","last_became_peered":"2023-10-06T02:59:49.107967+0000","last_unstale":"2023-10-06T02:59:53.669826+0000","last_undegraded":"2023-10-06T02:59:53.669826+0000","last_fullsized":"2023-10-06T02:59:53.669826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682251+0000","last_change":"2023-10-06T02:59:53.676753+0000","last_active":"2023-10-06T02:59:53.682251+0000","last_peered":"2023-10-06T02:59:53.682251+0000","last_clean":"2023-10-06T02:59:53.682251+0000","last_became_active":"2023-10-06T02:59:53.676385+0000","last_became_peered":"2023-10-06T02:59:53.676385+0000","last_unstale":"2023-10-06T02:59:53.682251+0000","last_undegraded":"2023-10-06T02:59:53.682251+0000","last_fullsized":"2023-10-06T02:59:53.682251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669538+0000","last_change":"2023-10-06T02:59:53.303221+0000","last_active":"2023-10-06T02:59:53.669538+0000","last_peered":"2023-10-06T02:59:53.669538+0000","last_clean":"2023-10-06T02:59:53.669538+0000","last_became_active":"2023-10-06T02:59:53.302890+0000","last_became_peered":"2023-10-06T02:59:53.302890+0000","last_unstale":"2023-10-06T02:59:53.669538+0000","last_undegraded":"2023-10-06T02:59:53.669538+0000","last_fullsized":"2023-10-06T02:59:53.669538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.670899+0000","last_change":"2023-10-06T02:59:49.102005+0000","last_active":"2023-10-06T02:59:53.670899+0000","last_peered":"2023-10-06T02:59:53.670899+0000","last_clean":"2023-10-06T02:59:53.670899+0000","last_became_active":"2023-10-06T02:59:49.101530+0000","last_became_peered":"2023-10-06T02:59:49.101530+0000","last_unstale":"2023-10-06T02:59:53.670899+0000","last_undegraded":"2023-10-06T02:59:53.670899+0000","last_fullsized":"2023-10-06T02:59:53.670899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.675026+0000","last_change":"2023-10-06T02:59:53.672581+0000","last_active":"2023-10-06T02:59:53.675026+0000","last_peered":"2023-10-06T02:59:53.675026+0000","last_clean":"2023-10-06T02:59:53.675026+0000","last_became_active":"2023-10-06T02:59:53.672299+0000","last_became_peered":"2023-10-06T02:59:53.672299+0000","last_unstale":"2023-10-06T02:59:53.675026+0000","last_undegraded":"2023-10-06T02:59:53.675026+0000","last_fullsized":"2023-10-06T02:59:53.675026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.293712+0000","last_change":"2023-10-06T02:59:53.300135+0000","last_active":"2023-10-06T02:59:54.293712+0000","last_peered":"2023-10-06T02:59:54.293712+0000","last_clean":"2023-10-06T02:59:54.293712+0000","last_became_active":"2023-10-06T02:59:53.299271+0000","last_became_peered":"2023-10-06T02:59:53.299271+0000","last_unstale":"2023-10-06T02:59:54.293712+0000","last_undegraded":"2023-10-06T02:59:54.293712+0000","last_fullsized":"2023-10-06T02:59:54.293712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.672088+0000","last_change":"2023-10-06T02:59:49.100171+0000","last_active":"2023-10-06T02:59:53.672088+0000","last_peered":"2023-10-06T02:59:53.672088+0000","last_clean":"2023-10-06T02:59:53.672088+0000","last_became_active":"2023-10-06T02:59:49.099689+0000","last_became_peered":"2023-10-06T02:59:49.099689+0000","last_unstale":"2023-10-06T02:59:53.672088+0000","last_undegraded":"2023-10-06T02:59:53.672088+0000","last_fullsized":"2023-10-06T02:59:53.672088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687100+0000","last_change":"2023-10-06T02:59:53.685270+0000","last_active":"2023-10-06T02:59:53.687100+0000","last_peered":"2023-10-06T02:59:53.687100+0000","last_clean":"2023-10-06T02:59:53.687100+0000","last_became_active":"2023-10-06T02:59:53.684983+0000","last_became_peered":"2023-10-06T02:59:53.684983+0000","last_unstale":"2023-10-06T02:59:53.687100+0000","last_undegraded":"2023-10-06T02:59:53.687100+0000","last_fullsized":"2023-10-06T02:59:53.687100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:49.904101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668939+0000","last_change":"2023-10-06T02:59:53.301048+0000","last_active":"2023-10-06T02:59:53.668939+0000","last_peered":"2023-10-06T02:59:53.668939+0000","last_clean":"2023-10-06T02:59:53.668939+0000","last_became_active":"2023-10-06T02:59:53.300086+0000","last_became_peered":"2023-10-06T02:59:53.300086+0000","last_unstale":"2023-10-06T02:59:53.668939+0000","last_undegraded":"2023-10-06T02:59:53.668939+0000","last_fullsized":"2023-10-06T02:59:53.668939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.663390+0000","last_change":"2023-10-06T02:59:49.102935+0000","last_active":"2023-10-06T02:59:53.663390+0000","last_peered":"2023-10-06T02:59:53.663390+0000","last_clean":"2023-10-06T02:59:53.663390+0000","last_became_active":"2023-10-06T02:59:49.102397+0000","last_became_peered":"2023-10-06T02:59:49.102397+0000","last_unstale":"2023-10-06T02:59:53.663390+0000","last_undegraded":"2023-10-06T02:59:53.663390+0000","last_fullsized":"2023-10-06T02:59:53.663390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.683104+0000","last_change":"2023-10-06T02:59:53.676229+0000","last_active":"2023-10-06T02:59:53.683104+0000","last_peered":"2023-10-06T02:59:53.683104+0000","last_clean":"2023-10-06T02:59:53.683104+0000","last_became_active":"2023-10-06T02:59:53.675895+0000","last_became_peered":"2023-10-06T02:59:53.675895+0000","last_unstale":"2023-10-06T02:59:53.683104+0000","last_undegraded":"2023-10-06T02:59:53.683104+0000","last_fullsized":"2023-10-06T02:59:53.683104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:03.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682155+0000","last_change":"2023-10-06T02:59:53.676843+0000","last_active":"2023-10-06T02:59:53.682155+0000","last_peered":"2023-10-06T02:59:53.682155+0000","last_clean":"2023-10-06T02:59:53.682155+0000","last_became_active":"2023-10-06T02:59:53.676528+0000","last_became_peered":"2023-10-06T02:59:53.676528+0000","last_unstale":"2023-10-06T02:59:53.682155+0000","last_undegraded":"2023-10-06T02:59:53.682155+0000","last_fullsized":"2023-10-06T02:59:53.682155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.296186+0000","last_change":"2023-10-06T02:59:53.294557+0000","last_active":"2023-10-06T02:59:54.296186+0000","last_peered":"2023-10-06T02:59:54.296186+0000","last_clean":"2023-10-06T02:59:54.296186+0000","last_became_active":"2023-10-06T02:59:53.291434+0000","last_became_peered":"2023-10-06T02:59:53.291434+0000","last_unstale":"2023-10-06T02:59:54.296186+0000","last_undegraded":"2023-10-06T02:59:54.296186+0000","last_fullsized":"2023-10-06T02:59:54.296186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684770+0000","last_change":"2023-10-06T02:59:53.678204+0000","last_active":"2023-10-06T02:59:53.684770+0000","last_peered":"2023-10-06T02:59:53.684770+0000","last_clean":"2023-10-06T02:59:53.684770+0000","last_became_active":"2023-10-06T02:59:53.677924+0000","last_became_peered":"2023-10-06T02:59:53.677924+0000","last_unstale":"2023-10-06T02:59:53.684770+0000","last_undegraded":"2023-10-06T02:59:53.684770+0000","last_fullsized":"2023-10-06T02:59:53.684770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292832+0000","last_change":"2023-10-06T02:59:53.301253+0000","last_active":"2023-10-06T02:59:54.292832+0000","last_peered":"2023-10-06T02:59:54.292832+0000","last_clean":"2023-10-06T02:59:54.292832+0000","last_became_active":"2023-10-06T02:59:53.300926+0000","last_became_peered":"2023-10-06T02:59:53.300926+0000","last_unstale":"2023-10-06T02:59:54.292832+0000","last_undegraded":"2023-10-06T02:59:54.292832+0000","last_fullsized":"2023-10-06T02:59:54.292832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:21.432516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668818+0000","last_change":"2023-10-06T02:59:53.292844+0000","last_active":"2023-10-06T02:59:53.668818+0000","last_peered":"2023-10-06T02:59:53.668818+0000","last_clean":"2023-10-06T02:59:53.668818+0000","last_became_active":"2023-10-06T02:59:53.292493+0000","last_became_peered":"2023-10-06T02:59:53.292493+0000","last_unstale":"2023-10-06T02:59:53.668818+0000","last_undegraded":"2023-10-06T02:59:53.668818+0000","last_fullsized":"2023-10-06T02:59:53.668818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681376+0000","last_change":"2023-10-06T02:59:53.676684+0000","last_active":"2023-10-06T02:59:53.681376+0000","last_peered":"2023-10-06T02:59:53.681376+0000","last_clean":"2023-10-06T02:59:53.681376+0000","last_became_active":"2023-10-06T02:59:53.676410+0000","last_became_peered":"2023-10-06T02:59:53.676410+0000","last_unstale":"2023-10-06T02:59:53.681376+0000","last_undegraded":"2023-10-06T02:59:53.681376+0000","last_fullsized":"2023-10-06T02:59:53.681376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.668711+0000","last_change":"2023-10-06T02:59:53.293924+0000","last_active":"2023-10-06T02:59:53.668711+0000","last_peered":"2023-10-06T02:59:53.668711+0000","last_clean":"2023-10-06T02:59:53.668711+0000","last_became_active":"2023-10-06T02:59:53.293596+0000","last_became_peered":"2023-10-06T02:59:53.293596+0000","last_unstale":"2023-10-06T02:59:53.668711+0000","last_undegraded":"2023-10-06T02:59:53.668711+0000","last_fullsized":"2023-10-06T02:59:53.668711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681521+0000","last_change":"2023-10-06T02:59:53.673847+0000","last_active":"2023-10-06T02:59:53.681521+0000","last_peered":"2023-10-06T02:59:53.681521+0000","last_clean":"2023-10-06T02:59:53.681521+0000","last_became_active":"2023-10-06T02:59:53.673559+0000","last_became_peered":"2023-10-06T02:59:53.673559+0000","last_unstale":"2023-10-06T02:59:53.681521+0000","last_undegraded":"2023-10-06T02:59:53.681521+0000","last_fullsized":"2023-10-06T02:59:53.681521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.678028+0000","last_change":"2023-10-06T02:59:53.674388+0000","last_active":"2023-10-06T02:59:53.678028+0000","last_peered":"2023-10-06T02:59:53.678028+0000","last_clean":"2023-10-06T02:59:53.678028+0000","last_became_active":"2023-10-06T02:59:53.674086+0000","last_became_peered":"2023-10-06T02:59:53.674086+0000","last_unstale":"2023-10-06T02:59:53.678028+0000","last_undegraded":"2023-10-06T02:59:53.678028+0000","last_fullsized":"2023-10-06T02:59:53.678028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.658043+0000","last_change":"2023-10-06T02:59:53.296871+0000","last_active":"2023-10-06T02:59:53.658043+0000","last_peered":"2023-10-06T02:59:53.658043+0000","last_clean":"2023-10-06T02:59:53.658043+0000","last_became_active":"2023-10-06T02:59:53.296550+0000","last_became_peered":"2023-10-06T02:59:53.296550+0000","last_unstale":"2023-10-06T02:59:53.658043+0000","last_undegraded":"2023-10-06T02:59:53.658043+0000","last_fullsized":"2023-10-06T02:59:53.658043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.687227+0000","last_change":"2023-10-06T02:59:53.683771+0000","last_active":"2023-10-06T02:59:53.687227+0000","last_peered":"2023-10-06T02:59:53.687227+0000","last_clean":"2023-10-06T02:59:53.687227+0000","last_became_active":"2023-10-06T02:59:53.683458+0000","last_became_peered":"2023-10-06T02:59:53.683458+0000","last_unstale":"2023-10-06T02:59:53.687227+0000","last_undegraded":"2023-10-06T02:59:53.687227+0000","last_fullsized":"2023-10-06T02:59:53.687227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.669694+0000","last_change":"2023-10-06T02:59:53.301158+0000","last_active":"2023-10-06T02:59:53.669694+0000","last_peered":"2023-10-06T02:59:53.669694+0000","last_clean":"2023-10-06T02:59:53.669694+0000","last_became_active":"2023-10-06T02:59:53.300797+0000","last_became_peered":"2023-10-06T02:59:53.300797+0000","last_unstale":"2023-10-06T02:59:53.669694+0000","last_undegraded":"2023-10-06T02:59:53.669694+0000","last_fullsized":"2023-10-06T02:59:53.669694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.686119+0000","last_change":"2023-10-06T02:59:53.683576+0000","last_active":"2023-10-06T02:59:53.686119+0000","last_peered":"2023-10-06T02:59:53.686119+0000","last_clean":"2023-10-06T02:59:53.686119+0000","last_became_active":"2023-10-06T02:59:53.683301+0000","last_became_peered":"2023-10-06T02:59:53.683301+0000","last_unstale":"2023-10-06T02:59:53.686119+0000","last_undegraded":"2023-10-06T02:59:53.686119+0000","last_fullsized":"2023-10-06T02:59:53.686119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.290397+0000","last_change":"2023-10-06T02:59:53.297975+0000","last_active":"2023-10-06T02:59:54.290397+0000","last_peered":"2023-10-06T02:59:54.290397+0000","last_clean":"2023-10-06T02:59:54.290397+0000","last_became_active":"2023-10-06T02:59:53.297724+0000","last_became_peered":"2023-10-06T02:59:53.297724+0000","last_unstale":"2023-10-06T02:59:54.290397+0000","last_undegraded":"2023-10-06T02:59:54.290397+0000","last_fullsized":"2023-10-06T02:59:54.290397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.689406+0000","last_change":"2023-10-06T02:59:53.684667+0000","last_active":"2023-10-06T02:59:53.689406+0000","last_peered":"2023-10-06T02:59:53.689406+0000","last_clean":"2023-10-06T02:59:53.689406+0000","last_became_active":"2023-10-06T02:59:53.684378+0000","last_became_peered":"2023-10-06T02:59:53.684378+0000","last_unstale":"2023-10-06T02:59:53.689406+0000","last_undegraded":"2023-10-06T02:59:53.689406+0000","last_fullsized":"2023-10-06T02:59:53.689406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:40.914600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.288809+0000","last_change":"2023-10-06T02:59:53.298276+0000","last_active":"2023-10-06T02:59:54.288809+0000","last_peered":"2023-10-06T02:59:54.288809+0000","last_clean":"2023-10-06T02:59:54.288809+0000","last_became_active":"2023-10-06T02:59:53.297471+0000","last_became_peered":"2023-10-06T02:59:53.297471+0000","last_unstale":"2023-10-06T02:59:54.288809+0000","last_undegraded":"2023-10-06T02:59:54.288809+0000","last_fullsized":"2023-10-06T02:59:54.288809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.684717+0000","last_change":"2023-10-06T02:59:53.679138+0000","last_active":"2023-10-06T02:59:53.684717+0000","last_peered":"2023-10-06T02:59:53.684717+0000","last_clean":"2023-10-06T02:59:53.684717+0000","last_became_active":"2023-10-06T02:59:53.678831+0000","last_became_peered":"2023-10-06T02:59:53.678831+0000","last_unstale":"2023-10-06T02:59:53.684717+0000","last_undegraded":"2023-10-06T02:59:53.684717+0000","last_fullsized":"2023-10-06T02:59:53.684717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:25.273960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292430+0000","last_change":"2023-10-06T02:59:53.295949+0000","last_active":"2023-10-06T02:59:54.292430+0000","last_peered":"2023-10-06T02:59:54.292430+0000","last_clean":"2023-10-06T02:59:54.292430+0000","last_became_active":"2023-10-06T02:59:53.295697+0000","last_became_peered":"2023-10-06T02:59:53.295697+0000","last_unstale":"2023-10-06T02:59:54.292430+0000","last_undegraded":"2023-10-06T02:59:54.292430+0000","last_fullsized":"2023-10-06T02:59:54.292430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.682283+0000","last_change":"2023-10-06T02:59:53.673079+0000","last_active":"2023-10-06T02:59:53.682283+0000","last_peered":"2023-10-06T02:59:53.682283+0000","last_clean":"2023-10-06T02:59:53.682283+0000","last_became_active":"2023-10-06T02:59:53.672629+0000","last_became_peered":"2023-10-06T02:59:53.672629+0000","last_unstale":"2023-10-06T02:59:53.682283+0000","last_undegraded":"2023-10-06T02:59:53.682283+0000","last_fullsized":"2023-10-06T02:59:53.682283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292559+0000","last_change":"2023-10-06T02:59:53.297170+0000","last_active":"2023-10-06T02:59:54.292559+0000","last_peered":"2023-10-06T02:59:54.292559+0000","last_clean":"2023-10-06T02:59:54.292559+0000","last_became_active":"2023-10-06T02:59:53.296843+0000","last_became_peered":"2023-10-06T02:59:53.296843+0000","last_unstale":"2023-10-06T02:59:54.292559+0000","last_undegraded":"2023-10-06T02:59:54.292559+0000","last_fullsized":"2023-10-06T02:59:54.292559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681280+0000","last_change":"2023-10-06T02:59:53.675030+0000","last_active":"2023-10-06T02:59:53.681280+0000","last_peered":"2023-10-06T02:59:53.681280+0000","last_clean":"2023-10-06T02:59:53.681280+0000","last_became_active":"2023-10-06T02:59:53.673662+0000","last_became_peered":"2023-10-06T02:59:53.673662+0000","last_unstale":"2023-10-06T02:59:53.681280+0000","last_undegraded":"2023-10-06T02:59:53.681280+0000","last_fullsized":"2023-10-06T02:59:53.681280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.294000+0000","last_change":"2023-10-06T02:59:53.299596+0000","last_active":"2023-10-06T02:59:54.294000+0000","last_peered":"2023-10-06T02:59:54.294000+0000","last_clean":"2023-10-06T02:59:54.294000+0000","last_became_active":"2023-10-06T02:59:53.298881+0000","last_became_peered":"2023-10-06T02:59:53.298881+0000","last_unstale":"2023-10-06T02:59:54.294000+0000","last_undegraded":"2023-10-06T02:59:54.294000+0000","last_fullsized":"2023-10-06T02:59:54.294000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:53.681995+0000","last_change":"2023-10-06T02:59:53.675391+0000","last_active":"2023-10-06T02:59:53.681995+0000","last_peered":"2023-10-06T02:59:53.681995+0000","last_clean":"2023-10-06T02:59:53.681995+0000","last_became_active":"2023-10-06T02:59:53.675092+0000","last_became_peered":"2023-10-06T02:59:53.675092+0000","last_unstale":"2023-10-06T02:59:53.681995+0000","last_undegraded":"2023-10-06T02:59:53.681995+0000","last_fullsized":"2023-10-06T02:59:53.681995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:59:54.292391+0000","last_change":"2023-10-06T02:59:53.294074+0000","last_active":"2023-10-06T02:59:54.292391+0000","last_peered":"2023-10-06T02:59:54.292391+0000","last_clean":"2023-10-06T02:59:54.292391+0000","last_became_active":"2023-10-06T02:59:53.293752+0000","last_became_peered":"2023-10-06T02:59:53.293752+0000","last_unstale":"2023-10-06T02:59:54.292391+0000","last_undegraded":"2023-10-06T02:59:54.292391+0000","last_fullsized":"2023-10-06T02:59:54.292391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":686098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":94602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":95570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":94068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":684900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:00:01.614 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:00:01.614 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T03:00:01.614 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T03:00:01.614 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T03:00:01.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f289d05e700 1 Processor -- start 2023-10-06T03:00:01.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f289d05e700 1 -- start start 2023-10-06T03:00:01.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f289d05e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f28980bbcd0 0x7f289814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f289d05e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28980b9fd0 con 0x7f289806d3d0 2023-10-06T03:00:01.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f289d05e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28980ba2b0 con 0x7f289806afe0 2023-10-06T03:00:01.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f289d05e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28980ba590 con 0x7f28980bbcd0 2023-10-06T03:00:01.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f2897fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f289806d3d0 0x7f289814a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44544/0 (socket says 172.21.15.27:44544) 2023-10-06T03:00:01.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f2897fff700 1 -- 172.21.15.27:0/3272291454 learned_addr learned my addr 172.21.15.27:0/3272291454 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:01.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f28977fe700 1 --2- 172.21.15.27:0/3272291454 >> v2:172.21.15.123:3300/0 conn(0x7f28980bbcd0 0x7f289814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f2896ffd700 1 -- 172.21.15.27:0/3272291454 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764792106 0 0) 0x7f28980b9fd0 con 0x7f289806d3d0 2023-10-06T03:00:01.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f2896ffd700 1 -- 172.21.15.27:0/3272291454 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2880003570 con 0x7f289806d3d0 2023-10-06T03:00:01.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f28977fe700 1 -- 172.21.15.27:0/3272291454 >> v1:172.21.15.123:6789/0 conn(0x7f289806afe0 legacy=0x7f2898069d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f28977fe700 1 -- 172.21.15.27:0/3272291454 >> v1:172.21.15.27:6789/0 conn(0x7f289806d3d0 legacy=0x7f289814a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.711+0000 7f28977fe700 1 -- 172.21.15.27:0/3272291454 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289814b530 con 0x7f28980bbcd0 2023-10-06T03:00:01.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.715+0000 7f28977fe700 1 --2- 172.21.15.27:0/3272291454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28980bbcd0 0x7f289814aff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f288c0098e0 tx=0x7f288c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32d3e68da03bc4d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.715+0000 7f2896ffd700 1 -- 172.21.15.27:0/3272291454 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00b640 con 0x7f28980bbcd0 2023-10-06T03:00:01.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.715+0000 7f2896ffd700 1 -- 172.21.15.27:0/3272291454 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c00b7a0 con 0x7f28980bbcd0 2023-10-06T03:00:01.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.715+0000 7f2896ffd700 1 -- 172.21.15.27:0/3272291454 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00bb40 con 0x7f28980bbcd0 2023-10-06T03:00:01.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.715+0000 7f289d05e700 1 -- 172.21.15.27:0/3272291454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28980bbcd0 msgr2=0x7f289814aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.715+0000 7f289d05e700 1 --2- 172.21.15.27:0/3272291454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28980bbcd0 0x7f289814aff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f288c0098e0 tx=0x7f288c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.715+0000 7f289d05e700 1 -- 172.21.15.27:0/3272291454 shutdown_connections 2023-10-06T03:00:01.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.715+0000 7f289d05e700 1 --2- 172.21.15.27:0/3272291454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28980bbcd0 0x7f289814aff0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.715+0000 7f289d05e700 1 -- 172.21.15.27:0/3272291454 >> 172.21.15.27:0/3272291454 conn(0x7f28980bae20 msgr2=0x7f28980bb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:01.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.715+0000 7f289d05e700 1 -- 172.21.15.27:0/3272291454 shutdown_connections 2023-10-06T03:00:01.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.715+0000 7f289d05e700 1 -- 172.21.15.27:0/3272291454 wait complete. 2023-10-06T03:00:01.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.715+0000 7f289d05e700 1 Processor -- start 2023-10-06T03:00:01.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.715+0000 7f289d05e700 1 -- start start 2023-10-06T03:00:01.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f289d05e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f289806afe0 0x7f289815c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f289d05e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f289806d3d0 0x7f289813e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f289d05e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28980bbcd0 0x7f289813ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f289d05e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2898150490 con 0x7f28980bbcd0 2023-10-06T03:00:01.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f289d05e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2898150770 con 0x7f289806afe0 2023-10-06T03:00:01.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f289d05e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289814ee70 con 0x7f289806d3d0 2023-10-06T03:00:01.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f2897fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f289806afe0 0x7f289815c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f2897fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f289806afe0 0x7f289815c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:55000/0 (socket says 172.21.15.27:55000) 2023-10-06T03:00:01.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f2897fff700 1 -- 172.21.15.27:0/4057661643 learned_addr learned my addr 172.21.15.27:0/4057661643 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:01.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f28977fe700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f289806d3d0 0x7f289813e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f289c85d700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28980bbcd0 0x7f289813ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f2897fff700 1 -- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f289806d3d0 msgr2=0x7f289813e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f2897fff700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f289806d3d0 0x7f289813e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f2897fff700 1 -- 172.21.15.27:0/4057661643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28980bbcd0 msgr2=0x7f289813ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f2897fff700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28980bbcd0 0x7f289813ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f2897fff700 1 -- 172.21.15.27:0/4057661643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c009420 con 0x7f289806afe0 2023-10-06T03:00:01.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f28977fe700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f289806d3d0 0x7f289813e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:01.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f2897fff700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f289806afe0 0x7f289815c180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f288800c7c0 tx=0x7f2888007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f287ffff700 1 -- 172.21.15.27:0/4057661643 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2888005cd0 con 0x7f289806afe0 2023-10-06T03:00:01.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f287ffff700 1 -- 172.21.15.27:0/4057661643 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2888005e30 con 0x7f289806afe0 2023-10-06T03:00:01.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f289d05e700 1 -- 172.21.15.27:0/4057661643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289814fe50 con 0x7f289806afe0 2023-10-06T03:00:01.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f287ffff700 1 -- 172.21.15.27:0/4057661643 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2888007320 con 0x7f289806afe0 2023-10-06T03:00:01.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.719+0000 7f289d05e700 1 -- 172.21.15.27:0/4057661643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2898148690 con 0x7f289806afe0 2023-10-06T03:00:01.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.723+0000 7f289d05e700 1 -- 172.21.15.27:0/4057661643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28981502e0 con 0x7f289806afe0 2023-10-06T03:00:01.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.723+0000 7f287ffff700 1 -- 172.21.15.27:0/4057661643 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2888007690 con 0x7f289806afe0 2023-10-06T03:00:01.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.723+0000 7f287ffff700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2884060580 0x7f2884062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.723+0000 7f287ffff700 1 -- 172.21.15.27:0/4057661643 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f288807c000 con 0x7f289806afe0 2023-10-06T03:00:01.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.723+0000 7f28977fe700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2884060580 0x7f2884062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.723+0000 7f28977fe700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2884060580 0x7f2884062a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f288c0093f0 tx=0x7f288c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.731+0000 7f287ffff700 1 -- 172.21.15.27:0/4057661643 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f288804c490 con 0x7f289806afe0 2023-10-06T03:00:01.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.923+0000 7f289d05e700 1 -- 172.21.15.27:0/4057661643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f28981508b0 con 0x7f289806afe0 2023-10-06T03:00:01.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.923+0000 7f287ffff700 1 -- 172.21.15.27:0/4057661643 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f28981508b0 con 0x7f289806afe0 2023-10-06T03:00:01.929 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:00:01.929 INFO:teuthology.orchestra.run.smithi027.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T03:00:01.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.927+0000 7f289d05e700 1 -- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2884060580 msgr2=0x7f2884062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.927+0000 7f289d05e700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2884060580 0x7f2884062a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f288c0093f0 tx=0x7f288c017000 comp rx=0 tx=0).stop 2023-10-06T03:00:01.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.927+0000 7f289d05e700 1 -- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f289806afe0 msgr2=0x7f289815c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.927+0000 7f289d05e700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f289806afe0 0x7f289815c180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f288800c7c0 tx=0x7f2888007e00 comp rx=0 tx=0).stop 2023-10-06T03:00:01.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.927+0000 7f289d05e700 1 -- 172.21.15.27:0/4057661643 shutdown_connections 2023-10-06T03:00:01.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.927+0000 7f289d05e700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2884060580 0x7f2884062a30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.927+0000 7f289d05e700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28980bbcd0 0x7f289813ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.927+0000 7f289d05e700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f289806d3d0 0x7f289813e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.927+0000 7f289d05e700 1 --2- 172.21.15.27:0/4057661643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f289806afe0 0x7f289815c180 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.927+0000 7f289d05e700 1 -- 172.21.15.27:0/4057661643 >> 172.21.15.27:0/4057661643 conn(0x7f28980bae20 msgr2=0x7f2898150c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:01.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.927+0000 7f289d05e700 1 -- 172.21.15.27:0/4057661643 shutdown_connections 2023-10-06T03:00:01.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:01.927+0000 7f289d05e700 1 -- 172.21.15.27:0/4057661643 wait complete. 2023-10-06T03:00:01.942 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T03:00:01.943 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:02.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e033ec700 1 Processor -- start 2023-10-06T03:00:02.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e033ec700 1 -- start start 2023-10-06T03:00:02.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e033ec700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2dfc06b190 0x7f2dfc14fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e033ec700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dfc153de0 con 0x7f2dfc150130 2023-10-06T03:00:02.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e033ec700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dfc153aa0 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e033ec700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dfc146ab0 con 0x7f2dfc06b190 2023-10-06T03:00:02.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e00987700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2dfc06b190 0x7f2dfc14fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e01989700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2dfc150130 0x7f2dfc15a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44558/0 (socket says 172.21.15.27:44558) 2023-10-06T03:00:02.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e01989700 1 -- 172.21.15.27:0/2483716485 learned_addr learned my addr 172.21.15.27:0/2483716485 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:02.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e00987700 1 -- 172.21.15.27:0/2483716485 >> v1:172.21.15.123:6789/0 conn(0x7f2dfc0b75d0 legacy=0x7f2dfc06bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e00987700 1 -- 172.21.15.27:0/2483716485 >> v1:172.21.15.27:6789/0 conn(0x7f2dfc150130 legacy=0x7f2dfc15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e00987700 1 -- 172.21.15.27:0/2483716485 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc0b99a0 con 0x7f2dfc06b190 2023-10-06T03:00:02.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e00987700 1 --2- 172.21.15.27:0/2483716485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2dfc06b190 0x7f2dfc14fbf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009e60 tx=0x7f2df4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72519938cd0032fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2dfbfff700 1 -- 172.21.15.27:0/2483716485 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df400e070 con 0x7f2dfc06b190 2023-10-06T03:00:02.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2dfbfff700 1 -- 172.21.15.27:0/2483716485 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df400bc30 con 0x7f2dfc06b190 2023-10-06T03:00:02.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2dfbfff700 1 -- 172.21.15.27:0/2483716485 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4012430 con 0x7f2dfc06b190 2023-10-06T03:00:02.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e033ec700 1 -- 172.21.15.27:0/2483716485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2dfc06b190 msgr2=0x7f2dfc14fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e033ec700 1 --2- 172.21.15.27:0/2483716485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2dfc06b190 0x7f2dfc14fbf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009e60 tx=0x7f2df4009780 comp rx=0 tx=0).stop 2023-10-06T03:00:02.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e033ec700 1 -- 172.21.15.27:0/2483716485 shutdown_connections 2023-10-06T03:00:02.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e033ec700 1 --2- 172.21.15.27:0/2483716485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2dfc06b190 0x7f2dfc14fbf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e033ec700 1 -- 172.21.15.27:0/2483716485 >> 172.21.15.27:0/2483716485 conn(0x7f2dfc0bde40 msgr2=0x7f2dfc0be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e033ec700 1 -- 172.21.15.27:0/2483716485 shutdown_connections 2023-10-06T03:00:02.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.043+0000 7f2e033ec700 1 -- 172.21.15.27:0/2483716485 wait complete. 2023-10-06T03:00:02.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e033ec700 1 Processor -- start 2023-10-06T03:00:02.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e033ec700 1 -- start start 2023-10-06T03:00:02.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e033ec700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2dfc06b190 0x7f2dfc14c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e033ec700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2dfc0b75d0 0x7f2dfc146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e033ec700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dfc150130 0x7f2dfc148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e033ec700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc149ce0 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e033ec700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc1489e0 con 0x7f2dfc150130 2023-10-06T03:00:02.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e033ec700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc14ca60 con 0x7f2dfc06b190 2023-10-06T03:00:02.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e00987700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2dfc0b75d0 0x7f2dfc146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e00987700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2dfc0b75d0 0x7f2dfc146bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49028/0 (socket says 172.21.15.27:49028) 2023-10-06T03:00:02.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e00987700 1 -- 172.21.15.27:0/3484774220 learned_addr learned my addr 172.21.15.27:0/3484774220 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:02.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e01989700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dfc150130 0x7f2dfc148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e01188700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2dfc06b190 0x7f2dfc14c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e00987700 1 -- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2dfc06b190 msgr2=0x7f2dfc14c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e00987700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2dfc06b190 0x7f2dfc14c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e00987700 1 -- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dfc150130 msgr2=0x7f2dfc148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e00987700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dfc150130 0x7f2dfc148e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e00987700 1 -- 172.21.15.27:0/3484774220 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df4009a20 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e01188700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2dfc06b190 0x7f2dfc14c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:02.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e00987700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2dfc0b75d0 0x7f2dfc146bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2df40097c0 tx=0x7f2df4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2df97fa700 1 -- 172.21.15.27:0/3484774220 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4012e40 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2df97fa700 1 -- 172.21.15.27:0/3484774220 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df401d630 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2df97fa700 1 -- 172.21.15.27:0/3484774220 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df401d9f0 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e033ec700 1 -- 172.21.15.27:0/3484774220 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dfc148390 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.047+0000 7f2e033ec700 1 -- 172.21.15.27:0/3484774220 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dfc14d330 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.051+0000 7f2e033ec700 1 -- 172.21.15.27:0/3484774220 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dfc148b90 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.051+0000 7f2df97fa700 1 -- 172.21.15.27:0/3484774220 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2df4024070 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.051+0000 7f2df97fa700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2de8060550 0x7f2de8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.051+0000 7f2df97fa700 1 -- 172.21.15.27:0/3484774220 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2df407f070 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.051+0000 7f2e01188700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2de8060550 0x7f2de8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.051+0000 7f2e01188700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2de8060550 0x7f2de8062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2df0007fd0 tx=0x7f2df0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.055+0000 7f2df97fa700 1 -- 172.21.15.27:0/3484774220 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2dfc148b90 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.215+0000 7f2e033ec700 1 -- 172.21.15.27:0/3484774220 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2dfc148b90 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.215+0000 7f2df97fa700 1 -- 172.21.15.27:0/3484774220 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f2dfc148b90 con 0x7f2dfc0b75d0 2023-10-06T03:00:02.222 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:00:02.222 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":24,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:54.652472+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:59:47.570918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:51.949130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:52.638817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:02.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.219+0000 7f2e033ec700 1 -- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2de8060550 msgr2=0x7f2de8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.219+0000 7f2e033ec700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2de8060550 0x7f2de8062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2df0007fd0 tx=0x7f2df0009040 comp rx=0 tx=0).stop 2023-10-06T03:00:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.219+0000 7f2e033ec700 1 -- 172.21.15.27:0/3484774220 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2dfc0b75d0 msgr2=0x7f2dfc146bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.219+0000 7f2e033ec700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2dfc0b75d0 0x7f2dfc146bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2df40097c0 tx=0x7f2df4019000 comp rx=0 tx=0).stop 2023-10-06T03:00:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.219+0000 7f2e033ec700 1 -- 172.21.15.27:0/3484774220 shutdown_connections 2023-10-06T03:00:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.219+0000 7f2e033ec700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2de8060550 0x7f2de8062a00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.219+0000 7f2e033ec700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dfc150130 0x7f2dfc148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.219+0000 7f2e033ec700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2dfc0b75d0 0x7f2dfc146bf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.219+0000 7f2e033ec700 1 --2- 172.21.15.27:0/3484774220 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2dfc06b190 0x7f2dfc14c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.219+0000 7f2e033ec700 1 -- 172.21.15.27:0/3484774220 >> 172.21.15.27:0/3484774220 conn(0x7f2dfc0bde40 msgr2=0x7f2dfc153000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.219+0000 7f2e033ec700 1 -- 172.21.15.27:0/3484774220 shutdown_connections 2023-10-06T03:00:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.219+0000 7f2e033ec700 1 -- 172.21.15.27:0/3484774220 wait complete. 2023-10-06T03:00:02.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:59:43.021608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:59:47.570918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:59:51.949130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:59:52.638817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:00:02.236 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:00:02.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.335+0000 7f3e6d18d700 1 Processor -- start 2023-10-06T03:00:02.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.335+0000 7f3e6d18d700 1 -- start start 2023-10-06T03:00:02.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.335+0000 7f3e6d18d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e6814ebb0 0x7f3e6814c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.335+0000 7f3e6d18d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6814bc40 con 0x7f3e680ba880 2023-10-06T03:00:02.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.335+0000 7f3e6d18d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e680b3610 con 0x7f3e68069900 2023-10-06T03:00:02.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.335+0000 7f3e6d18d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6814b8d0 con 0x7f3e6814ebb0 2023-10-06T03:00:02.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.335+0000 7f3e6c98c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3e680ba880 0x7f3e68134340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44566/0 (socket says 172.21.15.27:44566) 2023-10-06T03:00:02.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.335+0000 7f3e6c98c700 1 -- 172.21.15.27:0/4259967420 learned_addr learned my addr 172.21.15.27:0/4259967420 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:02.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.335+0000 7f3e5ffff700 1 --2- 172.21.15.27:0/4259967420 >> v2:172.21.15.123:3300/0 conn(0x7f3e6814ebb0 0x7f3e6814c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e677fe700 1 -- 172.21.15.27:0/4259967420 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056162687 0 0) 0x7f3e6814bc40 con 0x7f3e680ba880 2023-10-06T03:00:02.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e677fe700 1 -- 172.21.15.27:0/4259967420 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e54003570 con 0x7f3e680ba880 2023-10-06T03:00:02.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e5ffff700 1 -- 172.21.15.27:0/4259967420 >> v1:172.21.15.123:6789/0 conn(0x7f3e68069900 legacy=0x7f3e680b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e5ffff700 1 -- 172.21.15.27:0/4259967420 >> v1:172.21.15.27:6789/0 conn(0x7f3e680ba880 legacy=0x7f3e68134340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e5ffff700 1 -- 172.21.15.27:0/4259967420 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6814b5d0 con 0x7f3e6814ebb0 2023-10-06T03:00:02.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e5ffff700 1 --2- 172.21.15.27:0/4259967420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6814ebb0 0x7f3e6814c0d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e500098e0 tx=0x7f3e500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c654122459990654 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e677fe700 1 -- 172.21.15.27:0/4259967420 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000b640 con 0x7f3e6814ebb0 2023-10-06T03:00:02.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e677fe700 1 -- 172.21.15.27:0/4259967420 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5000b7a0 con 0x7f3e6814ebb0 2023-10-06T03:00:02.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e677fe700 1 -- 172.21.15.27:0/4259967420 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000bb40 con 0x7f3e6814ebb0 2023-10-06T03:00:02.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e6d18d700 1 -- 172.21.15.27:0/4259967420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6814ebb0 msgr2=0x7f3e6814c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e6d18d700 1 --2- 172.21.15.27:0/4259967420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6814ebb0 0x7f3e6814c0d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e500098e0 tx=0x7f3e500091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e6d18d700 1 -- 172.21.15.27:0/4259967420 shutdown_connections 2023-10-06T03:00:02.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e6d18d700 1 --2- 172.21.15.27:0/4259967420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6814ebb0 0x7f3e6814c0d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e6d18d700 1 -- 172.21.15.27:0/4259967420 >> 172.21.15.27:0/4259967420 conn(0x7f3e680bec30 msgr2=0x7f3e680bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e6d18d700 1 -- 172.21.15.27:0/4259967420 shutdown_connections 2023-10-06T03:00:02.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e6d18d700 1 -- 172.21.15.27:0/4259967420 wait complete. 2023-10-06T03:00:02.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e6d18d700 1 Processor -- start 2023-10-06T03:00:02.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.339+0000 7f3e6d18d700 1 -- start start 2023-10-06T03:00:02.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e6d18d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e68069900 0x7f3e6815ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e6d18d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e680ba880 0x7f3e68133750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e6d18d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e6814ebb0 0x7f3e6815b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e6d18d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6815b1b0 con 0x7f3e6814ebb0 2023-10-06T03:00:02.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e6d18d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6815f490 con 0x7f3e680ba880 2023-10-06T03:00:02.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e6d18d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e680bcd60 con 0x7f3e68069900 2023-10-06T03:00:02.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e5ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e680ba880 0x7f3e68133750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e6c98c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e6814ebb0 0x7f3e6815b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e5ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e680ba880 0x7f3e68133750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:55030/0 (socket says 172.21.15.27:55030) 2023-10-06T03:00:02.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e5ffff700 1 -- 172.21.15.27:0/1422983802 learned_addr learned my addr 172.21.15.27:0/1422983802 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e67fff700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e68069900 0x7f3e6815ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e5ffff700 1 -- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e68069900 msgr2=0x7f3e6815ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e5ffff700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e68069900 0x7f3e6815ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e5ffff700 1 -- 172.21.15.27:0/1422983802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e6814ebb0 msgr2=0x7f3e6815b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e5ffff700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e6814ebb0 0x7f3e6815b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e5ffff700 1 -- 172.21.15.27:0/1422983802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50009420 con 0x7f3e680ba880 2023-10-06T03:00:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e6c98c700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e6814ebb0 0x7f3e6815b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e5ffff700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e680ba880 0x7f3e68133750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3e680bf7b0 tx=0x7f3e50017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e64ff9700 1 -- 172.21.15.27:0/1422983802 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e50000d10 con 0x7f3e680ba880 2023-10-06T03:00:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e64ff9700 1 -- 172.21.15.27:0/1422983802 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5000bb20 con 0x7f3e680ba880 2023-10-06T03:00:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e6d18d700 1 -- 172.21.15.27:0/1422983802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e68133c90 con 0x7f3e680ba880 2023-10-06T03:00:02.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e64ff9700 1 -- 172.21.15.27:0/1422983802 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e50011650 con 0x7f3e680ba880 2023-10-06T03:00:02.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.343+0000 7f3e6d18d700 1 -- 172.21.15.27:0/1422983802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e68135200 con 0x7f3e680ba880 2023-10-06T03:00:02.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.347+0000 7f3e6d18d700 1 -- 172.21.15.27:0/1422983802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e68068910 con 0x7f3e680ba880 2023-10-06T03:00:02.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.347+0000 7f3e64ff9700 1 -- 172.21.15.27:0/1422983802 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3e500119c0 con 0x7f3e680ba880 2023-10-06T03:00:02.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.347+0000 7f3e64ff9700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3e48060580 0x7f3e48062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.347+0000 7f3e64ff9700 1 -- 172.21.15.27:0/1422983802 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3e5007dc10 con 0x7f3e680ba880 2023-10-06T03:00:02.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.347+0000 7f3e67fff700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3e48060580 0x7f3e48062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.347+0000 7f3e67fff700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3e48060580 0x7f3e48062a30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3e580039e0 tx=0x7f3e58007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.359+0000 7f3e64ff9700 1 -- 172.21.15.27:0/1422983802 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3e5004e120 con 0x7f3e680ba880 2023-10-06T03:00:02.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.511+0000 7f3e6d18d700 1 -- 172.21.15.27:0/1422983802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e680bb320 con 0x7f3e680ba880 2023-10-06T03:00:02.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.511+0000 7f3e64ff9700 1 -- 172.21.15.27:0/1422983802 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e50051740 con 0x7f3e680ba880 2023-10-06T03:00:02.517 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-10-06T03:00:02.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.515+0000 7f3e6d18d700 1 -- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3e48060580 msgr2=0x7f3e48062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.515+0000 7f3e6d18d700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3e48060580 0x7f3e48062a30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3e580039e0 tx=0x7f3e58007ec0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.515+0000 7f3e6d18d700 1 -- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e680ba880 msgr2=0x7f3e68133750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.515+0000 7f3e6d18d700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e680ba880 0x7f3e68133750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3e680bf7b0 tx=0x7f3e50017000 comp rx=0 tx=0).stop 2023-10-06T03:00:02.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.515+0000 7f3e6d18d700 1 -- 172.21.15.27:0/1422983802 shutdown_connections 2023-10-06T03:00:02.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.515+0000 7f3e6d18d700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3e48060580 0x7f3e48062a30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.515+0000 7f3e6d18d700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e6814ebb0 0x7f3e6815b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.515+0000 7f3e6d18d700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e680ba880 0x7f3e68133750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.515+0000 7f3e6d18d700 1 --2- 172.21.15.27:0/1422983802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e68069900 0x7f3e6815ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.515+0000 7f3e6d18d700 1 -- 172.21.15.27:0/1422983802 >> 172.21.15.27:0/1422983802 conn(0x7f3e680bec30 msgr2=0x7f3e68062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.515+0000 7f3e6d18d700 1 -- 172.21.15.27:0/1422983802 shutdown_connections 2023-10-06T03:00:02.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.515+0000 7f3e6d18d700 1 -- 172.21.15.27:0/1422983802 wait complete. 2023-10-06T03:00:02.536 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:00:02.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.643+0000 7f72660a4700 1 Processor -- start 2023-10-06T03:00:02.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.643+0000 7f72660a4700 1 -- start start 2023-10-06T03:00:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.643+0000 7f72660a4700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f72600b4b60 0x7f72600b9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.643+0000 7f72660a4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72600b2f00 0x7f7260148890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.643+0000 7f72660a4700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7260148400 con 0x7f72600ba560 2023-10-06T03:00:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.643+0000 7f72660a4700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726014c380 con 0x7f72600b4b60 2023-10-06T03:00:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.643+0000 7f72660a4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726014c660 con 0x7f72600b2f00 2023-10-06T03:00:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.643+0000 7f72648a1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f72600b4b60 0x7f72600b9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72650a2700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f72600ba560 0x7f726006d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44580/0 (socket says 172.21.15.27:44580) 2023-10-06T03:00:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72648a1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f72600b4b60 0x7f72600b9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49050/0 (socket says 172.21.15.27:49050) 2023-10-06T03:00:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72650a2700 1 -- 172.21.15.27:0/695925098 learned_addr learned my addr 172.21.15.27:0/695925098 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72658a3700 1 --2- 172.21.15.27:0/695925098 >> v2:172.21.15.123:3300/0 conn(0x7f72600b2f00 0x7f7260148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72648a1700 1 -- 172.21.15.27:0/695925098 >> v2:172.21.15.123:3300/0 conn(0x7f72600b2f00 msgr2=0x7f7260148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72648a1700 1 --2- 172.21.15.27:0/695925098 >> v2:172.21.15.123:3300/0 conn(0x7f72600b2f00 0x7f7260148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72648a1700 1 -- 172.21.15.27:0/695925098 >> v1:172.21.15.27:6789/0 conn(0x7f72600ba560 legacy=0x7f726006d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72648a1700 1 -- 172.21.15.27:0/695925098 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726006d8b0 con 0x7f72600b4b60 2023-10-06T03:00:02.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72648a1700 1 --2- 172.21.15.27:0/695925098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600b4b60 0x7f72600b9b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7260067590 tx=0x7f72500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9170fc29dbb4c2df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f7257fff700 1 -- 172.21.15.27:0/695925098 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725000f6b0 con 0x7f72600b4b60 2023-10-06T03:00:02.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f7257fff700 1 -- 172.21.15.27:0/695925098 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725000f810 con 0x7f72600b4b60 2023-10-06T03:00:02.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f7257fff700 1 -- 172.21.15.27:0/695925098 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725000fbb0 con 0x7f72600b4b60 2023-10-06T03:00:02.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72660a4700 1 -- 172.21.15.27:0/695925098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600b4b60 msgr2=0x7f72600b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72660a4700 1 --2- 172.21.15.27:0/695925098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600b4b60 0x7f72600b9b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7260067590 tx=0x7f72500091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72660a4700 1 -- 172.21.15.27:0/695925098 shutdown_connections 2023-10-06T03:00:02.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72660a4700 1 --2- 172.21.15.27:0/695925098 >> v2:172.21.15.123:3300/0 conn(0x7f72600b2f00 0x7f7260148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72660a4700 1 --2- 172.21.15.27:0/695925098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600b4b60 0x7f72600b9b10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72660a4700 1 -- 172.21.15.27:0/695925098 >> 172.21.15.27:0/695925098 conn(0x7f72600beed0 msgr2=0x7f72600bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72660a4700 1 -- 172.21.15.27:0/695925098 shutdown_connections 2023-10-06T03:00:02.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.647+0000 7f72660a4700 1 -- 172.21.15.27:0/695925098 wait complete. 2023-10-06T03:00:02.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72660a4700 1 Processor -- start 2023-10-06T03:00:02.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72660a4700 1 -- start start 2023-10-06T03:00:02.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72660a4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72600b2f00 0x7f72600b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72660a4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600ba560 0x7f72600bd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72660a4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f726014b660 0x7f7260157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72660a4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72601570a0 con 0x7f72600ba560 2023-10-06T03:00:02.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72660a4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7260156d50 con 0x7f726014b660 2023-10-06T03:00:02.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72660a4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72600bd900 con 0x7f72600b2f00 2023-10-06T03:00:02.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72648a1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600ba560 0x7f72600bd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72648a1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600ba560 0x7f72600bd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49060/0 (socket says 172.21.15.27:49060) 2023-10-06T03:00:02.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72648a1700 1 -- 172.21.15.27:0/257426306 learned_addr learned my addr 172.21.15.27:0/257426306 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:02.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72650a2700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72600b2f00 0x7f72600b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72658a3700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f726014b660 0x7f7260157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72648a1700 1 -- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72600b2f00 msgr2=0x7f72600b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72648a1700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72600b2f00 0x7f72600b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72648a1700 1 -- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f726014b660 msgr2=0x7f7260157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72648a1700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f726014b660 0x7f7260157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72648a1700 1 -- 172.21.15.27:0/257426306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250009420 con 0x7f72600ba560 2023-10-06T03:00:02.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.651+0000 7f72650a2700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72600b2f00 0x7f72600b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:02.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.655+0000 7f72648a1700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600ba560 0x7f72600bd3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f72600682d0 tx=0x7f7250019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.655+0000 7f72557fa700 1 -- 172.21.15.27:0/257426306 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725001f070 con 0x7f72600ba560 2023-10-06T03:00:02.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.655+0000 7f72557fa700 1 -- 172.21.15.27:0/257426306 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725000f980 con 0x7f72600ba560 2023-10-06T03:00:02.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.655+0000 7f72660a4700 1 -- 172.21.15.27:0/257426306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7260149800 con 0x7f72600ba560 2023-10-06T03:00:02.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.655+0000 7f72557fa700 1 -- 172.21.15.27:0/257426306 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250010470 con 0x7f72600ba560 2023-10-06T03:00:02.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.655+0000 7f72660a4700 1 -- 172.21.15.27:0/257426306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72600b5470 con 0x7f72600ba560 2023-10-06T03:00:02.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.655+0000 7f72660a4700 1 -- 172.21.15.27:0/257426306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7260149660 con 0x7f72600ba560 2023-10-06T03:00:02.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.655+0000 7f72557fa700 1 -- 172.21.15.27:0/257426306 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7250023070 con 0x7f72600ba560 2023-10-06T03:00:02.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.655+0000 7f72557fa700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7244060550 0x7f7244062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.659+0000 7f72557fa700 1 -- 172.21.15.27:0/257426306 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7250014070 con 0x7f72600ba560 2023-10-06T03:00:02.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.659+0000 7f72650a2700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7244060550 0x7f7244062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.659+0000 7f72650a2700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7244060550 0x7f7244062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f725c0018c0 tx=0x7f725c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.667+0000 7f72557fa700 1 -- 172.21.15.27:0/257426306 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7260149660 con 0x7f72600ba560 2023-10-06T03:00:02.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.815+0000 7f72660a4700 1 -- 172.21.15.27:0/257426306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7260149660 con 0x7f72600ba560 2023-10-06T03:00:02.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.815+0000 7f72557fa700 1 -- 172.21.15.27:0/257426306 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f725002a020 con 0x7f72600ba560 2023-10-06T03:00:02.821 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-10-06T03:00:02.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.819+0000 7f72660a4700 1 -- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7244060550 msgr2=0x7f7244062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.819+0000 7f72660a4700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7244060550 0x7f7244062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f725c0018c0 tx=0x7f725c009040 comp rx=0 tx=0).stop 2023-10-06T03:00:02.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.819+0000 7f72660a4700 1 -- 172.21.15.27:0/257426306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600ba560 msgr2=0x7f72600bd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.819+0000 7f72660a4700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600ba560 0x7f72600bd3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f72600682d0 tx=0x7f7250019000 comp rx=0 tx=0).stop 2023-10-06T03:00:02.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.819+0000 7f72660a4700 1 -- 172.21.15.27:0/257426306 shutdown_connections 2023-10-06T03:00:02.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.819+0000 7f72660a4700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7244060550 0x7f7244062a00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.819+0000 7f72660a4700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f726014b660 0x7f7260157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.819+0000 7f72660a4700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600ba560 0x7f72600bd3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.819+0000 7f72660a4700 1 --2- 172.21.15.27:0/257426306 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72600b2f00 0x7f72600b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.819+0000 7f72660a4700 1 -- 172.21.15.27:0/257426306 >> 172.21.15.27:0/257426306 conn(0x7f72600beed0 msgr2=0x7f7260145150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.819+0000 7f72660a4700 1 -- 172.21.15.27:0/257426306 shutdown_connections 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.819+0000 7f72660a4700 1 -- 172.21.15.27:0/257426306 wait complete. 2023-10-06T03:00:02.834 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:00:02.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.939+0000 7f9decba5700 1 Processor -- start 2023-10-06T03:00:02.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.939+0000 7f9decba5700 1 -- start start 2023-10-06T03:00:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.939+0000 7f9decba5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de80b81f0 0x7f9de814adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.939+0000 7f9decba5700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de80a17e0 con 0x7f9de80bc590 2023-10-06T03:00:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.939+0000 7f9decba5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de814c870 con 0x7f9de80b7e20 2023-10-06T03:00:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.939+0000 7f9decba5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de80bd590 con 0x7f9de80b81f0 2023-10-06T03:00:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.939+0000 7f9ddeffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9de80bc590 0x7f9de80a43c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44582/0 (socket says 172.21.15.27:44582) 2023-10-06T03:00:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.939+0000 7f9ddeffd700 1 -- 172.21.15.27:0/4069639973 learned_addr learned my addr 172.21.15.27:0/4069639973 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:02.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.939+0000 7f9de7fff700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de80b81f0 0x7f9de814adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696982096 0 0) 0x7f9de80a17e0 con 0x7f9de80bc590 2023-10-06T03:00:02.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dd4003570 con 0x7f9de80bc590 2023-10-06T03:00:02.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139064643 0 0) 0x7f9de814c870 con 0x7f9de80b7e20 2023-10-06T03:00:02.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9de80a17e0 con 0x7f9de80b7e20 2023-10-06T03:00:02.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1035074967 0 0) 0x7f9dd4003570 con 0x7f9de80bc590 2023-10-06T03:00:02.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de80b81f0 msgr2=0x7f9de814adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de80b81f0 0x7f9de814adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 >> v1:172.21.15.123:6789/0 conn(0x7f9de80b7e20 legacy=0x7f9de80a3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de814bd90 con 0x7f9de80bc590 2023-10-06T03:00:02.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1323929577 0 0) 0x7f9dd0001470 con 0x7f9de80bc590 2023-10-06T03:00:02.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 >> v1:172.21.15.27:6789/0 conn(0x7f9de80bc590 legacy=0x7f9de80a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9dd4003c20 0x7f9dd4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de80b81f0 0x7f9dd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd4004d50 0x7f9dd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de80bd590 con 0x7f9dd4004d50 2023-10-06T03:00:02.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd400bbf0 con 0x7f9dd4003c20 2023-10-06T03:00:02.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd400bd60 con 0x7f9de80b81f0 2023-10-06T03:00:02.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de7fff700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd4004d50 0x7f9dd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de77fe700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9dd4003c20 0x7f9dd4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9ddeffd700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de80b81f0 0x7f9dd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de7fff700 1 -- 172.21.15.27:0/4069639973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de80b81f0 msgr2=0x7f9dd4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de7fff700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de80b81f0 0x7f9dd4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de7fff700 1 -- 172.21.15.27:0/4069639973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9dd4003c20 msgr2=0x7f9dd4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de7fff700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9dd4003c20 0x7f9dd4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de7fff700 1 -- 172.21.15.27:0/4069639973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd4003570 con 0x7f9dd4004d50 2023-10-06T03:00:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de77fe700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9dd4003c20 0x7f9dd4004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9ddeffd700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de80b81f0 0x7f9dd4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de7fff700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd4004d50 0x7f9dd40051c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9de00094d0 tx=0x7f9de000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b410837c00113bbc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de000ea90 con 0x7f9dd4004d50 2023-10-06T03:00:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de000f040 con 0x7f9dd4004d50 2023-10-06T03:00:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de6ffd700 1 -- 172.21.15.27:0/4069639973 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de000ee20 con 0x7f9dd4004d50 2023-10-06T03:00:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9decba5700 1 -- 172.21.15.27:0/4069639973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd4004d50 msgr2=0x7f9dd40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9decba5700 1 --2- 172.21.15.27:0/4069639973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd4004d50 0x7f9dd40051c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9de00094d0 tx=0x7f9de000b040 comp rx=0 tx=0).stop 2023-10-06T03:00:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9de7fff700 1 -- 172.21.15.27:0/4069639973 reap_dead start 2023-10-06T03:00:02.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9decba5700 1 -- 172.21.15.27:0/4069639973 shutdown_connections 2023-10-06T03:00:02.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9decba5700 1 -- 172.21.15.27:0/4069639973 >> 172.21.15.27:0/4069639973 conn(0x7f9de80be9c0 msgr2=0x7f9de80bedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9decba5700 1 -- 172.21.15.27:0/4069639973 shutdown_connections 2023-10-06T03:00:02.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9decba5700 1 -- 172.21.15.27:0/4069639973 wait complete. 2023-10-06T03:00:02.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9decba5700 1 Processor -- start 2023-10-06T03:00:02.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.943+0000 7f9decba5700 1 -- start start 2023-10-06T03:00:02.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9decba5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de815f010 0x7f9de80a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9decba5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9de80b94b0 0x7f9de80baec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9decba5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9de80bb400 0x7f9de815b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9decba5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de80baa30 con 0x7f9de80b94b0 2023-10-06T03:00:02.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9decba5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de80a56d0 con 0x7f9de80bb400 2023-10-06T03:00:02.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9decba5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de80bb870 con 0x7f9de815f010 2023-10-06T03:00:02.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9ddeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9de80b94b0 0x7f9de80baec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9ddeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9de80b94b0 0x7f9de80baec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49072/0 (socket says 172.21.15.27:49072) 2023-10-06T03:00:02.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9ddeffd700 1 -- 172.21.15.27:0/1609829679 learned_addr learned my addr 172.21.15.27:0/1609829679 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:02.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9de77fe700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de815f010 0x7f9de80a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9de7fff700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9de80bb400 0x7f9de815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9ddeffd700 1 -- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de815f010 msgr2=0x7f9de80a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9ddeffd700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de815f010 0x7f9de80a5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9ddeffd700 1 -- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9de80bb400 msgr2=0x7f9de815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9ddeffd700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9de80bb400 0x7f9de815b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9ddeffd700 1 -- 172.21.15.27:0/1609829679 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de815f810 con 0x7f9de80b94b0 2023-10-06T03:00:02.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9ddeffd700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9de80b94b0 0x7f9de80baec0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000d860 tx=0x7f9dd0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9ddffff700 1 -- 172.21.15.27:0/1609829679 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0004b00 con 0x7f9de80b94b0 2023-10-06T03:00:02.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9ddffff700 1 -- 172.21.15.27:0/1609829679 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd0004c60 con 0x7f9de80b94b0 2023-10-06T03:00:02.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9ddffff700 1 -- 172.21.15.27:0/1609829679 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0007150 con 0x7f9de80b94b0 2023-10-06T03:00:02.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9decba5700 1 -- 172.21.15.27:0/1609829679 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de815faf0 con 0x7f9de80b94b0 2023-10-06T03:00:02.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9decba5700 1 -- 172.21.15.27:0/1609829679 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de80a72b0 con 0x7f9de80b94b0 2023-10-06T03:00:02.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.947+0000 7f9decba5700 1 -- 172.21.15.27:0/1609829679 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de80babe0 con 0x7f9de80b94b0 2023-10-06T03:00:02.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.951+0000 7f9ddffff700 1 -- 172.21.15.27:0/1609829679 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9dd00074c0 con 0x7f9de80b94b0 2023-10-06T03:00:02.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.951+0000 7f9ddffff700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9dc8060550 0x7f9dc8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.951+0000 7f9ddffff700 1 -- 172.21.15.27:0/1609829679 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9dd007c9f0 con 0x7f9de80b94b0 2023-10-06T03:00:02.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.951+0000 7f9de77fe700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9dc8060550 0x7f9dc8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.951+0000 7f9de77fe700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9dc8060550 0x7f9dc8062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8007bc0 tx=0x7f9dd8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:02.959+0000 7f9ddffff700 1 -- 172.21.15.27:0/1609829679 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9dd004cfb0 con 0x7f9de80b94b0 2023-10-06T03:00:03.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.119+0000 7f9decba5700 1 -- 172.21.15.27:0/1609829679 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9de80a7d80 con 0x7f9de80b94b0 2023-10-06T03:00:03.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.119+0000 7f9ddffff700 1 -- 172.21.15.27:0/1609829679 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9dd00505d0 con 0x7f9de80b94b0 2023-10-06T03:00:03.125 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-10-06T03:00:03.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.123+0000 7f9decba5700 1 -- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9dc8060550 msgr2=0x7f9dc8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.123+0000 7f9decba5700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9dc8060550 0x7f9dc8062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8007bc0 tx=0x7f9dd8009040 comp rx=0 tx=0).stop 2023-10-06T03:00:03.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.123+0000 7f9decba5700 1 -- 172.21.15.27:0/1609829679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9de80b94b0 msgr2=0x7f9de80baec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.123+0000 7f9decba5700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9de80b94b0 0x7f9de80baec0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000d860 tx=0x7f9dd0009040 comp rx=0 tx=0).stop 2023-10-06T03:00:03.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.123+0000 7f9decba5700 1 -- 172.21.15.27:0/1609829679 shutdown_connections 2023-10-06T03:00:03.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.123+0000 7f9decba5700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9dc8060550 0x7f9dc8062a00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.123+0000 7f9decba5700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9de80bb400 0x7f9de815b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.123+0000 7f9decba5700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9de80b94b0 0x7f9de80baec0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.123+0000 7f9decba5700 1 --2- 172.21.15.27:0/1609829679 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9de815f010 0x7f9de80a5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.123+0000 7f9decba5700 1 -- 172.21.15.27:0/1609829679 >> 172.21.15.27:0/1609829679 conn(0x7f9de80be9c0 msgr2=0x7f9de80bce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:03.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.123+0000 7f9decba5700 1 -- 172.21.15.27:0/1609829679 shutdown_connections 2023-10-06T03:00:03.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.123+0000 7f9decba5700 1 -- 172.21.15.27:0/1609829679 wait complete. 2023-10-06T03:00:03.139 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:00:03.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.247+0000 7f0b9b19c700 1 Processor -- start 2023-10-06T03:00:03.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.247+0000 7f0b9b19c700 1 -- start start 2023-10-06T03:00:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.247+0000 7f0b9b19c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9406c910 0x7f0b9406cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.247+0000 7f0b9b19c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0b940be5c0 0x7f0b9414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.247+0000 7f0b9b19c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b940a2be0 con 0x7f0b940a2070 2023-10-06T03:00:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.247+0000 7f0b9b19c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b940bd6e0 con 0x7f0b940be5c0 2023-10-06T03:00:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.247+0000 7f0b9b19c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9414c240 con 0x7f0b9406c910 2023-10-06T03:00:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.247+0000 7f0b99739700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0b940a2070 0x7f0b940a24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44598/0 (socket says 172.21.15.27:44598) 2023-10-06T03:00:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.247+0000 7f0b99739700 1 -- 172.21.15.27:0/1300866298 learned_addr learned my addr 172.21.15.27:0/1300866298 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.247+0000 7f0b93fff700 1 --2- 172.21.15.27:0/1300866298 >> v2:172.21.15.123:3300/0 conn(0x7f0b940be5c0 0x7f0b9414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.247+0000 7f0b98f38700 1 --2- 172.21.15.27:0/1300866298 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9406c910 0x7f0b9406cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.247+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264710120 0 0) 0x7f0b940a2be0 con 0x7f0b940a2070 2023-10-06T03:00:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.247+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b80003570 con 0x7f0b940a2070 2023-10-06T03:00:03.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4691503 0 0) 0x7f0b80003570 con 0x7f0b940a2070 2023-10-06T03:00:03.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9406c910 msgr2=0x7f0b9406cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:03.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 --2- 172.21.15.27:0/1300866298 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9406c910 0x7f0b9406cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 >> v2:172.21.15.123:3300/0 conn(0x7f0b940be5c0 msgr2=0x7f0b9414bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:03.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 --2- 172.21.15.27:0/1300866298 >> v2:172.21.15.123:3300/0 conn(0x7f0b940be5c0 0x7f0b9414bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9414c4f0 con 0x7f0b940a2070 2023-10-06T03:00:03.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1323929577 0 0) 0x7f0b8c0017f0 con 0x7f0b940a2070 2023-10-06T03:00:03.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 >> v1:172.21.15.27:6789/0 conn(0x7f0b940a2070 legacy=0x7f0b940a24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 --2- 172.21.15.27:0/1300866298 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9406c910 0x7f0b80003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 --2- 172.21.15.27:0/1300866298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b80003fe0 0x7f0b80004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 --2- 172.21.15.27:0/1300866298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b80004d50 0x7f0b800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940bd6e0 con 0x7f0b80004d50 2023-10-06T03:00:03.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9414c240 con 0x7f0b80003fe0 2023-10-06T03:00:03.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8000ba90 con 0x7f0b9406c910 2023-10-06T03:00:03.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b99739700 1 --2- 172.21.15.27:0/1300866298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b80004d50 0x7f0b800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b93fff700 1 --2- 172.21.15.27:0/1300866298 >> v2:172.21.15.123:3300/0 conn(0x7f0b940be5c0 0x7f0b9414bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:03.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b98f38700 1 --2- 172.21.15.27:0/1300866298 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9406c910 0x7f0b80003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b93fff700 1 --2- 172.21.15.27:0/1300866298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b80003fe0 0x7f0b80004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b99739700 1 -- 172.21.15.27:0/1300866298 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9406c910 msgr2=0x7f0b80003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:03.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b99739700 1 --2- 172.21.15.27:0/1300866298 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9406c910 0x7f0b80003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b99739700 1 -- 172.21.15.27:0/1300866298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b80003fe0 msgr2=0x7f0b80004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:03.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b99739700 1 --2- 172.21.15.27:0/1300866298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b80003fe0 0x7f0b80004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b99739700 1 -- 172.21.15.27:0/1300866298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b80003570 con 0x7f0b80004d50 2023-10-06T03:00:03.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b98f38700 1 --2- 172.21.15.27:0/1300866298 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9406c910 0x7f0b80003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:03.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b99739700 1 --2- 172.21.15.27:0/1300866298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b80004d50 0x7f0b800051c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00a950 tx=0x7f0b8c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef36c4fa2ccbe20 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:03.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0070f0 con 0x7f0b80004d50 2023-10-06T03:00:03.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c007250 con 0x7f0b80004d50 2023-10-06T03:00:03.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b937fe700 1 -- 172.21.15.27:0/1300866298 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c007610 con 0x7f0b80004d50 2023-10-06T03:00:03.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b9b19c700 1 -- 172.21.15.27:0/1300866298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b80004d50 msgr2=0x7f0b800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b9b19c700 1 --2- 172.21.15.27:0/1300866298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b80004d50 0x7f0b800051c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00a950 tx=0x7f0b8c00a060 comp rx=0 tx=0).stop 2023-10-06T03:00:03.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b99739700 1 -- 172.21.15.27:0/1300866298 reap_dead start 2023-10-06T03:00:03.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b9b19c700 1 -- 172.21.15.27:0/1300866298 shutdown_connections 2023-10-06T03:00:03.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b9b19c700 1 -- 172.21.15.27:0/1300866298 >> 172.21.15.27:0/1300866298 conn(0x7f0b940bf5e0 msgr2=0x7f0b9406df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:03.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b9b19c700 1 -- 172.21.15.27:0/1300866298 shutdown_connections 2023-10-06T03:00:03.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.251+0000 7f0b9b19c700 1 -- 172.21.15.27:0/1300866298 wait complete. 2023-10-06T03:00:03.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.255+0000 7f0b9b19c700 1 Processor -- start 2023-10-06T03:00:03.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.255+0000 7f0b9b19c700 1 -- start start 2023-10-06T03:00:03.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.255+0000 7f0b9b19c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b80004d50 0x7f0b9414d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.255+0000 7f0b9b19c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b9414b090 0x7f0b9415e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.255+0000 7f0b9b19c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9415eca0 0x7f0b941499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.255+0000 7f0b9b19c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9414fdb0 con 0x7f0b9414b090 2023-10-06T03:00:03.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.255+0000 7f0b9b19c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9414aea0 con 0x7f0b80004d50 2023-10-06T03:00:03.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.255+0000 7f0b9b19c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9414a770 con 0x7f0b9415eca0 2023-10-06T03:00:03.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.255+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b9414b090 0x7f0b9415e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.255+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b9414b090 0x7f0b9415e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49090/0 (socket says 172.21.15.27:49090) 2023-10-06T03:00:03.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.255+0000 7f0b93fff700 1 -- 172.21.15.27:0/3552959306 learned_addr learned my addr 172.21.15.27:0/3552959306 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:03.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.255+0000 7f0b98f38700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b80004d50 0x7f0b9414d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b99739700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9415eca0 0x7f0b941499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b93fff700 1 -- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9415eca0 msgr2=0x7f0b941499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b93fff700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9415eca0 0x7f0b941499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b93fff700 1 -- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b80004d50 msgr2=0x7f0b9414d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b93fff700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b80004d50 0x7f0b9414d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b93fff700 1 -- 172.21.15.27:0/3552959306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9414b660 con 0x7f0b9414b090 2023-10-06T03:00:03.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b93fff700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b9414b090 0x7f0b9415e760 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0b84010c70 tx=0x7f0b84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:03.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b90ff9700 1 -- 172.21.15.27:0/3552959306 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8400e860 con 0x7f0b9414b090 2023-10-06T03:00:03.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b90ff9700 1 -- 172.21.15.27:0/3552959306 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8400e9c0 con 0x7f0b9414b090 2023-10-06T03:00:03.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b9b19c700 1 -- 172.21.15.27:0/3552959306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9415f350 con 0x7f0b9414b090 2023-10-06T03:00:03.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b90ff9700 1 -- 172.21.15.27:0/3552959306 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8400ed60 con 0x7f0b9414b090 2023-10-06T03:00:03.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b9b19c700 1 -- 172.21.15.27:0/3552959306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b940bcae0 con 0x7f0b9414b090 2023-10-06T03:00:03.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b9b19c700 1 -- 172.21.15.27:0/3552959306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9414a5d0 con 0x7f0b9414b090 2023-10-06T03:00:03.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b90ff9700 1 -- 172.21.15.27:0/3552959306 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0b8401c610 con 0x7f0b9414b090 2023-10-06T03:00:03.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b90ff9700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f0b74060550 0x7f0b74062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.259+0000 7f0b90ff9700 1 -- 172.21.15.27:0/3552959306 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0b8407ced0 con 0x7f0b9414b090 2023-10-06T03:00:03.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.263+0000 7f0b98f38700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f0b74060550 0x7f0b74062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.263+0000 7f0b98f38700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f0b74060550 0x7f0b74062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009db0 tx=0x7f0b7c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:03.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.267+0000 7f0b90ff9700 1 -- 172.21.15.27:0/3552959306 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0b9414a5d0 con 0x7f0b9414b090 2023-10-06T03:00:03.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.431+0000 7f0b9b19c700 1 -- 172.21.15.27:0/3552959306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b9414a5d0 con 0x7f0b9414b090 2023-10-06T03:00:03.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.435+0000 7f0b90ff9700 1 -- 172.21.15.27:0/3552959306 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b9414a5d0 con 0x7f0b9414b090 2023-10-06T03:00:03.439 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-10-06T03:00:03.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.435+0000 7f0b9b19c700 1 -- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f0b74060550 msgr2=0x7f0b74062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.435+0000 7f0b9b19c700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f0b74060550 0x7f0b74062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009db0 tx=0x7f0b7c008040 comp rx=0 tx=0).stop 2023-10-06T03:00:03.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.435+0000 7f0b9b19c700 1 -- 172.21.15.27:0/3552959306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b9414b090 msgr2=0x7f0b9415e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.435+0000 7f0b9b19c700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b9414b090 0x7f0b9415e760 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0b84010c70 tx=0x7f0b84008040 comp rx=0 tx=0).stop 2023-10-06T03:00:03.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.435+0000 7f0b9b19c700 1 -- 172.21.15.27:0/3552959306 shutdown_connections 2023-10-06T03:00:03.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.435+0000 7f0b9b19c700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f0b74060550 0x7f0b74062a00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.435+0000 7f0b9b19c700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b9415eca0 0x7f0b941499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.435+0000 7f0b9b19c700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b9414b090 0x7f0b9415e760 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.435+0000 7f0b9b19c700 1 --2- 172.21.15.27:0/3552959306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b80004d50 0x7f0b9414d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.435+0000 7f0b9b19c700 1 -- 172.21.15.27:0/3552959306 >> 172.21.15.27:0/3552959306 conn(0x7f0b940bf5e0 msgr2=0x7f0b940a4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:03.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.435+0000 7f0b9b19c700 1 -- 172.21.15.27:0/3552959306 shutdown_connections 2023-10-06T03:00:03.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.435+0000 7f0b9b19c700 1 -- 172.21.15.27:0/3552959306 wait complete. 2023-10-06T03:00:03.453 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.559+0000 7f552f59e700 1 Processor -- start 2023-10-06T03:00:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.559+0000 7f552f59e700 1 -- start start 2023-10-06T03:00:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55300baec0 0x7f55301487e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f55300a0a30 0x7f553009d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553009dcb0 con 0x7f553009d850 2023-10-06T03:00:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5530148d20 con 0x7f55300a0a30 2023-10-06T03:00:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5530147a80 con 0x7f55300baec0 2023-10-06T03:00:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552dd9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f55300a0a30 0x7f553009d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552ed9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f553009d850 0x7f553014b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44606/0 (socket says 172.21.15.27:44606) 2023-10-06T03:00:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552ed9d700 1 -- 172.21.15.27:0/4050716063 learned_addr learned my addr 172.21.15.27:0/4050716063 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552e59c700 1 --2- 172.21.15.27:0/4050716063 >> v2:172.21.15.123:3300/0 conn(0x7f55300baec0 0x7f55301487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552d59a700 1 -- 172.21.15.27:0/4050716063 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366374848 0 0) 0x7f553009dcb0 con 0x7f553009d850 2023-10-06T03:00:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552d59a700 1 -- 172.21.15.27:0/4050716063 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f551c005780 con 0x7f553009d850 2023-10-06T03:00:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552dd9b700 1 -- 172.21.15.27:0/4050716063 >> v2:172.21.15.123:3300/0 conn(0x7f55300baec0 msgr2=0x7f55301487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552dd9b700 1 --2- 172.21.15.27:0/4050716063 >> v2:172.21.15.123:3300/0 conn(0x7f55300baec0 0x7f55301487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552dd9b700 1 -- 172.21.15.27:0/4050716063 >> v1:172.21.15.27:6789/0 conn(0x7f553009d850 legacy=0x7f553014b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552dd9b700 1 -- 172.21.15.27:0/4050716063 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5530147d00 con 0x7f55300a0a30 2023-10-06T03:00:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552dd9b700 1 --2- 172.21.15.27:0/4050716063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55300a0a30 0x7f553009d310 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5530067e60 tx=0x7f5520009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6714c7816e1aa1ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552d59a700 1 -- 172.21.15.27:0/4050716063 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552000e070 con 0x7f55300a0a30 2023-10-06T03:00:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552d59a700 1 -- 172.21.15.27:0/4050716063 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552000bb60 con 0x7f55300a0a30 2023-10-06T03:00:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552d59a700 1 -- 172.21.15.27:0/4050716063 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520012430 con 0x7f55300a0a30 2023-10-06T03:00:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 -- 172.21.15.27:0/4050716063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55300a0a30 msgr2=0x7f553009d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 --2- 172.21.15.27:0/4050716063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55300a0a30 0x7f553009d310 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5530067e60 tx=0x7f5520009780 comp rx=0 tx=0).stop 2023-10-06T03:00:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 -- 172.21.15.27:0/4050716063 shutdown_connections 2023-10-06T03:00:03.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 --2- 172.21.15.27:0/4050716063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55300a0a30 0x7f553009d310 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 --2- 172.21.15.27:0/4050716063 >> v2:172.21.15.123:3300/0 conn(0x7f55300baec0 0x7f55301487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 -- 172.21.15.27:0/4050716063 >> 172.21.15.27:0/4050716063 conn(0x7f553006eb10 msgr2=0x7f55300ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:03.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 -- 172.21.15.27:0/4050716063 shutdown_connections 2023-10-06T03:00:03.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 -- 172.21.15.27:0/4050716063 wait complete. 2023-10-06T03:00:03.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 Processor -- start 2023-10-06T03:00:03.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.563+0000 7f552f59e700 1 -- start start 2023-10-06T03:00:03.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f553009d850 0x7f553006ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552f59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55300a0a30 0x7f553014ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552f59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55300baec0 0x7f5530149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552f59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5530156f00 con 0x7f55300baec0 2023-10-06T03:00:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552f59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553006a9e0 con 0x7f553009d850 2023-10-06T03:00:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552f59e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553006a420 con 0x7f55300a0a30 2023-10-06T03:00:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55300baec0 0x7f5530149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55300baec0 0x7f5530149110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49104/0 (socket says 172.21.15.27:49104) 2023-10-06T03:00:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552ed9d700 1 -- 172.21.15.27:0/1367722780 learned_addr learned my addr 172.21.15.27:0/1367722780 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552dd9b700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55300a0a30 0x7f553014ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552e59c700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f553009d850 0x7f553006ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552ed9d700 1 -- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55300a0a30 msgr2=0x7f553014ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552ed9d700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55300a0a30 0x7f553014ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552ed9d700 1 -- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f553009d850 msgr2=0x7f553006ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552ed9d700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f553009d850 0x7f553006ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552ed9d700 1 -- 172.21.15.27:0/1367722780 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5520009a20 con 0x7f55300baec0 2023-10-06T03:00:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552ed9d700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55300baec0 0x7f5530149110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f55280010e0 tx=0x7f5528007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f55267fc700 1 -- 172.21.15.27:0/1367722780 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5528005c00 con 0x7f55300baec0 2023-10-06T03:00:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f55267fc700 1 -- 172.21.15.27:0/1367722780 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5528005d60 con 0x7f55300baec0 2023-10-06T03:00:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552f59e700 1 -- 172.21.15.27:0/1367722780 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553006a700 con 0x7f55300baec0 2023-10-06T03:00:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f55267fc700 1 -- 172.21.15.27:0/1367722780 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280072e0 con 0x7f55300baec0 2023-10-06T03:00:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552f59e700 1 -- 172.21.15.27:0/1367722780 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553006b1c0 con 0x7f55300baec0 2023-10-06T03:00:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f552f59e700 1 -- 172.21.15.27:0/1367722780 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5530146e10 con 0x7f55300baec0 2023-10-06T03:00:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.567+0000 7f55267fc700 1 -- 172.21.15.27:0/1367722780 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5528012400 con 0x7f55300baec0 2023-10-06T03:00:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.571+0000 7f55267fc700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5510060550 0x7f5510062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.571+0000 7f55267fc700 1 -- 172.21.15.27:0/1367722780 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f552807bce0 con 0x7f55300baec0 2023-10-06T03:00:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.571+0000 7f552e59c700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5510060550 0x7f5510062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.571+0000 7f552e59c700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5510060550 0x7f5510062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5518006fd0 tx=0x7f5518008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:03.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.575+0000 7f55267fc700 1 -- 172.21.15.27:0/1367722780 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5530146e10 con 0x7f55300baec0 2023-10-06T03:00:03.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.779+0000 7f552f59e700 1 -- 172.21.15.27:0/1367722780 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5530146e10 con 0x7f55300baec0 2023-10-06T03:00:03.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.779+0000 7f55267fc700 1 -- 172.21.15.27:0/1367722780 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3082 (secure 0 0 0) 0x7f5530146e10 con 0x7f55300baec0 2023-10-06T03:00:03.784 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:00:03.784 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3318688789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3318688789},{"type":"v1","addr":"172.21.15.123:6835","nonce":3318688789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:53.638660+0000","modified":"2023-10-06T02:59:56.293208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6833/3144883581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3144883581},{"type":"v1","addr":"172.21.15.27:6833","nonce":3144883581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:00:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.779+0000 7f552f59e700 1 -- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5510060550 msgr2=0x7f5510062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.779+0000 7f552f59e700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5510060550 0x7f5510062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5518006fd0 tx=0x7f5518008040 comp rx=0 tx=0).stop 2023-10-06T03:00:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.783+0000 7f552f59e700 1 -- 172.21.15.27:0/1367722780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55300baec0 msgr2=0x7f5530149110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.783+0000 7f552f59e700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55300baec0 0x7f5530149110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f55280010e0 tx=0x7f5528007dd0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.783+0000 7f552f59e700 1 -- 172.21.15.27:0/1367722780 shutdown_connections 2023-10-06T03:00:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.783+0000 7f552f59e700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5510060550 0x7f5510062a00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.783+0000 7f552f59e700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55300baec0 0x7f5530149110 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.783+0000 7f552f59e700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55300a0a30 0x7f553014ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.783+0000 7f552f59e700 1 --2- 172.21.15.27:0/1367722780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f553009d850 0x7f553006ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.783+0000 7f552f59e700 1 -- 172.21.15.27:0/1367722780 >> 172.21.15.27:0/1367722780 conn(0x7f553006eb10 msgr2=0x7f5530145f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.783+0000 7f552f59e700 1 -- 172.21.15.27:0/1367722780 shutdown_connections 2023-10-06T03:00:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.783+0000 7f552f59e700 1 -- 172.21.15.27:0/1367722780 wait complete. 2023-10-06T03:00:03.789 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 6 2023-10-06T03:00:03.799 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:03.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe743c700 1 Processor -- start 2023-10-06T03:00:03.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe743c700 1 -- start start 2023-10-06T03:00:03.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe743c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fefe006b190 0x7fefe014fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe743c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fefe0150130 0x7fefe0150530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe743c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe0153de0 con 0x7fefe00b75d0 2023-10-06T03:00:03.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe743c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe0146ab0 con 0x7fefe0150130 2023-10-06T03:00:03.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe743c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe0150a70 con 0x7fefe006b190 2023-10-06T03:00:03.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe59d9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fefe0150130 0x7fefe0150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe59d9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fefe0150130 0x7fefe0150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49120/0 (socket says 172.21.15.27:49120) 2023-10-06T03:00:03.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe59d9700 1 -- 172.21.15.27:0/336625238 learned_addr learned my addr 172.21.15.27:0/336625238 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:03.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe49d7700 1 --2- 172.21.15.27:0/336625238 >> v2:172.21.15.123:3300/0 conn(0x7fefe006b190 0x7fefe014fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe59d9700 1 -- 172.21.15.27:0/336625238 >> v2:172.21.15.123:3300/0 conn(0x7fefe006b190 msgr2=0x7fefe014fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:03.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe59d9700 1 --2- 172.21.15.27:0/336625238 >> v2:172.21.15.123:3300/0 conn(0x7fefe006b190 0x7fefe014fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe59d9700 1 -- 172.21.15.27:0/336625238 >> v1:172.21.15.123:6789/0 conn(0x7fefe00b75d0 legacy=0x7fefe006bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:03.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe59d9700 1 -- 172.21.15.27:0/336625238 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0153aa0 con 0x7fefe0150130 2023-10-06T03:00:03.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.899+0000 7fefe59d9700 1 --2- 172.21.15.27:0/336625238 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefe0150130 0x7fefe0150530 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fefe006dc60 tx=0x7fefd8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfeab7d995f08511 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:03.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefd3fff700 1 -- 172.21.15.27:0/336625238 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd800e070 con 0x7fefe0150130 2023-10-06T03:00:03.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefd3fff700 1 -- 172.21.15.27:0/336625238 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd800ba50 con 0x7fefe0150130 2023-10-06T03:00:03.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefd3fff700 1 -- 172.21.15.27:0/336625238 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd80092e0 con 0x7fefe0150130 2023-10-06T03:00:03.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 -- 172.21.15.27:0/336625238 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefe0150130 msgr2=0x7fefe0150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 --2- 172.21.15.27:0/336625238 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefe0150130 0x7fefe0150530 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fefe006dc60 tx=0x7fefd8009840 comp rx=0 tx=0).stop 2023-10-06T03:00:03.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 -- 172.21.15.27:0/336625238 shutdown_connections 2023-10-06T03:00:03.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 --2- 172.21.15.27:0/336625238 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefe0150130 0x7fefe0150530 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 --2- 172.21.15.27:0/336625238 >> v2:172.21.15.123:3300/0 conn(0x7fefe006b190 0x7fefe014fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 -- 172.21.15.27:0/336625238 >> 172.21.15.27:0/336625238 conn(0x7fefe00bde40 msgr2=0x7fefe00be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:03.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 -- 172.21.15.27:0/336625238 shutdown_connections 2023-10-06T03:00:03.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 -- 172.21.15.27:0/336625238 wait complete. 2023-10-06T03:00:03.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 Processor -- start 2023-10-06T03:00:03.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 -- start start 2023-10-06T03:00:03.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe006b190 0x7fefe01631a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefe00b75d0 0x7fefe0145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefe0150130 0x7fefe01438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.903+0000 7fefe743c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe00b7250 con 0x7fefe0150130 2023-10-06T03:00:03.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe743c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe0152380 con 0x7fefe006b190 2023-10-06T03:00:03.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe743c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe0152010 con 0x7fefe00b75d0 2023-10-06T03:00:03.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe59d9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefe0150130 0x7fefe01438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe59d9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefe0150130 0x7fefe01438e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49124/0 (socket says 172.21.15.27:49124) 2023-10-06T03:00:03.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe59d9700 1 -- 172.21.15.27:0/2472083921 learned_addr learned my addr 172.21.15.27:0/2472083921 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:03.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe51d8700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe006b190 0x7fefe01631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe49d7700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefe00b75d0 0x7fefe0145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe59d9700 1 -- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefe00b75d0 msgr2=0x7fefe0145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe59d9700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefe00b75d0 0x7fefe0145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe59d9700 1 -- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe006b190 msgr2=0x7fefe01631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe59d9700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe006b190 0x7fefe01631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe59d9700 1 -- 172.21.15.27:0/2472083921 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd8009ae0 con 0x7fefe0150130 2023-10-06T03:00:03.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe51d8700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe006b190 0x7fefe01631a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:03.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe59d9700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefe0150130 0x7fefe01438e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fefe006c530 tx=0x7fefd8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefd17fa700 1 -- 172.21.15.27:0/2472083921 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd800be60 con 0x7fefe0150130 2023-10-06T03:00:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefd17fa700 1 -- 172.21.15.27:0/2472083921 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd8008d90 con 0x7fefe0150130 2023-10-06T03:00:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefd17fa700 1 -- 172.21.15.27:0/2472083921 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd80266b0 con 0x7fefe0150130 2023-10-06T03:00:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe743c700 1 -- 172.21.15.27:0/2472083921 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe0151280 con 0x7fefe0150130 2023-10-06T03:00:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe743c700 1 -- 172.21.15.27:0/2472083921 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe01532e0 con 0x7fefe0150130 2023-10-06T03:00:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.907+0000 7fefe743c700 1 -- 172.21.15.27:0/2472083921 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe004be40 con 0x7fefe0150130 2023-10-06T03:00:03.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.911+0000 7fefd17fa700 1 -- 172.21.15.27:0/2472083921 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fefd8003040 con 0x7fefe0150130 2023-10-06T03:00:03.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.911+0000 7fefd17fa700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fefc4060580 0x7fefc4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.911+0000 7fefd17fa700 1 -- 172.21.15.27:0/2472083921 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fefd807e8c0 con 0x7fefe0150130 2023-10-06T03:00:03.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.911+0000 7fefe51d8700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fefc4060580 0x7fefc4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.911+0000 7fefe51d8700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fefc4060580 0x7fefc4062a30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fefdc007fd0 tx=0x7fefdc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:03.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:03.919+0000 7fefd17fa700 1 -- 172.21.15.27:0/2472083921 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fefd804ecb0 con 0x7fefe0150130 2023-10-06T03:00:04.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.079+0000 7fefe743c700 1 -- 172.21.15.27:0/2472083921 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefe01524c0 con 0x7fefe0150130 2023-10-06T03:00:04.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.083+0000 7fefd17fa700 1 -- 172.21.15.27:0/2472083921 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fefd80522d0 con 0x7fefe0150130 2023-10-06T03:00:04.089 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:00:04.089 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":24,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:54.652472+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:59:47.570918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:51.949130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:52.638817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.087+0000 7fefe743c700 1 -- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fefc4060580 msgr2=0x7fefc4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.087+0000 7fefe743c700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fefc4060580 0x7fefc4062a30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fefdc007fd0 tx=0x7fefdc009040 comp rx=0 tx=0).stop 2023-10-06T03:00:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.087+0000 7fefe743c700 1 -- 172.21.15.27:0/2472083921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefe0150130 msgr2=0x7fefe01438e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.087+0000 7fefe743c700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefe0150130 0x7fefe01438e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fefe006c530 tx=0x7fefd8018000 comp rx=0 tx=0).stop 2023-10-06T03:00:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.087+0000 7fefe743c700 1 -- 172.21.15.27:0/2472083921 shutdown_connections 2023-10-06T03:00:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.087+0000 7fefe743c700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fefc4060580 0x7fefc4062a30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.087+0000 7fefe743c700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefe0150130 0x7fefe01438e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.087+0000 7fefe743c700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefe00b75d0 0x7fefe0145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.087+0000 7fefe743c700 1 --2- 172.21.15.27:0/2472083921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe006b190 0x7fefe01631a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.087+0000 7fefe743c700 1 -- 172.21.15.27:0/2472083921 >> 172.21.15.27:0/2472083921 conn(0x7fefe00bde40 msgr2=0x7fefe00685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:04.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.087+0000 7fefe743c700 1 -- 172.21.15.27:0/2472083921 shutdown_connections 2023-10-06T03:00:04.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.087+0000 7fefe743c700 1 -- 172.21.15.27:0/2472083921 wait complete. 2023-10-06T03:00:04.109 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:59:43.021608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:59:47.570918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:59:51.949130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:59:52.638817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:00:04.110 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:00:04.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d51c7c700 1 Processor -- start 2023-10-06T03:00:04.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d51c7c700 1 -- start start 2023-10-06T03:00:04.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d51c7c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8d4c0b7e20 0x7f8d4c0b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d51c7c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d4c0bc590 0x7f8d4c0a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d51c7c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4c0a17e0 con 0x7f8d4c0a41f0 2023-10-06T03:00:04.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d51c7c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c14c870 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d51c7c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c0bd590 con 0x7f8d4c0bc590 2023-10-06T03:00:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d50c7a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8d4c0b7e20 0x7f8d4c0b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d4bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d4c0bc590 0x7f8d4c0a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d4bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d4c0bc590 0x7f8d4c0a3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:55146/0 (socket says 172.21.15.27:55146) 2023-10-06T03:00:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d5147b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8d4c0a41f0 0x7f8d4c14adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.27:49840/0 (socket says 172.21.15.27:49840) 2023-10-06T03:00:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d4bfff700 1 -- 172.21.15.27:0/1200743579 learned_addr learned my addr 172.21.15.27:0/1200743579 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d50c7a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8d4c0b7e20 0x7f8d4c0b81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49126/0 (socket says 172.21.15.27:49126) 2023-10-06T03:00:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d50c7a700 1 -- 172.21.15.27:0/1200743579 >> v2:172.21.15.123:3300/0 conn(0x7f8d4c0bc590 msgr2=0x7f8d4c0a3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d50c7a700 1 --2- 172.21.15.27:0/1200743579 >> v2:172.21.15.123:3300/0 conn(0x7f8d4c0bc590 0x7f8d4c0a3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d50c7a700 1 -- 172.21.15.27:0/1200743579 >> v1:172.21.15.123:6789/0 conn(0x7f8d4c0a41f0 legacy=0x7f8d4c14adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.219+0000 7f8d50c7a700 1 -- 172.21.15.27:0/1200743579 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c14bd90 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d50c7a700 1 --2- 172.21.15.27:0/1200743579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d4c0b7e20 0x7f8d4c0b81f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0872d0 tx=0x7f8d400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a219ff682bfb7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d4b7fe700 1 -- 172.21.15.27:0/1200743579 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40011630 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d4b7fe700 1 -- 172.21.15.27:0/1200743579 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40011790 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d4b7fe700 1 -- 172.21.15.27:0/1200743579 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40011b30 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d51c7c700 1 -- 172.21.15.27:0/1200743579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d4c0b7e20 msgr2=0x7f8d4c0b81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d51c7c700 1 --2- 172.21.15.27:0/1200743579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d4c0b7e20 0x7f8d4c0b81f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0872d0 tx=0x7f8d400091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d51c7c700 1 -- 172.21.15.27:0/1200743579 shutdown_connections 2023-10-06T03:00:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d51c7c700 1 --2- 172.21.15.27:0/1200743579 >> v2:172.21.15.123:3300/0 conn(0x7f8d4c0bc590 0x7f8d4c0a3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d51c7c700 1 --2- 172.21.15.27:0/1200743579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d4c0b7e20 0x7f8d4c0b81f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d51c7c700 1 -- 172.21.15.27:0/1200743579 >> 172.21.15.27:0/1200743579 conn(0x7f8d4c0be9c0 msgr2=0x7f8d4c0bedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d51c7c700 1 -- 172.21.15.27:0/1200743579 shutdown_connections 2023-10-06T03:00:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d51c7c700 1 -- 172.21.15.27:0/1200743579 wait complete. 2023-10-06T03:00:04.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d51c7c700 1 Processor -- start 2023-10-06T03:00:04.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.223+0000 7f8d51c7c700 1 -- start start 2023-10-06T03:00:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d51c7c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d4c0a41f0 0x7f8d4c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d51c7c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d4c0b7e20 0x7f8d4c147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d51c7c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d4c0bc590 0x7f8d4c1482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d51c7c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0baae0 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d51c7c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0bc3c0 con 0x7f8d4c0bc590 2023-10-06T03:00:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d51c7c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0a3bc0 con 0x7f8d4c0a41f0 2023-10-06T03:00:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d4bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d4c0b7e20 0x7f8d4c147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d4bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d4c0b7e20 0x7f8d4c147d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49136/0 (socket says 172.21.15.27:49136) 2023-10-06T03:00:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d4bfff700 1 -- 172.21.15.27:0/800370792 learned_addr learned my addr 172.21.15.27:0/800370792 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d5147b700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d4c0bc590 0x7f8d4c1482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d50c7a700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d4c0a41f0 0x7f8d4c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d4bfff700 1 -- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d4c0a41f0 msgr2=0x7f8d4c0a3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d4bfff700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d4c0a41f0 0x7f8d4c0a3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d4bfff700 1 -- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d4c0bc590 msgr2=0x7f8d4c1482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d4bfff700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d4c0bc590 0x7f8d4c1482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d4bfff700 1 -- 172.21.15.27:0/800370792 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40009420 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d5147b700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d4c0bc590 0x7f8d4c1482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:04.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d50c7a700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d4c0a41f0 0x7f8d4c0a3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:04.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d4bfff700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d4c0b7e20 0x7f8d4c147d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00e930 tx=0x7f8d3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:04.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d48ff9700 1 -- 172.21.15.27:0/800370792 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c009500 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d48ff9700 1 -- 172.21.15.27:0/800370792 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c00c850 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d51c7c700 1 -- 172.21.15.27:0/800370792 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c0bbd70 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d48ff9700 1 -- 172.21.15.27:0/800370792 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c00cbf0 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.227+0000 7f8d51c7c700 1 -- 172.21.15.27:0/800370792 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c14e010 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.231+0000 7f8d51c7c700 1 -- 172.21.15.27:0/800370792 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c087c00 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.231+0000 7f8d48ff9700 1 -- 172.21.15.27:0/800370792 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8d3c013470 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.231+0000 7f8d48ff9700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8d38060550 0x7f8d38062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.231+0000 7f8d48ff9700 1 -- 172.21.15.27:0/800370792 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d3c07c9f0 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.231+0000 7f8d50c7a700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8d38060550 0x7f8d38062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.231+0000 7f8d50c7a700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8d38060550 0x7f8d38062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8d40003080 tx=0x7f8d40017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:04.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.239+0000 7f8d48ff9700 1 -- 172.21.15.27:0/800370792 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8d3c050910 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.399+0000 7f8d51c7c700 1 -- 172.21.15.27:0/800370792 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d4c15eb50 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.399+0000 7f8d48ff9700 1 -- 172.21.15.27:0/800370792 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d3c0504a0 con 0x7f8d4c0b7e20 2023-10-06T03:00:04.406 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-10-06T03:00:04.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.403+0000 7f8d51c7c700 1 -- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8d38060550 msgr2=0x7f8d38062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.403+0000 7f8d51c7c700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8d38060550 0x7f8d38062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8d40003080 tx=0x7f8d40017000 comp rx=0 tx=0).stop 2023-10-06T03:00:04.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.403+0000 7f8d51c7c700 1 -- 172.21.15.27:0/800370792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d4c0b7e20 msgr2=0x7f8d4c147d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.403+0000 7f8d51c7c700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d4c0b7e20 0x7f8d4c147d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00e930 tx=0x7f8d3c009250 comp rx=0 tx=0).stop 2023-10-06T03:00:04.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.403+0000 7f8d51c7c700 1 -- 172.21.15.27:0/800370792 shutdown_connections 2023-10-06T03:00:04.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.403+0000 7f8d51c7c700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8d38060550 0x7f8d38062a00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.403+0000 7f8d51c7c700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d4c0bc590 0x7f8d4c1482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.403+0000 7f8d51c7c700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d4c0b7e20 0x7f8d4c147d80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.403+0000 7f8d51c7c700 1 --2- 172.21.15.27:0/800370792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d4c0a41f0 0x7f8d4c0a3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.403+0000 7f8d51c7c700 1 -- 172.21.15.27:0/800370792 >> 172.21.15.27:0/800370792 conn(0x7f8d4c0be9c0 msgr2=0x7f8d4c149a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:04.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.403+0000 7f8d51c7c700 1 -- 172.21.15.27:0/800370792 shutdown_connections 2023-10-06T03:00:04.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.403+0000 7f8d51c7c700 1 -- 172.21.15.27:0/800370792 wait complete. 2023-10-06T03:00:04.421 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:00:04.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.527+0000 7f1959990700 1 Processor -- start 2023-10-06T03:00:04.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.527+0000 7f1959990700 1 -- start start 2023-10-06T03:00:04.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.527+0000 7f1959990700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f195406f0c0 0x7f19540bab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.527+0000 7f1959990700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f19540bb050 0x7f1954067af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.527+0000 7f1959990700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19540ba3a0 con 0x7f1954068030 2023-10-06T03:00:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.527+0000 7f1959990700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19540ba680 con 0x7f195406f0c0 2023-10-06T03:00:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.527+0000 7f1959990700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540b64c0 con 0x7f19540bb050 2023-10-06T03:00:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.527+0000 7f195898e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f195406f0c0 0x7f19540bab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.527+0000 7f195898e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f195406f0c0 0x7f19540bab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49146/0 (socket says 172.21.15.27:49146) 2023-10-06T03:00:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.527+0000 7f195898e700 1 -- 172.21.15.27:0/876046918 learned_addr learned my addr 172.21.15.27:0/876046918 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:04.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.527+0000 7f1953fff700 1 --2- 172.21.15.27:0/876046918 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f19540bb050 0x7f1954067af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.527+0000 7f195898e700 1 -- 172.21.15.27:0/876046918 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f19540bb050 msgr2=0x7f1954067af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:04.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f195898e700 1 --2- 172.21.15.27:0/876046918 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f19540bb050 0x7f1954067af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f195898e700 1 -- 172.21.15.27:0/876046918 >> v1:172.21.15.123:6789/0 conn(0x7f1954068030 legacy=0x7f19540b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f195898e700 1 -- 172.21.15.27:0/876046918 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540b60f0 con 0x7f195406f0c0 2023-10-06T03:00:04.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f1953fff700 1 --2- 172.21.15.27:0/876046918 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f19540bb050 0x7f1954067af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:04.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f195898e700 1 --2- 172.21.15.27:0/876046918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f195406f0c0 0x7f19540bab10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f193c0099b0 tx=0x7f193c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39eede4c7ace2656 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:04.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f19537fe700 1 -- 172.21.15.27:0/876046918 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c00b860 con 0x7f195406f0c0 2023-10-06T03:00:04.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f19537fe700 1 -- 172.21.15.27:0/876046918 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c00b9c0 con 0x7f195406f0c0 2023-10-06T03:00:04.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f19537fe700 1 -- 172.21.15.27:0/876046918 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c00bd60 con 0x7f195406f0c0 2023-10-06T03:00:04.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f1959990700 1 -- 172.21.15.27:0/876046918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f195406f0c0 msgr2=0x7f19540bab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f1959990700 1 --2- 172.21.15.27:0/876046918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f195406f0c0 0x7f19540bab10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f193c0099b0 tx=0x7f193c009250 comp rx=0 tx=0).stop 2023-10-06T03:00:04.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f1959990700 1 -- 172.21.15.27:0/876046918 shutdown_connections 2023-10-06T03:00:04.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f1959990700 1 --2- 172.21.15.27:0/876046918 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f19540bb050 0x7f1954067af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f1959990700 1 --2- 172.21.15.27:0/876046918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f195406f0c0 0x7f19540bab10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f1959990700 1 -- 172.21.15.27:0/876046918 >> 172.21.15.27:0/876046918 conn(0x7f19540bfd60 msgr2=0x7f19540c0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:04.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f1959990700 1 -- 172.21.15.27:0/876046918 shutdown_connections 2023-10-06T03:00:04.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f1959990700 1 -- 172.21.15.27:0/876046918 wait complete. 2023-10-06T03:00:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f1959990700 1 Processor -- start 2023-10-06T03:00:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.531+0000 7f1959990700 1 -- start start 2023-10-06T03:00:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1959990700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1954068030 0x7f19540a3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1959990700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f195406f0c0 0x7f195414d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1959990700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19540bb050 0x7f195406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1959990700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195415ef50 con 0x7f19540bb050 2023-10-06T03:00:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1959990700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195415f370 con 0x7f195406f0c0 2023-10-06T03:00:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1959990700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195414f7c0 con 0x7f1954068030 2023-10-06T03:00:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1953fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f195406f0c0 0x7f195414d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f195918f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19540bb050 0x7f195406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1953fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f195406f0c0 0x7f195414d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:55172/0 (socket says 172.21.15.27:55172) 2023-10-06T03:00:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1953fff700 1 -- 172.21.15.27:0/3331606144 learned_addr learned my addr 172.21.15.27:0/3331606144 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f195898e700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1954068030 0x7f19540a3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f195918f700 1 -- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1954068030 msgr2=0x7f19540a3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f195918f700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1954068030 0x7f19540a3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f195918f700 1 -- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f195406f0c0 msgr2=0x7f195414d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f195918f700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f195406f0c0 0x7f195414d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f195918f700 1 -- 172.21.15.27:0/3331606144 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c0094f0 con 0x7f19540bb050 2023-10-06T03:00:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1953fff700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f195406f0c0 0x7f195414d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f195918f700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19540bb050 0x7f195406d260 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1954068450 tx=0x7f194c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1950ff9700 1 -- 172.21.15.27:0/3331606144 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c012630 con 0x7f19540bb050 2023-10-06T03:00:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1950ff9700 1 -- 172.21.15.27:0/3331606144 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c012790 con 0x7f19540bb050 2023-10-06T03:00:04.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1950ff9700 1 -- 172.21.15.27:0/3331606144 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c012b30 con 0x7f19540bb050 2023-10-06T03:00:04.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1959990700 1 -- 172.21.15.27:0/3331606144 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195415c0e0 con 0x7f19540bb050 2023-10-06T03:00:04.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1959990700 1 -- 172.21.15.27:0/3331606144 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195415bb40 con 0x7f19540bb050 2023-10-06T03:00:04.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.535+0000 7f1959990700 1 -- 172.21.15.27:0/3331606144 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1954069cc0 con 0x7f19540bb050 2023-10-06T03:00:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.539+0000 7f1950ff9700 1 -- 172.21.15.27:0/3331606144 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f194c024420 con 0x7f19540bb050 2023-10-06T03:00:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.539+0000 7f1950ff9700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1934060550 0x7f1934062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.539+0000 7f1950ff9700 1 -- 172.21.15.27:0/3331606144 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f194c07d100 con 0x7f19540bb050 2023-10-06T03:00:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.539+0000 7f195898e700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1934060550 0x7f1934062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.539+0000 7f195898e700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1934060550 0x7f1934062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f193c0099b0 tx=0x7f193c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:04.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.547+0000 7f1950ff9700 1 -- 172.21.15.27:0/3331606144 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f194c04d610 con 0x7f19540bb050 2023-10-06T03:00:04.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.707+0000 7f1959990700 1 -- 172.21.15.27:0/3331606144 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f195409f7c0 con 0x7f19540bb050 2023-10-06T03:00:04.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.707+0000 7f1950ff9700 1 -- 172.21.15.27:0/3331606144 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f194c050c30 con 0x7f19540bb050 2023-10-06T03:00:04.713 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-10-06T03:00:04.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.711+0000 7f1959990700 1 -- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1934060550 msgr2=0x7f1934062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.711+0000 7f1959990700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1934060550 0x7f1934062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f193c0099b0 tx=0x7f193c017000 comp rx=0 tx=0).stop 2023-10-06T03:00:04.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.711+0000 7f1959990700 1 -- 172.21.15.27:0/3331606144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19540bb050 msgr2=0x7f195406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.711+0000 7f1959990700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19540bb050 0x7f195406d260 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1954068450 tx=0x7f194c001690 comp rx=0 tx=0).stop 2023-10-06T03:00:04.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.711+0000 7f1959990700 1 -- 172.21.15.27:0/3331606144 shutdown_connections 2023-10-06T03:00:04.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.711+0000 7f1959990700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1934060550 0x7f1934062a00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.711+0000 7f1959990700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19540bb050 0x7f195406d260 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.711+0000 7f1959990700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f195406f0c0 0x7f195414d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.711+0000 7f1959990700 1 --2- 172.21.15.27:0/3331606144 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1954068030 0x7f19540a3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.711+0000 7f1959990700 1 -- 172.21.15.27:0/3331606144 >> 172.21.15.27:0/3331606144 conn(0x7f19540bfd60 msgr2=0x7f19540b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:04.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.711+0000 7f1959990700 1 -- 172.21.15.27:0/3331606144 shutdown_connections 2023-10-06T03:00:04.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.711+0000 7f1959990700 1 -- 172.21.15.27:0/3331606144 wait complete. 2023-10-06T03:00:04.727 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:00:04.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.835+0000 7f7173295700 1 Processor -- start 2023-10-06T03:00:04.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.835+0000 7f7173295700 1 -- start start 2023-10-06T03:00:04.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f716c14acb0 0x7f716c0b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f716c06b2e0 0x7f716c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f716c06d6e0 0x7f716c14eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c0b2f00 con 0x7f716c06b2e0 2023-10-06T03:00:04.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c0b31e0 con 0x7f716c14acb0 2023-10-06T03:00:04.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0bb940 con 0x7f716c06d6e0 2023-10-06T03:00:04.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7171a92700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f716c06b2e0 0x7f716c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7171a92700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f716c06b2e0 0x7f716c06d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49168/0 (socket says 172.21.15.27:49168) 2023-10-06T03:00:04.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7171a92700 1 -- 172.21.15.27:0/2219102806 learned_addr learned my addr 172.21.15.27:0/2219102806 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:04.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7172a94700 1 --2- 172.21.15.27:0/2219102806 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f716c06d6e0 0x7f716c14eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7172293700 1 --2- 172.21.15.27:0/2219102806 >> v2:172.21.15.123:3300/0 conn(0x7f716c14acb0 0x7f716c0b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7172a94700 1 -- 172.21.15.27:0/2219102806 >> v2:172.21.15.123:3300/0 conn(0x7f716c14acb0 msgr2=0x7f716c0b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:04.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7172a94700 1 --2- 172.21.15.27:0/2219102806 >> v2:172.21.15.123:3300/0 conn(0x7f716c14acb0 0x7f716c0b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7172a94700 1 -- 172.21.15.27:0/2219102806 >> v2:172.21.15.27:3300/0 conn(0x7f716c06b2e0 msgr2=0x7f716c06d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:04.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7172a94700 1 --2- 172.21.15.27:0/2219102806 >> v2:172.21.15.27:3300/0 conn(0x7f716c06b2e0 0x7f716c06d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7172a94700 1 -- 172.21.15.27:0/2219102806 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c0b86b0 con 0x7f716c06d6e0 2023-10-06T03:00:04.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7171a92700 1 --2- 172.21.15.27:0/2219102806 >> v2:172.21.15.27:3300/0 conn(0x7f716c06b2e0 0x7f716c06d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:04.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7172a94700 1 --2- 172.21.15.27:0/2219102806 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f716c06d6e0 0x7f716c14eb80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f716c068c80 tx=0x7f7164009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e50ce3bfce4a1ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:04.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7171291700 1 -- 172.21.15.27:0/2219102806 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716400e070 con 0x7f716c06d6e0 2023-10-06T03:00:04.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7171291700 1 -- 172.21.15.27:0/2219102806 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716400bab0 con 0x7f716c06d6e0 2023-10-06T03:00:04.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7171291700 1 -- 172.21.15.27:0/2219102806 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716400be50 con 0x7f716c06d6e0 2023-10-06T03:00:04.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 -- 172.21.15.27:0/2219102806 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f716c06d6e0 msgr2=0x7f716c14eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 --2- 172.21.15.27:0/2219102806 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f716c06d6e0 0x7f716c14eb80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f716c068c80 tx=0x7f7164009780 comp rx=0 tx=0).stop 2023-10-06T03:00:04.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 -- 172.21.15.27:0/2219102806 shutdown_connections 2023-10-06T03:00:04.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 --2- 172.21.15.27:0/2219102806 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f716c06d6e0 0x7f716c14eb80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 --2- 172.21.15.27:0/2219102806 >> v2:172.21.15.27:3300/0 conn(0x7f716c06b2e0 0x7f716c06d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 --2- 172.21.15.27:0/2219102806 >> v2:172.21.15.123:3300/0 conn(0x7f716c14acb0 0x7f716c0b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 -- 172.21.15.27:0/2219102806 >> 172.21.15.27:0/2219102806 conn(0x7f716c0beed0 msgr2=0x7f716c0bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:04.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 -- 172.21.15.27:0/2219102806 shutdown_connections 2023-10-06T03:00:04.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.839+0000 7f7173295700 1 -- 172.21.15.27:0/2219102806 wait complete. 2023-10-06T03:00:04.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7173295700 1 Processor -- start 2023-10-06T03:00:04.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7173295700 1 -- start start 2023-10-06T03:00:04.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7173295700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f716c06b2e0 0x7f716c0b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7173295700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f716c06d6e0 0x7f716c06c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7173295700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f716c14acb0 0x7f716c15b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7173295700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0bd190 con 0x7f716c14acb0 2023-10-06T03:00:04.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7173295700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0bc1c0 con 0x7f716c06b2e0 2023-10-06T03:00:04.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7173295700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c15b4e0 con 0x7f716c06d6e0 2023-10-06T03:00:04.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7172a94700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f716c14acb0 0x7f716c15b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7172a94700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f716c14acb0 0x7f716c15b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49184/0 (socket says 172.21.15.27:49184) 2023-10-06T03:00:04.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7172a94700 1 -- 172.21.15.27:0/382038168 learned_addr learned my addr 172.21.15.27:0/382038168 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:04.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7171a92700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f716c06d6e0 0x7f716c06c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7172293700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f716c06b2e0 0x7f716c0b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7172a94700 1 -- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f716c06d6e0 msgr2=0x7f716c06c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7172a94700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f716c06d6e0 0x7f716c06c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7172a94700 1 -- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f716c06b2e0 msgr2=0x7f716c0b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7172a94700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f716c06b2e0 0x7f716c0b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7172a94700 1 -- 172.21.15.27:0/382038168 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71600094f0 con 0x7f716c14acb0 2023-10-06T03:00:04.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7171a92700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f716c06d6e0 0x7f716c06c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:04.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.843+0000 7f7172a94700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f716c14acb0 0x7f716c15b970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f716400b610 tx=0x7f7164019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:04.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.847+0000 7f715e7fc700 1 -- 172.21.15.27:0/382038168 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164012d70 con 0x7f716c14acb0 2023-10-06T03:00:04.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.847+0000 7f715e7fc700 1 -- 172.21.15.27:0/382038168 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71640263f0 con 0x7f716c14acb0 2023-10-06T03:00:04.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.847+0000 7f7173295700 1 -- 172.21.15.27:0/382038168 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7164009a20 con 0x7f716c14acb0 2023-10-06T03:00:04.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.847+0000 7f715e7fc700 1 -- 172.21.15.27:0/382038168 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640267b0 con 0x7f716c14acb0 2023-10-06T03:00:04.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.847+0000 7f7173295700 1 -- 172.21.15.27:0/382038168 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c0bc410 con 0x7f716c14acb0 2023-10-06T03:00:04.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.847+0000 7f7173295700 1 -- 172.21.15.27:0/382038168 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716c15b690 con 0x7f716c14acb0 2023-10-06T03:00:04.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.847+0000 7f715e7fc700 1 -- 172.21.15.27:0/382038168 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7164026b20 con 0x7f716c14acb0 2023-10-06T03:00:04.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.847+0000 7f715e7fc700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7150060550 0x7f7150062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.847+0000 7f715e7fc700 1 -- 172.21.15.27:0/382038168 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f716407e720 con 0x7f716c14acb0 2023-10-06T03:00:04.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.847+0000 7f7172293700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7150060550 0x7f7150062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.851+0000 7f7172293700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7150060550 0x7f7150062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7168009d10 tx=0x7f71680091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:04.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:04.855+0000 7f715e7fc700 1 -- 172.21.15.27:0/382038168 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f716c15b690 con 0x7f716c14acb0 2023-10-06T03:00:05.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.011+0000 7f7173295700 1 -- 172.21.15.27:0/382038168 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f716c15b650 con 0x7f716c14acb0 2023-10-06T03:00:05.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.015+0000 7f715e7fc700 1 -- 172.21.15.27:0/382038168 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f716404ebb0 con 0x7f716c14acb0 2023-10-06T03:00:05.019 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-10-06T03:00:05.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.015+0000 7f7173295700 1 -- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7150060550 msgr2=0x7f7150062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.015+0000 7f7173295700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7150060550 0x7f7150062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7168009d10 tx=0x7f71680091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.015+0000 7f7173295700 1 -- 172.21.15.27:0/382038168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f716c14acb0 msgr2=0x7f716c15b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.015+0000 7f7173295700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f716c14acb0 0x7f716c15b970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f716400b610 tx=0x7f7164019000 comp rx=0 tx=0).stop 2023-10-06T03:00:05.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.015+0000 7f7173295700 1 -- 172.21.15.27:0/382038168 shutdown_connections 2023-10-06T03:00:05.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.015+0000 7f7173295700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7150060550 0x7f7150062a00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.015+0000 7f7173295700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f716c14acb0 0x7f716c15b970 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.015+0000 7f7173295700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f716c06d6e0 0x7f716c06c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.015+0000 7f7173295700 1 --2- 172.21.15.27:0/382038168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f716c06b2e0 0x7f716c0b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.015+0000 7f7173295700 1 -- 172.21.15.27:0/382038168 >> 172.21.15.27:0/382038168 conn(0x7f716c0beed0 msgr2=0x7f716c149900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:05.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.015+0000 7f7173295700 1 -- 172.21.15.27:0/382038168 shutdown_connections 2023-10-06T03:00:05.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.015+0000 7f7173295700 1 -- 172.21.15.27:0/382038168 wait complete. 2023-10-06T03:00:05.039 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:00:05.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f114e972700 1 Processor -- start 2023-10-06T03:00:05.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f114e972700 1 -- start start 2023-10-06T03:00:05.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f114e972700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f114814c660 0x7f114814b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f114e972700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11480b95c0 0x7f114806a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f114e972700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11480b9a20 con 0x7f114814ae30 2023-10-06T03:00:05.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f114e972700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1148069cb0 con 0x7f114814c660 2023-10-06T03:00:05.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f114e972700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11480b8c40 con 0x7f11480b95c0 2023-10-06T03:00:05.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f1147fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f114814ae30 0x7f11480b8eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44620/0 (socket says 172.21.15.27:44620) 2023-10-06T03:00:05.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f1147fff700 1 -- 172.21.15.27:0/2247360135 learned_addr learned my addr 172.21.15.27:0/2247360135 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:05.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f113ffff700 1 --2- 172.21.15.27:0/2247360135 >> v2:172.21.15.123:3300/0 conn(0x7f114814c660 0x7f114814b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f114cf0f700 1 --2- 172.21.15.27:0/2247360135 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11480b95c0 0x7f114806a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f11477fe700 1 -- 172.21.15.27:0/2247360135 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278794594 0 0) 0x7f11480b9a20 con 0x7f114814ae30 2023-10-06T03:00:05.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f11477fe700 1 -- 172.21.15.27:0/2247360135 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1134003570 con 0x7f114814ae30 2023-10-06T03:00:05.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f11477fe700 1 -- 172.21.15.27:0/2247360135 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1311159745 0 0) 0x7f1134003570 con 0x7f114814ae30 2023-10-06T03:00:05.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f113ffff700 1 -- 172.21.15.27:0/2247360135 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11480b95c0 msgr2=0x7f114806a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:05.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f113ffff700 1 --2- 172.21.15.27:0/2247360135 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11480b95c0 0x7f114806a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f113ffff700 1 -- 172.21.15.27:0/2247360135 >> v1:172.21.15.27:6789/0 conn(0x7f114814ae30 legacy=0x7f11480b8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.155+0000 7f113ffff700 1 -- 172.21.15.27:0/2247360135 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114806b9e0 con 0x7f114814c660 2023-10-06T03:00:05.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f113ffff700 1 --2- 172.21.15.27:0/2247360135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f114814c660 0x7f114814b200 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11480b8d80 tx=0x7f11300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5be129894758c317 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:05.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f11477fe700 1 -- 172.21.15.27:0/2247360135 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138001470 con 0x7f114814c660 2023-10-06T03:00:05.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f11477fe700 1 -- 172.21.15.27:0/2247360135 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1130011420 con 0x7f114814c660 2023-10-06T03:00:05.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f11477fe700 1 -- 172.21.15.27:0/2247360135 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11300117a0 con 0x7f114814c660 2023-10-06T03:00:05.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f114e972700 1 -- 172.21.15.27:0/2247360135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f114814c660 msgr2=0x7f114814b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f114e972700 1 --2- 172.21.15.27:0/2247360135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f114814c660 0x7f114814b200 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11480b8d80 tx=0x7f11300091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f114e972700 1 -- 172.21.15.27:0/2247360135 shutdown_connections 2023-10-06T03:00:05.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f114e972700 1 --2- 172.21.15.27:0/2247360135 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11480b95c0 0x7f114806a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f114e972700 1 --2- 172.21.15.27:0/2247360135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f114814c660 0x7f114814b200 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f114e972700 1 -- 172.21.15.27:0/2247360135 >> 172.21.15.27:0/2247360135 conn(0x7f11480be540 msgr2=0x7f11480be940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:05.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f114e972700 1 -- 172.21.15.27:0/2247360135 shutdown_connections 2023-10-06T03:00:05.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f114e972700 1 -- 172.21.15.27:0/2247360135 wait complete. 2023-10-06T03:00:05.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f114e972700 1 Processor -- start 2023-10-06T03:00:05.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.159+0000 7f114e972700 1 -- start start 2023-10-06T03:00:05.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f114e972700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11480b95c0 0x7f114814eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f114e972700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f114814ae30 0x7f11481443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f114e972700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f114814c660 0x7f1148144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f114e972700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1148147510 con 0x7f11480b95c0 2023-10-06T03:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f114e972700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114814f050 con 0x7f114814ae30 2023-10-06T03:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f114e972700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11480bc9c0 con 0x7f114814c660 2023-10-06T03:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f1147fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11480b95c0 0x7f114814eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f1147fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11480b95c0 0x7f114814eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49200/0 (socket says 172.21.15.27:49200) 2023-10-06T03:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f1147fff700 1 -- 172.21.15.27:0/3400089021 learned_addr learned my addr 172.21.15.27:0/3400089021 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f113ffff700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f114814ae30 0x7f11481443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f114cf0f700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f114814c660 0x7f1148144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f1147fff700 1 -- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f114814c660 msgr2=0x7f1148144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f1147fff700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f114814c660 0x7f1148144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f1147fff700 1 -- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f114814ae30 msgr2=0x7f11481443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f1147fff700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f114814ae30 0x7f11481443e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f1147fff700 1 -- 172.21.15.27:0/3400089021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1130009420 con 0x7f11480b95c0 2023-10-06T03:00:05.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f113ffff700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f114814ae30 0x7f11481443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:05.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f1147fff700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11480b95c0 0x7f114814eb10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f113800cb90 tx=0x7f1138001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:05.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f1144ff9700 1 -- 172.21.15.27:0/3400089021 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138001d60 con 0x7f11480b95c0 2023-10-06T03:00:05.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f1144ff9700 1 -- 172.21.15.27:0/3400089021 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1138007360 con 0x7f11480b95c0 2023-10-06T03:00:05.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f114e972700 1 -- 172.21.15.27:0/3400089021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11480bcca0 con 0x7f11480b95c0 2023-10-06T03:00:05.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f1144ff9700 1 -- 172.21.15.27:0/3400089021 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138007700 con 0x7f11480b95c0 2023-10-06T03:00:05.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.163+0000 7f114e972700 1 -- 172.21.15.27:0/3400089021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114814f9d0 con 0x7f11480b95c0 2023-10-06T03:00:05.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.167+0000 7f114e972700 1 -- 172.21.15.27:0/3400089021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114804be40 con 0x7f11480b95c0 2023-10-06T03:00:05.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.167+0000 7f1144ff9700 1 -- 172.21.15.27:0/3400089021 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1138004a40 con 0x7f11480b95c0 2023-10-06T03:00:05.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.167+0000 7f1144ff9700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1128060550 0x7f1128062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.167+0000 7f1144ff9700 1 -- 172.21.15.27:0/3400089021 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f113807c360 con 0x7f11480b95c0 2023-10-06T03:00:05.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.167+0000 7f113ffff700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1128060550 0x7f1128062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.167+0000 7f113ffff700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1128060550 0x7f1128062a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f11480b8d80 tx=0x7f1130016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:05.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.175+0000 7f1144ff9700 1 -- 172.21.15.27:0/3400089021 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f11380501e0 con 0x7f11480b95c0 2023-10-06T03:00:05.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.347+0000 7f114e972700 1 -- 172.21.15.27:0/3400089021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11480bbda0 con 0x7f11480b95c0 2023-10-06T03:00:05.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.351+0000 7f1144ff9700 1 -- 172.21.15.27:0/3400089021 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f113804fd70 con 0x7f11480b95c0 2023-10-06T03:00:05.356 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-10-06T03:00:05.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.351+0000 7f114e972700 1 -- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1128060550 msgr2=0x7f1128062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.351+0000 7f114e972700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1128060550 0x7f1128062a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f11480b8d80 tx=0x7f1130016000 comp rx=0 tx=0).stop 2023-10-06T03:00:05.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.351+0000 7f114e972700 1 -- 172.21.15.27:0/3400089021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11480b95c0 msgr2=0x7f114814eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.351+0000 7f114e972700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11480b95c0 0x7f114814eb10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f113800cb90 tx=0x7f1138001ad0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.351+0000 7f114e972700 1 -- 172.21.15.27:0/3400089021 shutdown_connections 2023-10-06T03:00:05.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.351+0000 7f114e972700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1128060550 0x7f1128062a00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.351+0000 7f114e972700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f114814c660 0x7f1148144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.351+0000 7f114e972700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f114814ae30 0x7f11481443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.351+0000 7f114e972700 1 --2- 172.21.15.27:0/3400089021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11480b95c0 0x7f114814eb10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.351+0000 7f114e972700 1 -- 172.21.15.27:0/3400089021 >> 172.21.15.27:0/3400089021 conn(0x7f11480be540 msgr2=0x7f114814d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:05.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.351+0000 7f114e972700 1 -- 172.21.15.27:0/3400089021 shutdown_connections 2023-10-06T03:00:05.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.355+0000 7f114e972700 1 -- 172.21.15.27:0/3400089021 wait complete. 2023-10-06T03:00:05.375 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:05.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.467+0000 7f96472fe700 1 Processor -- start 2023-10-06T03:00:05.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.467+0000 7f96472fe700 1 -- start start 2023-10-06T03:00:05.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96472fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96401457b0 0x7f96400b9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96472fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f964006b900 0x7f96400b9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96472fe700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964014bf90 con 0x7f964006d3d0 2023-10-06T03:00:05.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96472fe700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96400b4900 con 0x7f964006b900 2023-10-06T03:00:05.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96472fe700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964014c270 con 0x7f96401457b0 2023-10-06T03:00:05.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f9646afd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f964006b900 0x7f96400b9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f9646afd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f964006b900 0x7f96400b9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49210/0 (socket says 172.21.15.27:49210) 2023-10-06T03:00:05.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f9646afd700 1 -- 172.21.15.27:0/3905046474 learned_addr learned my addr 172.21.15.27:0/3905046474 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:05.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f9645afb700 1 --2- 172.21.15.27:0/3905046474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96401457b0 0x7f96400b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f9646afd700 1 -- 172.21.15.27:0/3905046474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96401457b0 msgr2=0x7f96400b9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:05.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f9646afd700 1 --2- 172.21.15.27:0/3905046474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96401457b0 0x7f96400b9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f9646afd700 1 -- 172.21.15.27:0/3905046474 >> v1:172.21.15.123:6789/0 conn(0x7f964006d3d0 legacy=0x7f96401450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f9646afd700 1 -- 172.21.15.27:0/3905046474 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9640069970 con 0x7f964006b900 2023-10-06T03:00:05.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f9646afd700 1 --2- 172.21.15.27:0/3905046474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f964006b900 0x7f96400b9b60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9638009f20 tx=0x7f9638009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505e56de01ba0f35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:05.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96452fa700 1 -- 172.21.15.27:0/3905046474 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963800e070 con 0x7f964006b900 2023-10-06T03:00:05.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96452fa700 1 -- 172.21.15.27:0/3905046474 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963800ba80 con 0x7f964006b900 2023-10-06T03:00:05.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96452fa700 1 -- 172.21.15.27:0/3905046474 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96380092e0 con 0x7f964006b900 2023-10-06T03:00:05.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96472fe700 1 -- 172.21.15.27:0/3905046474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f964006b900 msgr2=0x7f96400b9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96472fe700 1 --2- 172.21.15.27:0/3905046474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f964006b900 0x7f96400b9b60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9638009f20 tx=0x7f9638009840 comp rx=0 tx=0).stop 2023-10-06T03:00:05.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96472fe700 1 -- 172.21.15.27:0/3905046474 shutdown_connections 2023-10-06T03:00:05.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96472fe700 1 --2- 172.21.15.27:0/3905046474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f964006b900 0x7f96400b9b60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96472fe700 1 --2- 172.21.15.27:0/3905046474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96401457b0 0x7f96400b9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96472fe700 1 -- 172.21.15.27:0/3905046474 >> 172.21.15.27:0/3905046474 conn(0x7f96400bae20 msgr2=0x7f96400bb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:05.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96472fe700 1 -- 172.21.15.27:0/3905046474 shutdown_connections 2023-10-06T03:00:05.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.471+0000 7f96472fe700 1 -- 172.21.15.27:0/3905046474 wait complete. 2023-10-06T03:00:05.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f96472fe700 1 Processor -- start 2023-10-06T03:00:05.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f96472fe700 1 -- start start 2023-10-06T03:00:05.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f96472fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f964006b900 0x7f9640147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f96472fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f964006d3d0 0x7f964015e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f96472fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96401457b0 0x7f964014db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f96472fe700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9640146b70 con 0x7f96401457b0 2023-10-06T03:00:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f96472fe700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964015f1c0 con 0x7f964006b900 2023-10-06T03:00:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f96472fe700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964015c2e0 con 0x7f964006d3d0 2023-10-06T03:00:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f9646afd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96401457b0 0x7f964014db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f9646afd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96401457b0 0x7f964014db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49216/0 (socket says 172.21.15.27:49216) 2023-10-06T03:00:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f9646afd700 1 -- 172.21.15.27:0/3997948632 learned_addr learned my addr 172.21.15.27:0/3997948632 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f96462fc700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f964006b900 0x7f9640147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f9645afb700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f964006d3d0 0x7f964015e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f9646afd700 1 -- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f964006d3d0 msgr2=0x7f964015e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f9646afd700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f964006d3d0 0x7f964015e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f9646afd700 1 -- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f964006b900 msgr2=0x7f9640147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f9646afd700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f964006b900 0x7f9640147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f9646afd700 1 -- 172.21.15.27:0/3997948632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9638009ae0 con 0x7f96401457b0 2023-10-06T03:00:05.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f9646afd700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96401457b0 0x7f964014db90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f964006db90 tx=0x7f9638018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:05.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f96367fc700 1 -- 172.21.15.27:0/3997948632 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96380032f0 con 0x7f96401457b0 2023-10-06T03:00:05.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.475+0000 7f96367fc700 1 -- 172.21.15.27:0/3997948632 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9638008d20 con 0x7f96401457b0 2023-10-06T03:00:05.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.479+0000 7f96367fc700 1 -- 172.21.15.27:0/3997948632 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96380256b0 con 0x7f96401457b0 2023-10-06T03:00:05.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.479+0000 7f96472fe700 1 -- 172.21.15.27:0/3997948632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964015f460 con 0x7f96401457b0 2023-10-06T03:00:05.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.479+0000 7f96472fe700 1 -- 172.21.15.27:0/3997948632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9640145bc0 con 0x7f96401457b0 2023-10-06T03:00:05.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.479+0000 7f96472fe700 1 -- 172.21.15.27:0/3997948632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9640146d20 con 0x7f96401457b0 2023-10-06T03:00:05.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.479+0000 7f96367fc700 1 -- 172.21.15.27:0/3997948632 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9638003040 con 0x7f96401457b0 2023-10-06T03:00:05.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.479+0000 7f96367fc700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9624060550 0x7f9624062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.479+0000 7f96367fc700 1 -- 172.21.15.27:0/3997948632 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f963807e520 con 0x7f96401457b0 2023-10-06T03:00:05.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.479+0000 7f96462fc700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9624060550 0x7f9624062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.479+0000 7f96462fc700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9624060550 0x7f9624062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f963c003aa0 tx=0x7f963c000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:05.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.487+0000 7f96367fc700 1 -- 172.21.15.27:0/3997948632 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9640146d20 con 0x7f96401457b0 2023-10-06T03:00:05.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.683+0000 7f96472fe700 1 -- 172.21.15.27:0/3997948632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f964015f010 con 0x7f96401457b0 2023-10-06T03:00:05.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.687+0000 7f96367fc700 1 -- 172.21.15.27:0/3997948632 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3082 (secure 0 0 0) 0x7f963804e9b0 con 0x7f96401457b0 2023-10-06T03:00:05.692 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:00:05.692 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3318688789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3318688789},{"type":"v1","addr":"172.21.15.123:6835","nonce":3318688789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:53.638660+0000","modified":"2023-10-06T02:59:56.293208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6833/3144883581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3144883581},{"type":"v1","addr":"172.21.15.27:6833","nonce":3144883581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:00:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.691+0000 7f96472fe700 1 -- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9624060550 msgr2=0x7f9624062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.691+0000 7f96472fe700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9624060550 0x7f9624062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f963c003aa0 tx=0x7f963c000bc0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.691+0000 7f96472fe700 1 -- 172.21.15.27:0/3997948632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96401457b0 msgr2=0x7f964014db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.691+0000 7f96472fe700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96401457b0 0x7f964014db90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f964006db90 tx=0x7f9638018000 comp rx=0 tx=0).stop 2023-10-06T03:00:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.691+0000 7f96472fe700 1 -- 172.21.15.27:0/3997948632 shutdown_connections 2023-10-06T03:00:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.691+0000 7f96472fe700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9624060550 0x7f9624062a00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.691+0000 7f96472fe700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96401457b0 0x7f964014db90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.691+0000 7f96472fe700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f964006d3d0 0x7f964015e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.691+0000 7f96472fe700 1 --2- 172.21.15.27:0/3997948632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f964006b900 0x7f9640147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.691+0000 7f96472fe700 1 -- 172.21.15.27:0/3997948632 >> 172.21.15.27:0/3997948632 conn(0x7f96400bae20 msgr2=0x7f9640144e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.691+0000 7f96472fe700 1 -- 172.21.15.27:0/3997948632 shutdown_connections 2023-10-06T03:00:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.691+0000 7f96472fe700 1 -- 172.21.15.27:0/3997948632 wait complete. 2023-10-06T03:00:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 6 2023-10-06T03:00:05.712 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:05.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.811+0000 7f41f191a700 1 Processor -- start 2023-10-06T03:00:05.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.811+0000 7f41f191a700 1 -- start start 2023-10-06T03:00:05.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.811+0000 7f41f191a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f41ec069890 0x7f41ec06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.811+0000 7f41f191a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41ec06e8b0 0x7f41ec0b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.811+0000 7f41f191a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ec14bd10 con 0x7f41ec0b3d90 2023-10-06T03:00:05.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.811+0000 7f41f191a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ec0b33c0 con 0x7f41ec069890 2023-10-06T03:00:05.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.811+0000 7f41f191a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec06d7e0 con 0x7f41ec06e8b0 2023-10-06T03:00:05.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.811+0000 7f41ebfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41ec06e8b0 0x7f41ec0b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.811+0000 7f41f0918700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f41ec069890 0x7f41ec06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.811+0000 7f41f1119700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f41ec0b3d90 0x7f41ec1477b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.27:49856/0 (socket says 172.21.15.27:49856) 2023-10-06T03:00:05.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41ebfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41ec06e8b0 0x7f41ec0b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.27:54314/0 (socket says 172.21.15.27:54314) 2023-10-06T03:00:05.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41f1119700 1 -- 172.21.15.27:0/2162214584 learned_addr learned my addr 172.21.15.27:0/2162214584 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:05.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41ebfff700 1 -- 172.21.15.27:0/2162214584 >> v2:172.21.15.123:3300/0 conn(0x7f41ec069890 msgr2=0x7f41ec06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:05.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41ebfff700 1 --2- 172.21.15.27:0/2162214584 >> v2:172.21.15.123:3300/0 conn(0x7f41ec069890 0x7f41ec06d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41ebfff700 1 -- 172.21.15.27:0/2162214584 >> v1:172.21.15.123:6789/0 conn(0x7f41ec0b3d90 legacy=0x7f41ec1477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41ebfff700 1 -- 172.21.15.27:0/2162214584 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec14ba30 con 0x7f41ec06e8b0 2023-10-06T03:00:05.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41ebfff700 1 --2- 172.21.15.27:0/2162214584 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41ec06e8b0 0x7f41ec0b3850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41e00098e0 tx=0x7f41e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=731e5ccad0447202 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:05.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41eb7fe700 1 -- 172.21.15.27:0/2162214584 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000b640 con 0x7f41ec06e8b0 2023-10-06T03:00:05.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41eb7fe700 1 -- 172.21.15.27:0/2162214584 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e000b7a0 con 0x7f41ec06e8b0 2023-10-06T03:00:05.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41eb7fe700 1 -- 172.21.15.27:0/2162214584 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000bb40 con 0x7f41ec06e8b0 2023-10-06T03:00:05.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41f191a700 1 -- 172.21.15.27:0/2162214584 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41ec06e8b0 msgr2=0x7f41ec0b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41f191a700 1 --2- 172.21.15.27:0/2162214584 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41ec06e8b0 0x7f41ec0b3850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41e00098e0 tx=0x7f41e00091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41f191a700 1 -- 172.21.15.27:0/2162214584 shutdown_connections 2023-10-06T03:00:05.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41f191a700 1 --2- 172.21.15.27:0/2162214584 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41ec06e8b0 0x7f41ec0b3850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41f191a700 1 --2- 172.21.15.27:0/2162214584 >> v2:172.21.15.123:3300/0 conn(0x7f41ec069890 0x7f41ec06d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41f191a700 1 -- 172.21.15.27:0/2162214584 >> 172.21.15.27:0/2162214584 conn(0x7f41ec0bec40 msgr2=0x7f41ec0bf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:05.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41f191a700 1 -- 172.21.15.27:0/2162214584 shutdown_connections 2023-10-06T03:00:05.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.815+0000 7f41f191a700 1 -- 172.21.15.27:0/2162214584 wait complete. 2023-10-06T03:00:05.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f191a700 1 Processor -- start 2023-10-06T03:00:05.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f191a700 1 -- start start 2023-10-06T03:00:05.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f191a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41ec069890 0x7f41ec148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f191a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41ec06e8b0 0x7f41ec0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f191a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41ec0b3d90 0x7f41ec0b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f191a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec144280 con 0x7f41ec069890 2023-10-06T03:00:05.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f191a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec0b6540 con 0x7f41ec06e8b0 2023-10-06T03:00:05.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f191a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec146090 con 0x7f41ec0b3d90 2023-10-06T03:00:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f0918700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41ec069890 0x7f41ec148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f0918700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41ec069890 0x7f41ec148370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49222/0 (socket says 172.21.15.27:49222) 2023-10-06T03:00:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f0918700 1 -- 172.21.15.27:0/1904622774 learned_addr learned my addr 172.21.15.27:0/1904622774 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41ebfff700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41ec06e8b0 0x7f41ec0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f1119700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41ec0b3d90 0x7f41ec0b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f0918700 1 -- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41ec0b3d90 msgr2=0x7f41ec0b7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f0918700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41ec0b3d90 0x7f41ec0b7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f0918700 1 -- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41ec06e8b0 msgr2=0x7f41ec0b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f0918700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41ec06e8b0 0x7f41ec0b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f0918700 1 -- 172.21.15.27:0/1904622774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e0009420 con 0x7f41ec069890 2023-10-06T03:00:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.819+0000 7f41f0918700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41ec069890 0x7f41ec148370 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f41d800ec80 tx=0x7f41d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:05.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.823+0000 7f41e8ff9700 1 -- 172.21.15.27:0/1904622774 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d800c850 con 0x7f41ec069890 2023-10-06T03:00:05.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.823+0000 7f41e8ff9700 1 -- 172.21.15.27:0/1904622774 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d800c9b0 con 0x7f41ec069890 2023-10-06T03:00:05.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.823+0000 7f41f191a700 1 -- 172.21.15.27:0/1904622774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ec0b83d0 con 0x7f41ec069890 2023-10-06T03:00:05.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.823+0000 7f41e8ff9700 1 -- 172.21.15.27:0/1904622774 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d800cd50 con 0x7f41ec069890 2023-10-06T03:00:05.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.823+0000 7f41f191a700 1 -- 172.21.15.27:0/1904622774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ec1435e0 con 0x7f41ec069890 2023-10-06T03:00:05.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.823+0000 7f41f191a700 1 -- 172.21.15.27:0/1904622774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ec068e60 con 0x7f41ec069890 2023-10-06T03:00:05.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.823+0000 7f41e8ff9700 1 -- 172.21.15.27:0/1904622774 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f41d8013680 con 0x7f41ec069890 2023-10-06T03:00:05.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.823+0000 7f41e8ff9700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f41d0060550 0x7f41d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:05.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.823+0000 7f41e8ff9700 1 -- 172.21.15.27:0/1904622774 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f41d807cb20 con 0x7f41ec069890 2023-10-06T03:00:05.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.823+0000 7f41ebfff700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f41d0060550 0x7f41d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:05.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.827+0000 7f41ebfff700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f41d0060550 0x7f41d0062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f41e00093f0 tx=0x7f41e0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.831+0000 7f41e8ff9700 1 -- 172.21.15.27:0/1904622774 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f41d804cfb0 con 0x7f41ec069890 2023-10-06T03:00:05.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.987+0000 7f41f191a700 1 -- 172.21.15.27:0/1904622774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41ec0b6330 con 0x7f41ec069890 2023-10-06T03:00:05.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.991+0000 7f41e8ff9700 1 -- 172.21.15.27:0/1904622774 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f41d80505d0 con 0x7f41ec069890 2023-10-06T03:00:05.997 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:00:05.997 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":24,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T02:59:54.652472+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:59:47.570918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:51.949130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:52.638817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:05.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.991+0000 7f41f191a700 1 -- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f41d0060550 msgr2=0x7f41d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.991+0000 7f41f191a700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f41d0060550 0x7f41d0062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f41e00093f0 tx=0x7f41e0017000 comp rx=0 tx=0).stop 2023-10-06T03:00:05.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.991+0000 7f41f191a700 1 -- 172.21.15.27:0/1904622774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41ec069890 msgr2=0x7f41ec148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.991+0000 7f41f191a700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41ec069890 0x7f41ec148370 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f41d800ec80 tx=0x7f41d80091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.991+0000 7f41f191a700 1 -- 172.21.15.27:0/1904622774 shutdown_connections 2023-10-06T03:00:05.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.991+0000 7f41f191a700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f41d0060550 0x7f41d0062a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.991+0000 7f41f191a700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41ec0b3d90 0x7f41ec0b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.991+0000 7f41f191a700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41ec06e8b0 0x7f41ec0b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.991+0000 7f41f191a700 1 --2- 172.21.15.27:0/1904622774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41ec069890 0x7f41ec148370 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.991+0000 7f41f191a700 1 -- 172.21.15.27:0/1904622774 >> 172.21.15.27:0/1904622774 conn(0x7f41ec0bec40 msgr2=0x7f41ec06d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.991+0000 7f41f191a700 1 -- 172.21.15.27:0/1904622774 shutdown_connections 2023-10-06T03:00:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:05.991+0000 7f41f191a700 1 -- 172.21.15.27:0/1904622774 wait complete. 2023-10-06T03:00:06.011 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:06.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff55a3e7700 1 Processor -- start 2023-10-06T03:00:06.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff55a3e7700 1 -- start start 2023-10-06T03:00:06.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff55a3e7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff5540baec0 0x7ff5541487e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff55a3e7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff55409da20 0x7ff5540a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff55a3e7700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff554148350 con 0x7ff5540a0a30 2023-10-06T03:00:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff55a3e7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff554148d20 con 0x7ff5540baec0 2023-10-06T03:00:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff55a3e7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5540ba410 con 0x7ff55409da20 2023-10-06T03:00:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff558be4700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff5540a0a30 0x7ff55409d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44634/0 (socket says 172.21.15.27:44634) 2023-10-06T03:00:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff558be4700 1 -- 172.21.15.27:0/3587037589 learned_addr learned my addr 172.21.15.27:0/3587037589 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff5593e5700 1 --2- 172.21.15.27:0/3587037589 >> v2:172.21.15.27:3300/0 conn(0x7ff5540baec0 0x7ff5541487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff559be6700 1 --2- 172.21.15.27:0/3587037589 >> v2:172.21.15.123:3300/0 conn(0x7ff55409da20 0x7ff5540a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff54bfff700 1 -- 172.21.15.27:0/3587037589 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868894202 0 0) 0x7ff554148350 con 0x7ff5540a0a30 2023-10-06T03:00:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff54bfff700 1 -- 172.21.15.27:0/3587037589 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff540003570 con 0x7ff5540a0a30 2023-10-06T03:00:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff5593e5700 1 -- 172.21.15.27:0/3587037589 >> v2:172.21.15.123:3300/0 conn(0x7ff55409da20 msgr2=0x7ff5540a28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff5593e5700 1 --2- 172.21.15.27:0/3587037589 >> v2:172.21.15.123:3300/0 conn(0x7ff55409da20 0x7ff5540a28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff5593e5700 1 -- 172.21.15.27:0/3587037589 >> v1:172.21.15.27:6789/0 conn(0x7ff5540a0a30 legacy=0x7ff55409d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff5593e5700 1 -- 172.21.15.27:0/3587037589 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff554147a80 con 0x7ff5540baec0 2023-10-06T03:00:06.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff5593e5700 1 --2- 172.21.15.27:0/3587037589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5540baec0 0x7ff5541487e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff5540a05c0 tx=0x7ff5440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1006abb98bcde236 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.111+0000 7ff54bfff700 1 -- 172.21.15.27:0/3587037589 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff544011630 con 0x7ff5540baec0 2023-10-06T03:00:06.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff54bfff700 1 -- 172.21.15.27:0/3587037589 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff544011790 con 0x7ff5540baec0 2023-10-06T03:00:06.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff54bfff700 1 -- 172.21.15.27:0/3587037589 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff544011b30 con 0x7ff5540baec0 2023-10-06T03:00:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 -- 172.21.15.27:0/3587037589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5540baec0 msgr2=0x7ff5541487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 --2- 172.21.15.27:0/3587037589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5540baec0 0x7ff5541487e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff5540a05c0 tx=0x7ff5440091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 -- 172.21.15.27:0/3587037589 shutdown_connections 2023-10-06T03:00:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 --2- 172.21.15.27:0/3587037589 >> v2:172.21.15.123:3300/0 conn(0x7ff55409da20 0x7ff5540a28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 --2- 172.21.15.27:0/3587037589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5540baec0 0x7ff5541487e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 -- 172.21.15.27:0/3587037589 >> 172.21.15.27:0/3587037589 conn(0x7ff55406eb10 msgr2=0x7ff5540ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 -- 172.21.15.27:0/3587037589 shutdown_connections 2023-10-06T03:00:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 -- 172.21.15.27:0/3587037589 wait complete. 2023-10-06T03:00:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 Processor -- start 2023-10-06T03:00:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 -- start start 2023-10-06T03:00:06.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff55409da20 0x7ff554146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540a0a30 0x7ff554095a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5540baec0 0x7ff5540bc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5541462e0 con 0x7ff5540baec0 2023-10-06T03:00:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff554158c20 con 0x7ff5540a0a30 2023-10-06T03:00:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff55a3e7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff554159180 con 0x7ff55409da20 2023-10-06T03:00:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff559be6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5540baec0 0x7ff5540bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff559be6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5540baec0 0x7ff5540bc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49228/0 (socket says 172.21.15.27:49228) 2023-10-06T03:00:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff559be6700 1 -- 172.21.15.27:0/2302864872 learned_addr learned my addr 172.21.15.27:0/2302864872 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff558be4700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540a0a30 0x7ff554095a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff5593e5700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff55409da20 0x7ff554146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff559be6700 1 -- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff55409da20 msgr2=0x7ff554146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff559be6700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff55409da20 0x7ff554146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff559be6700 1 -- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540a0a30 msgr2=0x7ff554095a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff559be6700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540a0a30 0x7ff554095a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff559be6700 1 -- 172.21.15.27:0/2302864872 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff544009420 con 0x7ff5540baec0 2023-10-06T03:00:06.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff559be6700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5540baec0 0x7ff5540bc270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff54c00ea50 tx=0x7ff54c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.115+0000 7ff5497fa700 1 -- 172.21.15.27:0/2302864872 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c00ee90 con 0x7ff5540baec0 2023-10-06T03:00:06.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.119+0000 7ff55a3e7700 1 -- 172.21.15.27:0/2302864872 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff554158e10 con 0x7ff5540baec0 2023-10-06T03:00:06.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.119+0000 7ff5497fa700 1 -- 172.21.15.27:0/2302864872 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c00c7f0 con 0x7ff5540baec0 2023-10-06T03:00:06.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.119+0000 7ff5497fa700 1 -- 172.21.15.27:0/2302864872 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c00cbb0 con 0x7ff5540baec0 2023-10-06T03:00:06.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.119+0000 7ff55a3e7700 1 -- 172.21.15.27:0/2302864872 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5540bc7b0 con 0x7ff5540baec0 2023-10-06T03:00:06.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.119+0000 7ff55a3e7700 1 -- 172.21.15.27:0/2302864872 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff554159330 con 0x7ff5540baec0 2023-10-06T03:00:06.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.119+0000 7ff5497fa700 1 -- 172.21.15.27:0/2302864872 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff54c013470 con 0x7ff5540baec0 2023-10-06T03:00:06.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.119+0000 7ff5497fa700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ff538060580 0x7ff538062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.119+0000 7ff5497fa700 1 -- 172.21.15.27:0/2302864872 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff54c07cac0 con 0x7ff5540baec0 2023-10-06T03:00:06.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.119+0000 7ff5593e5700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ff538060580 0x7ff538062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.119+0000 7ff5593e5700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ff538060580 0x7ff538062a30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff5540a05c0 tx=0x7ff544017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.127+0000 7ff5497fa700 1 -- 172.21.15.27:0/2302864872 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff554159330 con 0x7ff5540baec0 2023-10-06T03:00:06.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff55a3e7700 1 -- 172.21.15.27:0/2302864872 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5541592f0 con 0x7ff5540baec0 2023-10-06T03:00:06.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff5497fa700 1 -- 172.21.15.27:0/2302864872 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3082 (secure 0 0 0) 0x7ff54c017c20 con 0x7ff5540baec0 2023-10-06T03:00:06.328 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:00:06.328 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3318688789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3318688789},{"type":"v1","addr":"172.21.15.123:6835","nonce":3318688789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:53.638660+0000","modified":"2023-10-06T02:59:56.293208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6833/3144883581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3144883581},{"type":"v1","addr":"172.21.15.27:6833","nonce":3144883581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:00:06.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff55a3e7700 1 -- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ff538060580 msgr2=0x7ff538062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff55a3e7700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ff538060580 0x7ff538062a30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff5540a05c0 tx=0x7ff544017000 comp rx=0 tx=0).stop 2023-10-06T03:00:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff55a3e7700 1 -- 172.21.15.27:0/2302864872 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5540baec0 msgr2=0x7ff5540bc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff55a3e7700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5540baec0 0x7ff5540bc270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff54c00ea50 tx=0x7ff54c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff55a3e7700 1 -- 172.21.15.27:0/2302864872 shutdown_connections 2023-10-06T03:00:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff55a3e7700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7ff538060580 0x7ff538062a30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff55a3e7700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5540baec0 0x7ff5540bc270 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff55a3e7700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540a0a30 0x7ff554095a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff55a3e7700 1 --2- 172.21.15.27:0/2302864872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff55409da20 0x7ff554146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff55a3e7700 1 -- 172.21.15.27:0/2302864872 >> 172.21.15.27:0/2302864872 conn(0x7ff55406eb10 msgr2=0x7ff5540ba550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff55a3e7700 1 -- 172.21.15.27:0/2302864872 shutdown_connections 2023-10-06T03:00:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.323+0000 7ff55a3e7700 1 -- 172.21.15.27:0/2302864872 wait complete. 2023-10-06T03:00:06.332 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 6 2023-10-06T03:00:06.544 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:59:53.638660+0000', 'modified': '2023-10-06T02:59:56.293208+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4302': {'gid': 4302, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.27:6833/3144883581', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6832', 'nonce': 3144883581}, {'type': 'v1', 'addr': '172.21.15.27:6833', 'nonce': 3144883581}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:00:06.544 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:00:06.545 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:00:06.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70bbfff700 1 Processor -- start 2023-10-06T03:00:06.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70bbfff700 1 -- start start 2023-10-06T03:00:06.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70bbfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f70bc0bb2c0 0x7f70bc0ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70bbfff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70bc09ef80 con 0x7f70bc0b9c50 2023-10-06T03:00:06.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70bbfff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70bc0a39d0 con 0x7f70bc0a3550 2023-10-06T03:00:06.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70bbfff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70bc0a0f20 con 0x7f70bc0bb2c0 2023-10-06T03:00:06.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70b27fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f70bc0bb2c0 0x7f70bc0ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70b27fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f70bc0bb2c0 0x7f70bc0ba020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49242/0 (socket says 172.21.15.27:49242) 2023-10-06T03:00:06.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70baffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f70bc0b9c50 0x7f70bc06c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44650/0 (socket says 172.21.15.27:44650) 2023-10-06T03:00:06.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70b27fc700 1 -- 172.21.15.27:0/1226088133 learned_addr learned my addr 172.21.15.27:0/1226088133 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:06.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70b27fc700 1 -- 172.21.15.27:0/1226088133 >> v1:172.21.15.123:6789/0 conn(0x7f70bc0a3550 legacy=0x7f70bc09f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70ba7fc700 1 -- 172.21.15.27:0/1226088133 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884048864 0 0) 0x7f70bc09ef80 con 0x7f70bc0b9c50 2023-10-06T03:00:06.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70b27fc700 1 -- 172.21.15.27:0/1226088133 >> v1:172.21.15.27:6789/0 conn(0x7f70bc0b9c50 legacy=0x7f70bc06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70b27fc700 1 -- 172.21.15.27:0/1226088133 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70bc0a2c50 con 0x7f70bc0bb2c0 2023-10-06T03:00:06.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70b27fc700 1 --2- 172.21.15.27:0/1226088133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70bc0bb2c0 0x7f70bc0ba020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f70a40099b0 tx=0x7f70a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8063131dcf99868 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70ba7fc700 1 -- 172.21.15.27:0/1226088133 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a400b860 con 0x7f70bc0bb2c0 2023-10-06T03:00:06.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70ba7fc700 1 -- 172.21.15.27:0/1226088133 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a400b9c0 con 0x7f70bc0bb2c0 2023-10-06T03:00:06.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70ba7fc700 1 -- 172.21.15.27:0/1226088133 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a400bd60 con 0x7f70bc0bb2c0 2023-10-06T03:00:06.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70bbfff700 1 -- 172.21.15.27:0/1226088133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70bc0bb2c0 msgr2=0x7f70bc0ba020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70bbfff700 1 --2- 172.21.15.27:0/1226088133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70bc0bb2c0 0x7f70bc0ba020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f70a40099b0 tx=0x7f70a4009250 comp rx=0 tx=0).stop 2023-10-06T03:00:06.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70bbfff700 1 -- 172.21.15.27:0/1226088133 shutdown_connections 2023-10-06T03:00:06.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70bbfff700 1 --2- 172.21.15.27:0/1226088133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70bc0bb2c0 0x7f70bc0ba020 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.659+0000 7f70bbfff700 1 -- 172.21.15.27:0/1226088133 >> 172.21.15.27:0/1226088133 conn(0x7f70bc06eb10 msgr2=0x7f70bc0ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:06.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.663+0000 7f70bbfff700 1 -- 172.21.15.27:0/1226088133 shutdown_connections 2023-10-06T03:00:06.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.663+0000 7f70bbfff700 1 -- 172.21.15.27:0/1226088133 wait complete. 2023-10-06T03:00:06.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.663+0000 7f70bbfff700 1 Processor -- start 2023-10-06T03:00:06.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.663+0000 7f70bbfff700 1 -- start start 2023-10-06T03:00:06.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70bbfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70bc0a3550 0x7f70bc068550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70bbfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70bc0b9c50 0x7f70bc152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70bbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70bc0bb2c0 0x7f70bc14ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70bbfff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc069500 con 0x7f70bc0b9c50 2023-10-06T03:00:06.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70bbfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc06b410 con 0x7f70bc0bb2c0 2023-10-06T03:00:06.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70bbfff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc1481b0 con 0x7f70bc0a3550 2023-10-06T03:00:06.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70b27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70bc0b9c50 0x7f70bc152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70b27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70bc0b9c50 0x7f70bc152000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49248/0 (socket says 172.21.15.27:49248) 2023-10-06T03:00:06.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70b27fc700 1 -- 172.21.15.27:0/3142441189 learned_addr learned my addr 172.21.15.27:0/3142441189 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:06.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70bb7fe700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70bc0bb2c0 0x7f70bc14ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70baffd700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70bc0a3550 0x7f70bc068550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70b27fc700 1 -- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70bc0a3550 msgr2=0x7f70bc068550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70b27fc700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70bc0a3550 0x7f70bc068550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70b27fc700 1 -- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70bc0bb2c0 msgr2=0x7f70bc14ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70b27fc700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70bc0bb2c0 0x7f70bc14ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70b27fc700 1 -- 172.21.15.27:0/3142441189 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a40094f0 con 0x7f70bc0b9c50 2023-10-06T03:00:06.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70b27fc700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70bc0b9c50 0x7f70bc152000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0705f0 tx=0x7f70a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70b37fe700 1 -- 172.21.15.27:0/3142441189 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4020070 con 0x7f70bc0b9c50 2023-10-06T03:00:06.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70b37fe700 1 -- 172.21.15.27:0/3142441189 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a4011dc0 con 0x7f70bc0b9c50 2023-10-06T03:00:06.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70bbfff700 1 -- 172.21.15.27:0/3142441189 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70bc148400 con 0x7f70bc0b9c50 2023-10-06T03:00:06.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70b37fe700 1 -- 172.21.15.27:0/3142441189 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a40256c0 con 0x7f70bc0b9c50 2023-10-06T03:00:06.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.667+0000 7f70bbfff700 1 -- 172.21.15.27:0/3142441189 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70bc153530 con 0x7f70bc0b9c50 2023-10-06T03:00:06.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.671+0000 7f70b37fe700 1 -- 172.21.15.27:0/3142441189 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f70a401a420 con 0x7f70bc0b9c50 2023-10-06T03:00:06.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.671+0000 7f70b37fe700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f709c060550 0x7f709c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.671+0000 7f70b37fe700 1 -- 172.21.15.27:0/3142441189 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f70a407e220 con 0x7f70bc0b9c50 2023-10-06T03:00:06.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.671+0000 7f70baffd700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f709c060550 0x7f709c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.671+0000 7f70baffd700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f709c060550 0x7f709c062a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f70ac007fd0 tx=0x7f70ac007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.671+0000 7f70c3cbb740 1 Processor -- start 2023-10-06T03:00:06.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.671+0000 7f70c3cbb740 1 -- start start 2023-10-06T03:00:06.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.671+0000 7f70c3cbb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x104b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.671+0000 7f70c3cbb740 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe17710 0x105a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.671+0000 7f70c3cbb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe62790 0x105ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.671+0000 7f70c3cbb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0xfc2f30 con 0xe17ae0 2023-10-06T03:00:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.671+0000 7f70c3cbb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0xfbeed0 con 0xe62790 2023-10-06T03:00:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.671+0000 7f70c3cbb740 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0xf850b0 con 0xe17710 2023-10-06T03:00:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70baffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x104b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70baffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x104b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49256/0 (socket says 172.21.15.27:49256) 2023-10-06T03:00:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70baffd700 1 -- 172.21.15.27:0/3029648444 learned_addr learned my addr 172.21.15.27:0/3029648444 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70b27fc700 1 --2- 172.21.15.27:0/3029648444 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe17710 0x105a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70bb7fe700 1 --2- 172.21.15.27:0/3029648444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe62790 0x105ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70baffd700 1 -- 172.21.15.27:0/3029648444 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe17710 msgr2=0x105a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:06.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70baffd700 1 --2- 172.21.15.27:0/3029648444 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe17710 0x105a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70baffd700 1 -- 172.21.15.27:0/3029648444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe62790 msgr2=0x105ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:06.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70baffd700 1 --2- 172.21.15.27:0/3029648444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe62790 0x105ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70baffd700 1 -- 172.21.15.27:0/3029648444 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe639e0 con 0xe17ae0 2023-10-06T03:00:06.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70baffd700 1 --2- 172.21.15.27:0/3029648444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x104b770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0049a0 tx=0x7f70ac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af801bbd493cbe7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f709bfff700 1 -- 172.21.15.27:0/3029648444 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac013600 con 0xe17ae0 2023-10-06T03:00:06.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f709bfff700 1 -- 172.21.15.27:0/3029648444 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac013760 con 0xe17ae0 2023-10-06T03:00:06.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f709bfff700 1 -- 172.21.15.27:0/3029648444 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac013ae0 con 0xe17ae0 2023-10-06T03:00:06.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70c3cbb740 1 -- 172.21.15.27:0/3029648444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 msgr2=0x104b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/3029648444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x104b770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0049a0 tx=0x7f70ac014000 comp rx=0 tx=0).stop 2023-10-06T03:00:06.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70c3cbb740 1 -- 172.21.15.27:0/3029648444 shutdown_connections 2023-10-06T03:00:06.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/3029648444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe62790 0x105ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/3029648444 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe17710 0x105a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/3029648444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x104b770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70c3cbb740 1 -- 172.21.15.27:0/3029648444 >> 172.21.15.27:0/3029648444 conn(0xe17eb0 msgr2=0x106c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:06.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70c3cbb740 1 -- 172.21.15.27:0/3029648444 shutdown_connections 2023-10-06T03:00:06.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70c3cbb740 1 -- 172.21.15.27:0/3029648444 wait complete. 2023-10-06T03:00:06.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70c3cbb740 1 -- start start 2023-10-06T03:00:06.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.675+0000 7f70c3cbb740 1 Processor -- start 2023-10-06T03:00:06.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17710 0x1051230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x105fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe62790 0x105ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0xf84d50 con 0xe17ae0 2023-10-06T03:00:06.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0xf5d970 con 0xe17710 2023-10-06T03:00:06.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0xf96d60 con 0xe62790 2023-10-06T03:00:06.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 10 client.0 _ll_register_callbacks cb 0x1008b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:06.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70b27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x105fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70b27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x105fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49268/0 (socket says 172.21.15.27:49268) 2023-10-06T03:00:06.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70b27fc700 1 -- 172.21.15.27:0/2336089774 learned_addr learned my addr 172.21.15.27:0/2336089774 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:06.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70baffd700 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17710 0x1051230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70bb7fe700 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe62790 0x105ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70b27fc700 1 -- 172.21.15.27:0/2336089774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe62790 msgr2=0x105ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:06.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70b27fc700 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe62790 0x105ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70b27fc700 1 -- 172.21.15.27:0/2336089774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17710 msgr2=0x1051230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:06.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70b27fc700 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17710 0x1051230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70b27fc700 1 -- 172.21.15.27:0/2336089774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ac001420 con 0xe17ae0 2023-10-06T03:00:06.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70baffd700 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17710 0x1051230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:06.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70b27fc700 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x105fa50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f70a4000e50 tx=0x7f70a407c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e861a56ca3e4175d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70997fa700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-10-06T03:00:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70997fa700 1 -- 172.21.15.27:0/2336089774 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4052a70 con 0xe17ae0 2023-10-06T03:00:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70997fa700 1 -- 172.21.15.27:0/2336089774 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f70a4055560 con 0xe17ae0 2023-10-06T03:00:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 1 -- 172.21.15.27:0/2336089774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xf5dcc0 con 0xe17ae0 2023-10-06T03:00:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70997fa700 1 -- 172.21.15.27:0/2336089774 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70a40592b0 con 0xe17ae0 2023-10-06T03:00:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 10 client.4707 fetch_fsmap learned FSMap version 6 2023-10-06T03:00:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 1 -- 172.21.15.27:0/2336089774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0xf8d370 con 0xe17ae0 2023-10-06T03:00:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70997fa700 1 -- 172.21.15.27:0/2336089774 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xf5dcc0 con 0xe17ae0 2023-10-06T03:00:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70997fa700 1 -- 172.21.15.27:0/2336089774 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 6) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f70a40517c0 con 0xe17ae0 2023-10-06T03:00:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 10 client.4707 fetch_fsmap finished waiting for FSMap version 6 2023-10-06T03:00:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 10 client.4707 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 20 client.4707 populate_metadata read hostname 'smithi027' 2023-10-06T03:00:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.27:6832/3144883581,v1:172.21.15.27:6833/3144883581] conn(0x1094ba0 0x1096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 4 client.4707 mds_command: new command op to 4302 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70c3cbb740 1 -- 172.21.15.27:0/2336089774 --> [v2:172.21.15.27:6832/3144883581,v1:172.21.15.27:6833/3144883581] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xf613e0 con 0x1094ba0 2023-10-06T03:00:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70baffd700 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.27:6832/3144883581,v1:172.21.15.27:6833/3144883581] conn(0x1094ba0 0x1096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70baffd700 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.27:6832/3144883581,v1:172.21.15.27:6833/3144883581] conn(0x1094ba0 0x1096f80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=822bf3f89e8f0066 server_cookie=f7bd2b43e9d61de9 in_seq=0 out_seq=0 2023-10-06T03:00:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.679+0000 7f70997fa700 10 client.4707 ms_handle_connect on v2:172.21.15.27:6832/3144883581 2023-10-06T03:00:06.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70997fa700 1 -- 172.21.15.27:0/2336089774 <== mds.0 v2:172.21.15.27:6832/3144883581 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0xf613e0 con 0x1094ba0 2023-10-06T03:00:06.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70997fa700 10 client.4707 handle_command_reply: tid=0 2023-10-06T03:00:06.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70c3cbb740 1 client.4707 shutdown 2023-10-06T03:00:06.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70c3cbb740 1 -- 172.21.15.27:0/2336089774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 msgr2=0x105fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x105fa50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f70a4000e50 tx=0x7f70a407c4a0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70c3cbb740 1 -- 172.21.15.27:0/2336089774 shutdown_connections 2023-10-06T03:00:06.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.27:6832/3144883581,v1:172.21.15.27:6833/3144883581] conn(0x1094ba0 0x1096f80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe62790 0x105ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x105fa50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70997fa700 0 client.4707 ms_handle_reset on v2:172.21.15.27:6832/3144883581 2023-10-06T03:00:06.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/2336089774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17710 0x1051230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70c3cbb740 1 -- 172.21.15.27:0/2336089774 >> 172.21.15.27:0/2336089774 conn(0xe17eb0 msgr2=0x1049ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:06.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70c3cbb740 1 -- 172.21.15.27:0/2336089774 shutdown_connections 2023-10-06T03:00:06.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70c3cbb740 1 -- 172.21.15.27:0/2336089774 wait complete. 2023-10-06T03:00:06.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.683+0000 7f70c3cbb740 20 client.4707 trim_cache size 0 max 16384 2023-10-06T03:00:06.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.699+0000 7f70c3cbb740 1 Processor -- start 2023-10-06T03:00:06.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.699+0000 7f70c3cbb740 1 -- start start 2023-10-06T03:00:06.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17710 0x1084520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x1084a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe62790 0x104efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0xfe63b0 con 0xe17ae0 2023-10-06T03:00:06.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0xfbdd60 con 0xe17710 2023-10-06T03:00:06.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0xf5fb80 con 0xe62790 2023-10-06T03:00:06.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70b27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x1084a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70b27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x1084a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49280/0 (socket says 172.21.15.27:49280) 2023-10-06T03:00:06.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70b27fc700 1 -- 172.21.15.27:0/199665280 learned_addr learned my addr 172.21.15.27:0/199665280 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:06.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70baffd700 1 --2- 172.21.15.27:0/199665280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17710 0x1084520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70bb7fe700 1 --2- 172.21.15.27:0/199665280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe62790 0x104efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70b27fc700 1 -- 172.21.15.27:0/199665280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe62790 msgr2=0x104efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70b27fc700 1 --2- 172.21.15.27:0/199665280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe62790 0x104efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70b27fc700 1 -- 172.21.15.27:0/199665280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17710 msgr2=0x1084520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70b27fc700 1 --2- 172.21.15.27:0/199665280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17710 0x1084520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70b27fc700 1 -- 172.21.15.27:0/199665280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70bc0bc430 con 0xe17ae0 2023-10-06T03:00:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70bb7fe700 1 --2- 172.21.15.27:0/199665280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe62790 0x104efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70b27fc700 1 --2- 172.21.15.27:0/199665280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x1084a60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70a40508c0 tx=0x7f70a4067000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86e9514c64455fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70b0ff9700 1 -- 172.21.15.27:0/199665280 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a40592b0 con 0xe17ae0 2023-10-06T03:00:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70b0ff9700 1 -- 172.21.15.27:0/199665280 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a4052a70 con 0xe17ae0 2023-10-06T03:00:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70b0ff9700 1 -- 172.21.15.27:0/199665280 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a40092c0 con 0xe17ae0 2023-10-06T03:00:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 -- 172.21.15.27:0/199665280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 msgr2=0x1084a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/199665280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x1084a60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70a40508c0 tx=0x7f70a4067000 comp rx=0 tx=0).stop 2023-10-06T03:00:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 -- 172.21.15.27:0/199665280 shutdown_connections 2023-10-06T03:00:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/199665280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe62790 0x104efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/199665280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe17ae0 0x1084a60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/199665280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17710 0x1084520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 -- 172.21.15.27:0/199665280 >> 172.21.15.27:0/199665280 conn(0xe17eb0 msgr2=0x1083e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 -- 172.21.15.27:0/199665280 shutdown_connections 2023-10-06T03:00:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 -- 172.21.15.27:0/199665280 wait complete. 2023-10-06T03:00:06.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.703+0000 7f70c3cbb740 1 -- start start 2023-10-06T03:00:06.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70c3cbb740 1 Processor -- start 2023-10-06T03:00:06.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70c3cbb740 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe17710 0x10dd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70c3cbb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17ae0 0x10ddc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70c3cbb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe62790 0x10de770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70c3cbb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0xfc3490 con 0xe62790 2023-10-06T03:00:06.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70c3cbb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0xf94010 con 0xe17ae0 2023-10-06T03:00:06.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70c3cbb740 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0xf93610 con 0xe17710 2023-10-06T03:00:06.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70c3cbb740 10 client.0 _ll_register_callbacks cb 0xf68920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:06.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70bb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe62790 0x10de770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70bb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe62790 0x10de770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49286/0 (socket says 172.21.15.27:49286) 2023-10-06T03:00:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70bb7fe700 1 -- 172.21.15.27:0/3108557556 learned_addr learned my addr 172.21.15.27:0/3108557556 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70b27fc700 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17ae0 0x10ddc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70baffd700 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe17710 0x10dd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70bb7fe700 1 -- 172.21.15.27:0/3108557556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe17710 msgr2=0x10dd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70bb7fe700 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe17710 0x10dd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70bb7fe700 1 -- 172.21.15.27:0/3108557556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17ae0 msgr2=0x10ddc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70bb7fe700 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17ae0 0x10ddc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70bb7fe700 1 -- 172.21.15.27:0/3108557556 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xf8d370 con 0xe62790 2023-10-06T03:00:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70baffd700 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe17710 0x10dd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70997fa700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-10-06T03:00:06.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70bb7fe700 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe62790 0x10de770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f70b4013dc0 tx=0x7f70b4003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9794e47901f65d01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70997fa700 1 -- 172.21.15.27:0/3108557556 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4006ba0 con 0xe62790 2023-10-06T03:00:06.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70c3cbb740 1 -- 172.21.15.27:0/3108557556 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xf93410 con 0xe62790 2023-10-06T03:00:06.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70997fa700 1 -- 172.21.15.27:0/3108557556 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f70b4006d00 con 0xe62790 2023-10-06T03:00:06.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70997fa700 1 -- 172.21.15.27:0/3108557556 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70b4015900 con 0xe62790 2023-10-06T03:00:06.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70c3cbb740 10 client.4713 fetch_fsmap learned FSMap version 6 2023-10-06T03:00:06.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.707+0000 7f70c3cbb740 1 -- 172.21.15.27:0/3108557556 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0xf73d80 con 0xe62790 2023-10-06T03:00:06.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70997fa700 1 -- 172.21.15.27:0/3108557556 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xf93410 con 0xe62790 2023-10-06T03:00:06.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70997fa700 1 -- 172.21.15.27:0/3108557556 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 6) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f70b401b020 con 0xe62790 2023-10-06T03:00:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 10 client.4713 fetch_fsmap finished waiting for FSMap version 6 2023-10-06T03:00:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 10 client.4713 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 20 client.4713 populate_metadata read hostname 'smithi027' 2023-10-06T03:00:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.27:6832/3144883581,v1:172.21.15.27:6833/3144883581] conn(0x10df9f0 0x10eaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 4 client.4713 mds_command: new command op to 4302 tid=0[{"prefix": "status"}] 2023-10-06T03:00:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 1 -- 172.21.15.27:0/3108557556 --> [v2:172.21.15.27:6832/3144883581,v1:172.21.15.27:6833/3144883581] -- command(tid 0: {"prefix": "status"}) v1 -- 0xe6f4e0 con 0x10df9f0 2023-10-06T03:00:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70baffd700 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.27:6832/3144883581,v1:172.21.15.27:6833/3144883581] conn(0x10df9f0 0x10eaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70997fa700 10 client.4713 ms_handle_connect on v2:172.21.15.27:6832/3144883581 2023-10-06T03:00:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70baffd700 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.27:6832/3144883581,v1:172.21.15.27:6833/3144883581] conn(0x10df9f0 0x10eaa00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c483cac6bedf8af1 server_cookie=d2b66ae0416f2f06 in_seq=0 out_seq=0 2023-10-06T03:00:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70997fa700 1 -- 172.21.15.27:0/3108557556 <== mds.0 v2:172.21.15.27:6832/3144883581 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0xe6f4e0 con 0x10df9f0 2023-10-06T03:00:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70997fa700 10 client.4713 handle_command_reply: tid=0 2023-10-06T03:00:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 1 client.4713 shutdown 2023-10-06T03:00:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 1 -- 172.21.15.27:0/3108557556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe62790 msgr2=0x10de770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe62790 0x10de770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f70b4013dc0 tx=0x7f70b4003040 comp rx=0 tx=0).stop 2023-10-06T03:00:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 1 -- 172.21.15.27:0/3108557556 shutdown_connections 2023-10-06T03:00:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.27:6832/3144883581,v1:172.21.15.27:6833/3144883581] conn(0x10df9f0 0x10eaa00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0xe62790 0x10de770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70997fa700 0 client.4713 ms_handle_reset on v2:172.21.15.27:6832/3144883581 2023-10-06T03:00:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0xe17ae0 0x10ddc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 1 --2- 172.21.15.27:0/3108557556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0xe17710 0x10dd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 1 -- 172.21.15.27:0/3108557556 >> 172.21.15.27:0/3108557556 conn(0xe17eb0 msgr2=0x1069100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:06.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 1 -- 172.21.15.27:0/3108557556 shutdown_connections 2023-10-06T03:00:06.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 1 -- 172.21.15.27:0/3108557556 wait complete. 2023-10-06T03:00:06.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70c3cbb740 20 client.4713 trim_cache size 0 max 16384 2023-10-06T03:00:06.721 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-06T03:00:06.721 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "e03fe5a6-e2a4-4ef7-9a46-008590473953", 2023-10-06T03:00:06.721 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2023-10-06T03:00:06.721 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 4302, 2023-10-06T03:00:06.722 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2023-10-06T03:00:06.722 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2023-10-06T03:00:06.722 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2023-10-06T03:00:06.722 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 12.442349715000001, 2023-10-06T03:00:06.722 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 6, 2023-10-06T03:00:06.722 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 24, 2023-10-06T03:00:06.722 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 24, 2023-10-06T03:00:06.722 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 17.489999259000001 2023-10-06T03:00:06.722 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-06T03:00:06.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70bbfff700 1 -- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f709c060550 msgr2=0x7f709c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70bbfff700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f709c060550 0x7f709c062a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f70ac007fd0 tx=0x7f70ac007d30 comp rx=0 tx=0).stop 2023-10-06T03:00:06.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70bbfff700 1 -- 172.21.15.27:0/3142441189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70bc0b9c50 msgr2=0x7f70bc152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70bbfff700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70bc0b9c50 0x7f70bc152000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0705f0 tx=0x7f70a4017000 comp rx=0 tx=0).stop 2023-10-06T03:00:06.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70bbfff700 1 -- 172.21.15.27:0/3142441189 shutdown_connections 2023-10-06T03:00:06.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70bbfff700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f709c060550 0x7f709c062a00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70bbfff700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70bc0bb2c0 0x7f70bc14ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70bbfff700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70bc0b9c50 0x7f70bc152000 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70bbfff700 1 --2- 172.21.15.27:0/3142441189 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70bc0a3550 0x7f70bc068550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70bbfff700 1 -- 172.21.15.27:0/3142441189 >> 172.21.15.27:0/3142441189 conn(0x7f70bc06eb10 msgr2=0x7f70bc09f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:06.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70bbfff700 1 -- 172.21.15.27:0/3142441189 shutdown_connections 2023-10-06T03:00:06.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.711+0000 7f70bbfff700 1 -- 172.21.15.27:0/3142441189 wait complete. 2023-10-06T03:00:06.736 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-06T03:00:06.759 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-06T03:00:06.759 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}, 'client.2': {}} 2023-10-06T03:00:06.759 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-06T03:00:06.759 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-06T03:00:06.759 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-06T03:00:06.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:06.760 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-06T03:00:06.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:06.768 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-10-06T03:00:06.787 INFO:teuthology.orchestra.run.smithi158.stderr:Cannot find device "ceph-brx" 2023-10-06T03:00:06.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:00:06.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:06.788 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2023-10-06T03:00:06.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:06.796 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2023-10-06T03:00:06.813 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2023-10-06T03:00:06.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:00:06.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:06.814 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-06T03:00:06.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:06.822 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link delete ceph-brx 2023-10-06T03:00:06.840 INFO:teuthology.orchestra.run.smithi124.stderr:Cannot find device "ceph-brx" 2023-10-06T03:00:06.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:00:06.842 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-06T03:00:06.842 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:00:06.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f6012eb8700 1 Processor -- start 2023-10-06T03:00:06.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f6012eb8700 1 -- start start 2023-10-06T03:00:06.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f6012eb8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f600c14f6c0 0x7f600c0b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f6012eb8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f600c14fb20 0x7f600c0b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f6012eb8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600c0a1a90 con 0x7f600c06cb40 2023-10-06T03:00:06.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f6012eb8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600c0bda50 con 0x7f600c14f6c0 2023-10-06T03:00:06.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f6012eb8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600c0bc750 con 0x7f600c14fb20 2023-10-06T03:00:06.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f600bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f600c14f6c0 0x7f600c0b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f6010c54700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f600c06cb40 0x7f600c14efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44664/0 (socket says 172.21.15.27:44664) 2023-10-06T03:00:06.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f600bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f600c14f6c0 0x7f600c0b6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49290/0 (socket says 172.21.15.27:49290) 2023-10-06T03:00:06.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f6010c54700 1 -- 172.21.15.27:0/2580226429 learned_addr learned my addr 172.21.15.27:0/2580226429 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:06.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f6011455700 1 --2- 172.21.15.27:0/2580226429 >> v2:172.21.15.123:3300/0 conn(0x7f600c14fb20 0x7f600c0b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f600bfff700 1 -- 172.21.15.27:0/2580226429 >> v2:172.21.15.123:3300/0 conn(0x7f600c14fb20 msgr2=0x7f600c0b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:06.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f600bfff700 1 --2- 172.21.15.27:0/2580226429 >> v2:172.21.15.123:3300/0 conn(0x7f600c14fb20 0x7f600c0b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f600bfff700 1 -- 172.21.15.27:0/2580226429 >> v1:172.21.15.27:6789/0 conn(0x7f600c06cb40 legacy=0x7f600c14efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f600b7fe700 1 -- 172.21.15.27:0/2580226429 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631577960 0 0) 0x7f6000001110 con 0x7f600c06cb40 2023-10-06T03:00:06.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f600bfff700 1 -- 172.21.15.27:0/2580226429 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c0a3930 con 0x7f600c14f6c0 2023-10-06T03:00:06.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f600bfff700 1 --2- 172.21.15.27:0/2580226429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f600c14f6c0 0x7f600c0b6eb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f600c0bea10 tx=0x7f5ff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6976e85a55801c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f600b7fe700 1 -- 172.21.15.27:0/2580226429 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8011630 con 0x7f600c14f6c0 2023-10-06T03:00:06.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f600b7fe700 1 -- 172.21.15.27:0/2580226429 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff8011790 con 0x7f600c14f6c0 2023-10-06T03:00:06.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.951+0000 7f600b7fe700 1 -- 172.21.15.27:0/2580226429 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8011b30 con 0x7f600c14f6c0 2023-10-06T03:00:06.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.955+0000 7f6012eb8700 1 -- 172.21.15.27:0/2580226429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f600c14f6c0 msgr2=0x7f600c0b6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.955+0000 7f6012eb8700 1 --2- 172.21.15.27:0/2580226429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f600c14f6c0 0x7f600c0b6eb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f600c0bea10 tx=0x7f5ff80091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.955+0000 7f6012eb8700 1 -- 172.21.15.27:0/2580226429 shutdown_connections 2023-10-06T03:00:06.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.955+0000 7f6012eb8700 1 --2- 172.21.15.27:0/2580226429 >> v2:172.21.15.123:3300/0 conn(0x7f600c14fb20 0x7f600c0b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.955+0000 7f6012eb8700 1 --2- 172.21.15.27:0/2580226429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f600c14f6c0 0x7f600c0b6eb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.955+0000 7f6012eb8700 1 -- 172.21.15.27:0/2580226429 >> 172.21.15.27:0/2580226429 conn(0x7f600c0bf620 msgr2=0x7f600c06e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:06.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.955+0000 7f6012eb8700 1 -- 172.21.15.27:0/2580226429 shutdown_connections 2023-10-06T03:00:06.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.955+0000 7f6012eb8700 1 -- 172.21.15.27:0/2580226429 wait complete. 2023-10-06T03:00:06.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.955+0000 7f6012eb8700 1 Processor -- start 2023-10-06T03:00:06.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.955+0000 7f6012eb8700 1 -- start start 2023-10-06T03:00:06.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6012eb8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f600c06cb40 0x7f600c14d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6012eb8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f600c14f6c0 0x7f600c15c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6012eb8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f600c14fb20 0x7f600c15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6012eb8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c0b99b0 con 0x7f600c14fb20 2023-10-06T03:00:06.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6012eb8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c15fb80 con 0x7f600c14f6c0 2023-10-06T03:00:06.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6012eb8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c15fe60 con 0x7f600c06cb40 2023-10-06T03:00:06.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6011455700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f600c14fb20 0x7f600c15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6011455700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f600c14fb20 0x7f600c15c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49298/0 (socket says 172.21.15.27:49298) 2023-10-06T03:00:06.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6011455700 1 -- 172.21.15.27:0/4195901859 learned_addr learned my addr 172.21.15.27:0/4195901859 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:06.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f600bfff700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f600c14f6c0 0x7f600c15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6010c54700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f600c06cb40 0x7f600c14d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6011455700 1 -- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f600c06cb40 msgr2=0x7f600c14d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6011455700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f600c06cb40 0x7f600c14d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6011455700 1 -- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f600c14f6c0 msgr2=0x7f600c15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6011455700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f600c14f6c0 0x7f600c15c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6011455700 1 -- 172.21.15.27:0/4195901859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff8009420 con 0x7f600c14fb20 2023-10-06T03:00:06.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6011455700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f600c14fb20 0x7f600c15c660 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6004009e90 tx=0x7f600400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6008ff9700 1 -- 172.21.15.27:0/4195901859 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600400cc00 con 0x7f600c14fb20 2023-10-06T03:00:06.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6008ff9700 1 -- 172.21.15.27:0/4195901859 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600400f040 con 0x7f600c14fb20 2023-10-06T03:00:06.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6012eb8700 1 -- 172.21.15.27:0/4195901859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600c0a7bf0 con 0x7f600c14fb20 2023-10-06T03:00:06.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6008ff9700 1 -- 172.21.15.27:0/4195901859 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004014480 con 0x7f600c14fb20 2023-10-06T03:00:06.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6012eb8700 1 -- 172.21.15.27:0/4195901859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600c15cba0 con 0x7f600c14fb20 2023-10-06T03:00:06.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.959+0000 7f6012eb8700 1 -- 172.21.15.27:0/4195901859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600c0b9b20 con 0x7f600c14fb20 2023-10-06T03:00:06.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.963+0000 7f6008ff9700 1 -- 172.21.15.27:0/4195901859 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6004014830 con 0x7f600c14fb20 2023-10-06T03:00:06.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.963+0000 7f6008ff9700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5ff0060550 0x7f5ff0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.963+0000 7f6008ff9700 1 -- 172.21.15.27:0/4195901859 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f600407d3e0 con 0x7f600c14fb20 2023-10-06T03:00:06.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.963+0000 7f6010c54700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5ff0060550 0x7f5ff0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.963+0000 7f6010c54700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5ff0060550 0x7f5ff0062a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6000007160 tx=0x7f6000007f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:06.971+0000 7f6008ff9700 1 -- 172.21.15.27:0/4195901859 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6004051300 con 0x7f600c14fb20 2023-10-06T03:00:07.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.171+0000 7f6012eb8700 1 -- 172.21.15.27:0/4195901859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f600c04be40 con 0x7f600c14fb20 2023-10-06T03:00:07.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.171+0000 7f6008ff9700 1 -- 172.21.15.27:0/4195901859 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6004050e90 con 0x7f600c14fb20 2023-10-06T03:00:07.178 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:00:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.175+0000 7f6012eb8700 1 -- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5ff0060550 msgr2=0x7f5ff0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.175+0000 7f6012eb8700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5ff0060550 0x7f5ff0062a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6000007160 tx=0x7f6000007f50 comp rx=0 tx=0).stop 2023-10-06T03:00:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.175+0000 7f6012eb8700 1 -- 172.21.15.27:0/4195901859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f600c14fb20 msgr2=0x7f600c15c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.175+0000 7f6012eb8700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f600c14fb20 0x7f600c15c660 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6004009e90 tx=0x7f600400b040 comp rx=0 tx=0).stop 2023-10-06T03:00:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.175+0000 7f6012eb8700 1 -- 172.21.15.27:0/4195901859 shutdown_connections 2023-10-06T03:00:07.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.175+0000 7f6012eb8700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5ff0060550 0x7f5ff0062a00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.175+0000 7f6012eb8700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f600c14fb20 0x7f600c15c660 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.175+0000 7f6012eb8700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f600c14f6c0 0x7f600c15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.175+0000 7f6012eb8700 1 --2- 172.21.15.27:0/4195901859 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f600c06cb40 0x7f600c14d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.175+0000 7f6012eb8700 1 -- 172.21.15.27:0/4195901859 >> 172.21.15.27:0/4195901859 conn(0x7f600c0bf620 msgr2=0x7f600c1507f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.175+0000 7f6012eb8700 1 -- 172.21.15.27:0/4195901859 shutdown_connections 2023-10-06T03:00:07.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:07.175+0000 7f6012eb8700 1 -- 172.21.15.27:0/4195901859 wait complete. 2023-10-06T03:00:07.192 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:00:07.193 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:00:07.193 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi124.front.sepia.ceph.com 2023-10-06T03:00:07.193 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:00:07.193 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:07.193 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:00:07.193 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:00:07.193 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:00:07.193 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:00:07.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:07.194 DEBUG:teuthology.orchestra.run.smithi124:> ip addr 2023-10-06T03:00:07.201 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:00:07.201 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:00:07.201 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:00:07.201 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:07.202 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2023-10-06T03:00:07.202 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:07.202 INFO:teuthology.orchestra.run.smithi124.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:00:07.202 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a6 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:07.202 INFO:teuthology.orchestra.run.smithi124.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:00:07.202 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:07.202 INFO:teuthology.orchestra.run.smithi124.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:00:07.202 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c4 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:07.202 INFO:teuthology.orchestra.run.smithi124.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:00:07.202 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c5 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:07.202 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.21.15.124/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-06T03:00:07.202 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft 42529sec preferred_lft 42529sec 2023-10-06T03:00:07.203 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::ec4:7aff:fe8f:d5c5/64 scope link 2023-10-06T03:00:07.203 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:07.203 INFO:teuthology.orchestra.run.smithi124.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T03:00:07.203 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 02:42:89:5d:df:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:07.203 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T03:00:07.203 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:07.203 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:00:07.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:07.204 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T03:00:07.204 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T03:00:07.204 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:00:07.204 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip addr flush dev ceph-brx 2023-10-06T03:00:07.204 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set ceph-brx up 2023-10-06T03:00:07.204 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:00:07.204 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T03:00:07.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:07.290 DEBUG:teuthology.orchestra.run.smithi124:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:00:07.301 INFO:teuthology.orchestra.run.smithi124.stdout:1 2023-10-06T03:00:07.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:07.304 DEBUG:teuthology.orchestra.run.smithi124:> route 2023-10-06T03:00:07.335 INFO:teuthology.orchestra.run.smithi124.stdout:Kernel IP routing table 2023-10-06T03:00:07.336 INFO:teuthology.orchestra.run.smithi124.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:00:07.336 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-06T03:00:07.336 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:00:07.336 INFO:teuthology.orchestra.run.smithi124.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T03:00:07.336 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-06T03:00:07.337 INFO:teuthology.orchestra.run.smithi124.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-06T03:00:07.337 INFO:teuthology.orchestra.run.smithi124.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:00:07.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:07.337 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T03:00:07.338 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T03:00:07.338 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:00:07.338 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:00:07.338 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:00:07.338 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T03:00:07.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:07.421 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-06T03:00:07.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:07.427 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list-id 2023-10-06T03:00:07.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:07.433 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T03:00:07.433 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T03:00:07.433 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:00:07.433 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T03:00:07.434 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T03:00:07.504 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T03:00:07.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:07.505 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T03:00:07.505 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T03:00:07.505 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T03:00:07.505 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:00:07.505 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T03:00:07.505 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T03:00:07.505 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T03:00:07.505 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T03:00:07.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:07.577 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-06T03:00:07.577 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-06T03:00:07.577 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set brx.0 up 2023-10-06T03:00:07.577 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:00:07.577 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-06T03:00:07.601 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T03:00:07.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:00:07.601 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:07.606 INFO:teuthology.orchestra.run.smithi124.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:00:07.607 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:00:07.607 DEBUG:teuthology.orchestra.run.smithi124:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:07.611 DEBUG:teuthology.orchestra.run.smithi124:> sudo modprobe fuse 2023-10-06T03:00:07.674 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:00:07.674 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:00:07.683 INFO:teuthology.orchestra.run.smithi124.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:00:07.684 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:00:07.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:07.685 DEBUG:teuthology.orchestra.run.smithi124:> ls /sys/fs/fuse/connections 2023-10-06T03:00:07.690 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:00:07.690 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T03:00:07.692 DEBUG:teuthology.orchestra.run.smithi124:> sudo modprobe fuse 2023-10-06T03:00:07.709 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:00:07.709 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:00:07.766 INFO:teuthology.orchestra.run.smithi124.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:00:07.766 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:00:07.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:07.767 DEBUG:teuthology.orchestra.run.smithi124:> ls /sys/fs/fuse/connections 2023-10-06T03:00:07.798 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi124.stderr:2023-10-06T03:00:07.792+0000 7fc817cc6380 -1 init, newargv = 0x55a7617b5a50 newargc=15 2023-10-06T03:00:07.798 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi124.stderr:ceph-fuse[28627]: starting ceph client 2023-10-06T03:00:07.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi124.stderr:ceph-fuse[28627]: starting fuse 2023-10-06T03:00:08.875 DEBUG:teuthology.orchestra.run.smithi124:> sudo modprobe fuse 2023-10-06T03:00:08.894 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:00:08.894 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:00:08.950 INFO:teuthology.orchestra.run.smithi124.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:00:08.951 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:00:08.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:08.952 DEBUG:teuthology.orchestra.run.smithi124:> ls /sys/fs/fuse/connections 2023-10-06T03:00:08.959 INFO:teuthology.orchestra.run.smithi124.stdout:52 2023-10-06T03:00:08.959 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T03:00:08.960 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:00:08.960 DEBUG:teuthology.orchestra.run.smithi124:> import glob 2023-10-06T03:00:08.960 DEBUG:teuthology.orchestra.run.smithi124:> import re 2023-10-06T03:00:08.960 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-06T03:00:08.960 DEBUG:teuthology.orchestra.run.smithi124:> import subprocess 2023-10-06T03:00:08.960 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T03:00:08.960 DEBUG:teuthology.orchestra.run.smithi124:> def _find_admin_socket(client_name): 2023-10-06T03:00:08.960 DEBUG:teuthology.orchestra.run.smithi124:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T03:00:08.960 DEBUG:teuthology.orchestra.run.smithi124:> files = glob.glob(asok_path) 2023-10-06T03:00:08.961 DEBUG:teuthology.orchestra.run.smithi124:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T03:00:08.961 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T03:00:08.961 DEBUG:teuthology.orchestra.run.smithi124:> # Given a non-glob path, it better be there 2023-10-06T03:00:08.961 DEBUG:teuthology.orchestra.run.smithi124:> if "*" not in asok_path: 2023-10-06T03:00:08.961 DEBUG:teuthology.orchestra.run.smithi124:> assert(len(files) == 1) 2023-10-06T03:00:08.961 DEBUG:teuthology.orchestra.run.smithi124:> return files[0] 2023-10-06T03:00:08.961 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T03:00:08.961 DEBUG:teuthology.orchestra.run.smithi124:> for f in files: 2023-10-06T03:00:08.961 DEBUG:teuthology.orchestra.run.smithi124:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:00:08.961 DEBUG:teuthology.orchestra.run.smithi124:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:00:08.961 DEBUG:teuthology.orchestra.run.smithi124:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:00:08.961 DEBUG:teuthology.orchestra.run.smithi124:> contents = proc_f.read() 2023-10-06T03:00:08.961 DEBUG:teuthology.orchestra.run.smithi124:> if mountpoint in contents: 2023-10-06T03:00:08.962 DEBUG:teuthology.orchestra.run.smithi124:> return f 2023-10-06T03:00:08.962 DEBUG:teuthology.orchestra.run.smithi124:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:00:08.962 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-06T03:00:08.962 DEBUG:teuthology.orchestra.run.smithi124:> print(_find_admin_socket("client.0")) 2023-10-06T03:00:08.962 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-06T03:00:09.044 INFO:teuthology.orchestra.run.smithi124.stdout:/var/run/ceph/ceph-client.0.28627.asok 2023-10-06T03:00:09.229 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.28627.asok 2023-10-06T03:00:09.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:09.230 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.28627.asok status 2023-10-06T03:00:09.366 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-06T03:00:09.366 INFO:teuthology.orchestra.run.smithi124.stdout: "metadata": { 2023-10-06T03:00:09.366 INFO:teuthology.orchestra.run.smithi124.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:00:09.367 INFO:teuthology.orchestra.run.smithi124.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:00:09.367 INFO:teuthology.orchestra.run.smithi124.stdout: "entity_id": "0", 2023-10-06T03:00:09.367 INFO:teuthology.orchestra.run.smithi124.stdout: "hostname": "smithi124", 2023-10-06T03:00:09.367 INFO:teuthology.orchestra.run.smithi124.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T03:00:09.367 INFO:teuthology.orchestra.run.smithi124.stdout: "pid": "28627", 2023-10-06T03:00:09.367 INFO:teuthology.orchestra.run.smithi124.stdout: "root": "/" 2023-10-06T03:00:09.367 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T03:00:09.367 INFO:teuthology.orchestra.run.smithi124.stdout: "dentry_count": 0, 2023-10-06T03:00:09.367 INFO:teuthology.orchestra.run.smithi124.stdout: "dentry_pinned_count": 0, 2023-10-06T03:00:09.367 INFO:teuthology.orchestra.run.smithi124.stdout: "id": 4708, 2023-10-06T03:00:09.367 INFO:teuthology.orchestra.run.smithi124.stdout: "inst": { 2023-10-06T03:00:09.368 INFO:teuthology.orchestra.run.smithi124.stdout: "name": { 2023-10-06T03:00:09.368 INFO:teuthology.orchestra.run.smithi124.stdout: "type": "client", 2023-10-06T03:00:09.368 INFO:teuthology.orchestra.run.smithi124.stdout: "num": 4708 2023-10-06T03:00:09.368 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T03:00:09.368 INFO:teuthology.orchestra.run.smithi124.stdout: "addr": { 2023-10-06T03:00:09.368 INFO:teuthology.orchestra.run.smithi124.stdout: "type": "v1", 2023-10-06T03:00:09.368 INFO:teuthology.orchestra.run.smithi124.stdout: "addr": "172.21.15.124:0", 2023-10-06T03:00:09.368 INFO:teuthology.orchestra.run.smithi124.stdout: "nonce": 445957310 2023-10-06T03:00:09.368 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-06T03:00:09.368 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T03:00:09.368 INFO:teuthology.orchestra.run.smithi124.stdout: "addr": { 2023-10-06T03:00:09.368 INFO:teuthology.orchestra.run.smithi124.stdout: "type": "v1", 2023-10-06T03:00:09.369 INFO:teuthology.orchestra.run.smithi124.stdout: "addr": "172.21.15.124:0", 2023-10-06T03:00:09.369 INFO:teuthology.orchestra.run.smithi124.stdout: "nonce": 445957310 2023-10-06T03:00:09.369 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-06T03:00:09.369 INFO:teuthology.orchestra.run.smithi124.stdout: "inst_str": "client.4708 172.21.15.124:0/445957310", 2023-10-06T03:00:09.369 INFO:teuthology.orchestra.run.smithi124.stdout: "addr_str": "172.21.15.124:0/445957310", 2023-10-06T03:00:09.369 INFO:teuthology.orchestra.run.smithi124.stdout: "inode_count": 1, 2023-10-06T03:00:09.369 INFO:teuthology.orchestra.run.smithi124.stdout: "mds_epoch": 6, 2023-10-06T03:00:09.369 INFO:teuthology.orchestra.run.smithi124.stdout: "osd_epoch": 24, 2023-10-06T03:00:09.369 INFO:teuthology.orchestra.run.smithi124.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:00:09.369 INFO:teuthology.orchestra.run.smithi124.stdout: "blocklisted": false, 2023-10-06T03:00:09.369 INFO:teuthology.orchestra.run.smithi124.stdout: "fs_name": "cephfs" 2023-10-06T03:00:09.369 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-06T03:00:09.376 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:00:09.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.483+0000 7f4b7d106700 1 Processor -- start 2023-10-06T03:00:09.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.483+0000 7f4b7d106700 1 -- start start 2023-10-06T03:00:09.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b7d106700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4b7806cbb0 0x7f4b7814f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:09.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b7d106700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b780a2310 con 0x7f4b780b5520 2023-10-06T03:00:09.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b7d106700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b780a2680 con 0x7f4b780be150 2023-10-06T03:00:09.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b7d106700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7806cfd0 con 0x7f4b7806cbb0 2023-10-06T03:00:09.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b777fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4b780b5520 0x7f4b7814eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44056/0 (socket says 172.21.15.27:44056) 2023-10-06T03:00:09.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b777fe700 1 -- 172.21.15.27:0/710197226 learned_addr learned my addr 172.21.15.27:0/710197226 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:09.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b7c905700 1 --2- 172.21.15.27:0/710197226 >> v2:172.21.15.123:3300/0 conn(0x7f4b7806cbb0 0x7f4b7814f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:09.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b76ffd700 1 -- 172.21.15.27:0/710197226 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340404319 0 0) 0x7f4b780a2310 con 0x7f4b780b5520 2023-10-06T03:00:09.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b76ffd700 1 -- 172.21.15.27:0/710197226 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b60003570 con 0x7f4b780b5520 2023-10-06T03:00:09.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b7c905700 1 -- 172.21.15.27:0/710197226 >> v1:172.21.15.123:6789/0 conn(0x7f4b780be150 legacy=0x7f4b780b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:09.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b7c905700 1 -- 172.21.15.27:0/710197226 >> v1:172.21.15.27:6789/0 conn(0x7f4b780b5520 legacy=0x7f4b7814eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:09.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b7c905700 1 -- 172.21.15.27:0/710197226 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b780bd1d0 con 0x7f4b7806cbb0 2023-10-06T03:00:09.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b7c905700 1 --2- 172.21.15.27:0/710197226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b7806cbb0 0x7f4b7814f600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009e60 tx=0x7f4b70009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=386196973c45cb6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:09.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b76ffd700 1 -- 172.21.15.27:0/710197226 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000e070 con 0x7f4b7806cbb0 2023-10-06T03:00:09.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b76ffd700 1 -- 172.21.15.27:0/710197226 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7000bb60 con 0x7f4b7806cbb0 2023-10-06T03:00:09.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b76ffd700 1 -- 172.21.15.27:0/710197226 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70012430 con 0x7f4b7806cbb0 2023-10-06T03:00:09.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b7d106700 1 -- 172.21.15.27:0/710197226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b7806cbb0 msgr2=0x7f4b7814f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:09.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b7d106700 1 --2- 172.21.15.27:0/710197226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b7806cbb0 0x7f4b7814f600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009e60 tx=0x7f4b70009780 comp rx=0 tx=0).stop 2023-10-06T03:00:09.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.487+0000 7f4b7d106700 1 -- 172.21.15.27:0/710197226 shutdown_connections 2023-10-06T03:00:09.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b7d106700 1 --2- 172.21.15.27:0/710197226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b7806cbb0 0x7f4b7814f600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:09.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b7d106700 1 -- 172.21.15.27:0/710197226 >> 172.21.15.27:0/710197226 conn(0x7f4b780bf440 msgr2=0x7f4b7806df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:09.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b7d106700 1 -- 172.21.15.27:0/710197226 shutdown_connections 2023-10-06T03:00:09.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b7d106700 1 -- 172.21.15.27:0/710197226 wait complete. 2023-10-06T03:00:09.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b7d106700 1 Processor -- start 2023-10-06T03:00:09.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b7d106700 1 -- start start 2023-10-06T03:00:09.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b7d106700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4b7806cbb0 0x7f4b7814ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:09.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b7d106700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780b5520 0x7f4b7815b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:09.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b7d106700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b780be150 0x7f4b780a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:09.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b7d106700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7815e8c0 con 0x7f4b780b5520 2023-10-06T03:00:09.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b7d106700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7815b460 con 0x7f4b780be150 2023-10-06T03:00:09.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b7d106700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780a7bd0 con 0x7f4b7806cbb0 2023-10-06T03:00:09.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780b5520 0x7f4b7815b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:09.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780b5520 0x7f4b7815b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43182/0 (socket says 172.21.15.27:43182) 2023-10-06T03:00:09.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b777fe700 1 -- 172.21.15.27:0/4285780831 learned_addr learned my addr 172.21.15.27:0/4285780831 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:09.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b7c905700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b780be150 0x7f4b780a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:09.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.491+0000 7f4b77fff700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4b7806cbb0 0x7f4b7814ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:09.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.495+0000 7f4b777fe700 1 -- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4b7806cbb0 msgr2=0x7f4b7814ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:09.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.495+0000 7f4b777fe700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4b7806cbb0 0x7f4b7814ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.495+0000 7f4b777fe700 1 -- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b780be150 msgr2=0x7f4b780a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.495+0000 7f4b777fe700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b780be150 0x7f4b780a5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.495+0000 7f4b777fe700 1 -- 172.21.15.27:0/4285780831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b70009a20 con 0x7f4b780b5520 2023-10-06T03:00:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.495+0000 7f4b777fe700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780b5520 0x7f4b7815b8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800c7c0 tx=0x7f4b68007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.495+0000 7f4b5ffff700 1 -- 172.21.15.27:0/4285780831 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68005c00 con 0x7f4b780b5520 2023-10-06T03:00:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.495+0000 7f4b5ffff700 1 -- 172.21.15.27:0/4285780831 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b68005d60 con 0x7f4b780b5520 2023-10-06T03:00:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.495+0000 7f4b7d106700 1 -- 172.21.15.27:0/4285780831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7815e5e0 con 0x7f4b780b5520 2023-10-06T03:00:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.495+0000 7f4b5ffff700 1 -- 172.21.15.27:0/4285780831 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68007320 con 0x7f4b780b5520 2023-10-06T03:00:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.495+0000 7f4b7d106700 1 -- 172.21.15.27:0/4285780831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7815be30 con 0x7f4b780b5520 2023-10-06T03:00:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.495+0000 7f4b7d106700 1 -- 172.21.15.27:0/4285780831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7815b5d0 con 0x7f4b780b5520 2023-10-06T03:00:09.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.495+0000 7f4b5ffff700 1 -- 172.21.15.27:0/4285780831 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4b6801b3b0 con 0x7f4b780b5520 2023-10-06T03:00:09.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.499+0000 7f4b5ffff700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4b64060550 0x7f4b64062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:09.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.499+0000 7f4b5ffff700 1 -- 172.21.15.27:0/4285780831 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4b6807bdf0 con 0x7f4b780b5520 2023-10-06T03:00:09.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.499+0000 7f4b77fff700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4b64060550 0x7f4b64062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:09.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.499+0000 7f4b77fff700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4b64060550 0x7f4b64062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0039e0 tx=0x7f4b6c007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:09.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.503+0000 7f4b5ffff700 1 -- 172.21.15.27:0/4285780831 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4b6804c280 con 0x7f4b780b5520 2023-10-06T03:00:09.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.703+0000 7f4b7d106700 1 -- 172.21.15.27:0/4285780831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4b7804be40 con 0x7f4b780b5520 2023-10-06T03:00:09.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.703+0000 7f4b5ffff700 1 -- 172.21.15.27:0/4285780831 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4b68017070 con 0x7f4b780b5520 2023-10-06T03:00:09.709 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:00:09.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.707+0000 7f4b7d106700 1 -- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4b64060550 msgr2=0x7f4b64062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:09.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.707+0000 7f4b7d106700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4b64060550 0x7f4b64062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0039e0 tx=0x7f4b6c007ec0 comp rx=0 tx=0).stop 2023-10-06T03:00:09.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.707+0000 7f4b7d106700 1 -- 172.21.15.27:0/4285780831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780b5520 msgr2=0x7f4b7815b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:09.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.707+0000 7f4b7d106700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780b5520 0x7f4b7815b8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800c7c0 tx=0x7f4b68007dd0 comp rx=0 tx=0).stop 2023-10-06T03:00:09.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.707+0000 7f4b7d106700 1 -- 172.21.15.27:0/4285780831 shutdown_connections 2023-10-06T03:00:09.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.707+0000 7f4b7d106700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4b64060550 0x7f4b64062a00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:09.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.707+0000 7f4b7d106700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b780be150 0x7f4b780a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:09.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.707+0000 7f4b7d106700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780b5520 0x7f4b7815b8f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:09.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.707+0000 7f4b7d106700 1 --2- 172.21.15.27:0/4285780831 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4b7806cbb0 0x7f4b7814ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:09.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.707+0000 7f4b7d106700 1 -- 172.21.15.27:0/4285780831 >> 172.21.15.27:0/4285780831 conn(0x7f4b780bf440 msgr2=0x7f4b7814ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:09.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.707+0000 7f4b7d106700 1 -- 172.21.15.27:0/4285780831 shutdown_connections 2023-10-06T03:00:09.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:09.707+0000 7f4b7d106700 1 -- 172.21.15.27:0/4285780831 wait complete. 2023-10-06T03:00:09.723 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:00:09.723 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:00:09.723 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-06T03:00:09.724 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:00:09.724 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:00:09.724 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:00:09.724 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:00:09.724 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:00:09.724 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:00:09.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:09.725 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-06T03:00:09.732 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:00:09.732 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:00:09.732 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:00:09.733 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:09.733 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-06T03:00:09.733 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:09.733 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:00:09.733 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:09.733 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:00:09.734 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:09.734 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:00:09.734 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:09.734 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:00:09.734 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:09.735 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-06T03:00:09.735 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42540sec preferred_lft 42540sec 2023-10-06T03:00:09.735 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-06T03:00:09.735 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:09.735 INFO:teuthology.orchestra.run.smithi158.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T03:00:09.736 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 02:42:dd:4f:80:b6 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:09.736 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T03:00:09.736 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:09.736 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:00:09.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:09.736 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T03:00:09.737 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T03:00:09.737 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:00:09.737 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip addr flush dev ceph-brx 2023-10-06T03:00:09.737 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set ceph-brx up 2023-10-06T03:00:09.737 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:00:09.737 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T03:00:09.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:09.824 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:00:09.834 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-06T03:00:09.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:09.836 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-06T03:00:09.859 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-06T03:00:09.859 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:00:09.859 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-06T03:00:09.860 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:00:09.860 INFO:teuthology.orchestra.run.smithi158.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T03:00:09.860 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-06T03:00:09.860 INFO:teuthology.orchestra.run.smithi158.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-06T03:00:09.860 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:00:09.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:09.860 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T03:00:09.860 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T03:00:09.860 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:00:09.860 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:00:09.861 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:00:09.861 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T03:00:09.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:09.901 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-06T03:00:09.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:09.950 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list-id 2023-10-06T03:00:09.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:09.957 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T03:00:09.957 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T03:00:09.958 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:00:09.958 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T03:00:09.958 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T03:00:09.986 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T03:00:09.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:09.987 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T03:00:09.987 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T03:00:09.987 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T03:00:09.987 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:00:09.987 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T03:00:09.987 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T03:00:09.987 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T03:00:09.987 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T03:00:10.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:10.061 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-06T03:00:10.062 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-06T03:00:10.062 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-06T03:00:10.062 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:00:10.062 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-06T03:00:10.090 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-06T03:00:10.090 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:00:10.090 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:00:10.138 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:00:10.138 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:00:10.138 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:00:10.143 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2023-10-06T03:00:10.156 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:00:10.157 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:00:10.214 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:00:10.215 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:00:10.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:10.216 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2023-10-06T03:00:10.221 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:00:10.221 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-06T03:00:10.223 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2023-10-06T03:00:10.237 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:00:10.238 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:00:10.246 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:00:10.246 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:00:10.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:10.247 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2023-10-06T03:00:10.316 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:2023-10-06T03:00:10.312+0000 7fc757032380 -1 init, newargv = 0x563558991d10 newargc=15 2023-10-06T03:00:10.316 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[28531]: starting ceph client 2023-10-06T03:00:10.328 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[28531]: starting fuse 2023-10-06T03:00:11.353 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2023-10-06T03:00:11.371 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:00:11.371 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:00:11.381 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:00:11.382 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:00:11.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:11.383 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2023-10-06T03:00:11.429 INFO:teuthology.orchestra.run.smithi158.stdout:52 2023-10-06T03:00:11.430 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T03:00:11.430 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:00:11.430 DEBUG:teuthology.orchestra.run.smithi158:> import glob 2023-10-06T03:00:11.430 DEBUG:teuthology.orchestra.run.smithi158:> import re 2023-10-06T03:00:11.430 DEBUG:teuthology.orchestra.run.smithi158:> import os 2023-10-06T03:00:11.430 DEBUG:teuthology.orchestra.run.smithi158:> import subprocess 2023-10-06T03:00:11.430 DEBUG:teuthology.orchestra.run.smithi158:> 2023-10-06T03:00:11.430 DEBUG:teuthology.orchestra.run.smithi158:> def _find_admin_socket(client_name): 2023-10-06T03:00:11.431 DEBUG:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-06T03:00:11.431 DEBUG:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2023-10-06T03:00:11.431 DEBUG:teuthology.orchestra.run.smithi158:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-06T03:00:11.431 DEBUG:teuthology.orchestra.run.smithi158:> 2023-10-06T03:00:11.431 DEBUG:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2023-10-06T03:00:11.431 DEBUG:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2023-10-06T03:00:11.431 DEBUG:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2023-10-06T03:00:11.431 DEBUG:teuthology.orchestra.run.smithi158:> return files[0] 2023-10-06T03:00:11.431 DEBUG:teuthology.orchestra.run.smithi158:> 2023-10-06T03:00:11.431 DEBUG:teuthology.orchestra.run.smithi158:> for f in files: 2023-10-06T03:00:11.432 DEBUG:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:00:11.432 DEBUG:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:00:11.432 DEBUG:teuthology.orchestra.run.smithi158:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:00:11.432 DEBUG:teuthology.orchestra.run.smithi158:> contents = proc_f.read() 2023-10-06T03:00:11.432 DEBUG:teuthology.orchestra.run.smithi158:> if mountpoint in contents: 2023-10-06T03:00:11.432 DEBUG:teuthology.orchestra.run.smithi158:> return f 2023-10-06T03:00:11.432 DEBUG:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:00:11.432 DEBUG:teuthology.orchestra.run.smithi158:> 2023-10-06T03:00:11.432 DEBUG:teuthology.orchestra.run.smithi158:> print(_find_admin_socket("client.1")) 2023-10-06T03:00:11.432 DEBUG:teuthology.orchestra.run.smithi158:> ' 2023-10-06T03:00:11.514 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.1.28531.asok 2023-10-06T03:00:11.699 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.28531.asok 2023-10-06T03:00:11.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:11.699 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.28531.asok status 2023-10-06T03:00:11.796 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2023-10-06T03:00:11.796 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2023-10-06T03:00:11.796 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:00:11.796 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:00:11.796 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "1", 2023-10-06T03:00:11.796 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2023-10-06T03:00:11.796 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-06T03:00:11.797 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "28531", 2023-10-06T03:00:11.797 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2023-10-06T03:00:11.797 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-06T03:00:11.797 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2023-10-06T03:00:11.797 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2023-10-06T03:00:11.797 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 4726, 2023-10-06T03:00:11.797 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2023-10-06T03:00:11.797 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2023-10-06T03:00:11.797 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2023-10-06T03:00:11.797 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 4726 2023-10-06T03:00:11.797 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-06T03:00:11.797 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2023-10-06T03:00:11.798 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2023-10-06T03:00:11.798 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2023-10-06T03:00:11.798 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 1802353057 2023-10-06T03:00:11.798 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-06T03:00:11.798 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-06T03:00:11.798 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2023-10-06T03:00:11.798 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2023-10-06T03:00:11.798 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2023-10-06T03:00:11.798 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 1802353057 2023-10-06T03:00:11.798 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-06T03:00:11.798 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.4726 172.21.15.158:0/1802353057", 2023-10-06T03:00:11.799 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/1802353057", 2023-10-06T03:00:11.799 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2023-10-06T03:00:11.799 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 6, 2023-10-06T03:00:11.799 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 24, 2023-10-06T03:00:11.799 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:00:11.799 INFO:teuthology.orchestra.run.smithi158.stdout: "blocklisted": false, 2023-10-06T03:00:11.799 INFO:teuthology.orchestra.run.smithi158.stdout: "fs_name": "cephfs" 2023-10-06T03:00:11.799 INFO:teuthology.orchestra.run.smithi158.stdout:} 2023-10-06T03:00:11.805 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:00:11.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.915+0000 7f7ad3fff700 1 Processor -- start 2023-10-06T03:00:11.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.915+0000 7f7ad3fff700 1 -- start start 2023-10-06T03:00:11.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad3fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad40b9c50 0x7f7ad40ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:11.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7ad40bb2c0 0x7f7ad40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:11.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad3fff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad409ef80 con 0x7f7ad406c910 2023-10-06T03:00:11.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad3fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad40a0f20 con 0x7f7ad40bb2c0 2023-10-06T03:00:11.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad3fff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40a2c50 con 0x7f7ad40b9c50 2023-10-06T03:00:11.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad37fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7ad406c910 0x7f7ad409f410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44060/0 (socket says 172.21.15.27:44060) 2023-10-06T03:00:11.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad37fe700 1 -- 172.21.15.27:0/1812529891 learned_addr learned my addr 172.21.15.27:0/1812529891 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:00:11.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad2ffd700 1 --2- 172.21.15.27:0/1812529891 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad40b9c50 0x7f7ad40ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:11.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad27fc700 1 --2- 172.21.15.27:0/1812529891 >> v2:172.21.15.123:3300/0 conn(0x7f7ad40bb2c0 0x7f7ad40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:11.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad1ffb700 1 -- 172.21.15.27:0/1812529891 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092609190 0 0) 0x7f7ad409ef80 con 0x7f7ad406c910 2023-10-06T03:00:11.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad1ffb700 1 -- 172.21.15.27:0/1812529891 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7abc003570 con 0x7f7ad406c910 2023-10-06T03:00:11.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad27fc700 1 -- 172.21.15.27:0/1812529891 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad40b9c50 msgr2=0x7f7ad40ba020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:11.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad27fc700 1 --2- 172.21.15.27:0/1812529891 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad40b9c50 0x7f7ad40ba020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:11.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad27fc700 1 -- 172.21.15.27:0/1812529891 >> v1:172.21.15.27:6789/0 conn(0x7f7ad406c910 legacy=0x7f7ad409f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:11.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad1ffb700 1 -- 172.21.15.27:0/1812529891 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3818816558 0 0) 0x7f7abc003570 con 0x7f7ad406c910 2023-10-06T03:00:11.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad27fc700 1 -- 172.21.15.27:0/1812529891 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad40a2f30 con 0x7f7ad40bb2c0 2023-10-06T03:00:11.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad2ffd700 1 --2- 172.21.15.27:0/1812529891 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad40b9c50 0x7f7ad40ba020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:11.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad27fc700 1 --2- 172.21.15.27:0/1812529891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad40bb2c0 0x7f7ad40a3550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009e60 tx=0x7f7acc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38c1704b6463a17 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:11.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad1ffb700 1 -- 172.21.15.27:0/1812529891 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00e070 con 0x7f7ad40bb2c0 2023-10-06T03:00:11.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad1ffb700 1 -- 172.21.15.27:0/1812529891 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc00b7a0 con 0x7f7ad40bb2c0 2023-10-06T03:00:11.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad1ffb700 1 -- 172.21.15.27:0/1812529891 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4001470 con 0x7f7ad40bb2c0 2023-10-06T03:00:11.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad3fff700 1 -- 172.21.15.27:0/1812529891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad40bb2c0 msgr2=0x7f7ad40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:11.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad3fff700 1 --2- 172.21.15.27:0/1812529891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad40bb2c0 0x7f7ad40a3550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009e60 tx=0x7f7acc009780 comp rx=0 tx=0).stop 2023-10-06T03:00:11.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad3fff700 1 -- 172.21.15.27:0/1812529891 shutdown_connections 2023-10-06T03:00:11.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad3fff700 1 --2- 172.21.15.27:0/1812529891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad40bb2c0 0x7f7ad40a3550 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:11.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad3fff700 1 --2- 172.21.15.27:0/1812529891 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad40b9c50 0x7f7ad40ba020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:11.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad3fff700 1 -- 172.21.15.27:0/1812529891 >> 172.21.15.27:0/1812529891 conn(0x7f7ad406eb10 msgr2=0x7f7ad40ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:11.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad3fff700 1 -- 172.21.15.27:0/1812529891 shutdown_connections 2023-10-06T03:00:11.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.919+0000 7f7ad3fff700 1 -- 172.21.15.27:0/1812529891 wait complete. 2023-10-06T03:00:11.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad3fff700 1 Processor -- start 2023-10-06T03:00:11.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad3fff700 1 -- start start 2023-10-06T03:00:11.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad406c910 0x7f7ad4151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:11.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ad40b9c50 0x7f7ad4162660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:11.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad3fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad40bb2c0 0x7f7ad4069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:11.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad3fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad4151940 con 0x7f7ad40b9c50 2023-10-06T03:00:11.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad3fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad415f940 con 0x7f7ad406c910 2023-10-06T03:00:11.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad3fff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad4162f60 con 0x7f7ad40bb2c0 2023-10-06T03:00:11.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ad40b9c50 0x7f7ad4162660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:11.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ad40b9c50 0x7f7ad4162660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43192/0 (socket says 172.21.15.27:43192) 2023-10-06T03:00:11.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad27fc700 1 -- 172.21.15.27:0/2484098475 learned_addr learned my addr 172.21.15.27:0/2484098475 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:00:11.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad2ffd700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad406c910 0x7f7ad4151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:11.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad37fe700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad40bb2c0 0x7f7ad4069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:11.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad27fc700 1 -- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad40bb2c0 msgr2=0x7f7ad4069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:11.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad27fc700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad40bb2c0 0x7f7ad4069520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:11.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad27fc700 1 -- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad406c910 msgr2=0x7f7ad4151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:11.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad27fc700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad406c910 0x7f7ad4151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:11.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad27fc700 1 -- 172.21.15.27:0/2484098475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8009420 con 0x7f7ad40b9c50 2023-10-06T03:00:11.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad27fc700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ad40b9c50 0x7f7ad4162660 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40705f0 tx=0x7f7acc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:11.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7abaffd700 1 -- 172.21.15.27:0/2484098475 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc012990 con 0x7f7ad40b9c50 2023-10-06T03:00:11.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7abaffd700 1 -- 172.21.15.27:0/2484098475 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc012b30 con 0x7f7ad40b9c50 2023-10-06T03:00:11.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad3fff700 1 -- 172.21.15.27:0/2484098475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7acc009a20 con 0x7f7ad40b9c50 2023-10-06T03:00:11.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7abaffd700 1 -- 172.21.15.27:0/2484098475 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc027470 con 0x7f7ad40b9c50 2023-10-06T03:00:11.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.923+0000 7f7ad3fff700 1 -- 172.21.15.27:0/2484098475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad4162ba0 con 0x7f7ad40b9c50 2023-10-06T03:00:11.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.927+0000 7f7ad3fff700 1 -- 172.21.15.27:0/2484098475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad40674b0 con 0x7f7ad40b9c50 2023-10-06T03:00:11.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.927+0000 7f7abaffd700 1 -- 172.21.15.27:0/2484098475 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7acc024070 con 0x7f7ad40b9c50 2023-10-06T03:00:11.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.927+0000 7f7abaffd700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7ac0060550 0x7f7ac0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:11.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.927+0000 7f7abaffd700 1 -- 172.21.15.27:0/2484098475 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7acc07ed00 con 0x7f7ad40b9c50 2023-10-06T03:00:11.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.927+0000 7f7ad2ffd700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7ac0060550 0x7f7ac0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:11.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.927+0000 7f7ad2ffd700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7ac0060550 0x7f7ac0062a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009f40 tx=0x7f7ac80091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:11.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:11.935+0000 7f7abaffd700 1 -- 172.21.15.27:0/2484098475 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7acc04f0f0 con 0x7f7ad40b9c50 2023-10-06T03:00:12.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.134+0000 7f7ad3fff700 1 -- 172.21.15.27:0/2484098475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7ad404b600 con 0x7f7ad40b9c50 2023-10-06T03:00:12.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.134+0000 7f7abaffd700 1 -- 172.21.15.27:0/2484098475 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7acc052710 con 0x7f7ad40b9c50 2023-10-06T03:00:12.142 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:00:12.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.138+0000 7f7ad3fff700 1 -- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7ac0060550 msgr2=0x7f7ac0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.138+0000 7f7ad3fff700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7ac0060550 0x7f7ac0062a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009f40 tx=0x7f7ac80091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.138+0000 7f7ad3fff700 1 -- 172.21.15.27:0/2484098475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ad40b9c50 msgr2=0x7f7ad4162660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.138+0000 7f7ad3fff700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ad40b9c50 0x7f7ad4162660 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40705f0 tx=0x7f7acc018000 comp rx=0 tx=0).stop 2023-10-06T03:00:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.138+0000 7f7ad3fff700 1 -- 172.21.15.27:0/2484098475 shutdown_connections 2023-10-06T03:00:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.138+0000 7f7ad3fff700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7ac0060550 0x7f7ac0062a00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.138+0000 7f7ad3fff700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad40bb2c0 0x7f7ad4069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.138+0000 7f7ad3fff700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ad40b9c50 0x7f7ad4162660 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.138+0000 7f7ad3fff700 1 --2- 172.21.15.27:0/2484098475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad406c910 0x7f7ad4151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.138+0000 7f7ad3fff700 1 -- 172.21.15.27:0/2484098475 >> 172.21.15.27:0/2484098475 conn(0x7f7ad406eb10 msgr2=0x7f7ad409de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.138+0000 7f7ad3fff700 1 -- 172.21.15.27:0/2484098475 shutdown_connections 2023-10-06T03:00:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:00:12.138+0000 7f7ad3fff700 1 -- 172.21.15.27:0/2484098475 wait complete. 2023-10-06T03:00:12.156 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:00:12.156 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:00:12.156 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2023-10-06T03:00:12.157 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T03:00:12.157 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T03:00:12.157 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:00:12.157 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:00:12.157 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:00:12.157 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T03:00:12.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:12.157 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2023-10-06T03:00:12.165 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:00:12.165 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:00:12.165 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:00:12.165 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:12.165 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2023-10-06T03:00:12.166 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:12.166 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:00:12.166 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:12.166 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:00:12.166 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:12.166 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:00:12.166 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:12.166 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:00:12.166 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:12.167 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-06T03:00:12.167 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42525sec preferred_lft 42525sec 2023-10-06T03:00:12.167 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2023-10-06T03:00:12.167 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:12.167 INFO:teuthology.orchestra.run.smithi174.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T03:00:12.167 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 02:42:37:6d:82:29 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:12.167 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T03:00:12.167 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:12.167 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:00:12.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:12.168 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-10-06T03:00:12.168 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-10-06T03:00:12.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:00:12.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr flush dev ceph-brx 2023-10-06T03:00:12.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set ceph-brx up 2023-10-06T03:00:12.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:00:12.168 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-10-06T03:00:12.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:12.259 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:00:12.270 INFO:teuthology.orchestra.run.smithi174.stdout:1 2023-10-06T03:00:12.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:12.271 DEBUG:teuthology.orchestra.run.smithi174:> route 2023-10-06T03:00:12.298 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2023-10-06T03:00:12.298 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:00:12.298 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-06T03:00:12.298 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:00:12.298 INFO:teuthology.orchestra.run.smithi174.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T03:00:12.299 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-06T03:00:12.299 INFO:teuthology.orchestra.run.smithi174.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-06T03:00:12.299 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:00:12.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:12.299 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-10-06T03:00:12.299 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-10-06T03:00:12.299 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:00:12.300 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:00:12.300 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:00:12.300 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-10-06T03:00:12.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:12.341 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2023-10-06T03:00:12.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:12.347 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list-id 2023-10-06T03:00:12.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:12.395 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-10-06T03:00:12.396 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-10-06T03:00:12.396 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:00:12.396 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 0 2023-10-06T03:00:12.396 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-10-06T03:00:12.425 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.1/16 2023-10-06T03:00:12.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:12.425 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-10-06T03:00:12.425 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-10-06T03:00:12.425 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.0 2023-10-06T03:00:12.425 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:00:12.425 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T03:00:12.425 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T03:00:12.425 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T03:00:12.425 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-10-06T03:00:12.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:12.497 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-10-06T03:00:12.497 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-10-06T03:00:12.497 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2023-10-06T03:00:12.497 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:00:12.497 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-10-06T03:00:12.523 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-06T03:00:12.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:00:12.523 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T03:00:12.527 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T03:00:12.527 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:00:12.527 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T03:00:12.531 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2023-10-06T03:00:12.547 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:00:12.547 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:00:12.557 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:00:12.558 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:00:12.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:12.559 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2023-10-06T03:00:12.564 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:00:12.564 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-06T03:00:12.566 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2023-10-06T03:00:12.583 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:00:12.583 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:00:12.641 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:00:12.641 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:00:12.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:12.642 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2023-10-06T03:00:12.658 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi174.stderr:2023-10-06T03:00:12.654+0000 7fc4db8e7380 -1 init, newargv = 0x56161d702150 newargc=15 2023-10-06T03:00:12.658 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi174.stderr:ceph-fuse[28580]: starting ceph client 2023-10-06T03:00:12.668 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi174.stderr:ceph-fuse[28580]: starting fuse 2023-10-06T03:00:13.749 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2023-10-06T03:00:13.767 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:00:13.768 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:00:13.779 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:00:13.780 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:00:13.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:13.781 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2023-10-06T03:00:13.831 INFO:teuthology.orchestra.run.smithi174.stdout:52 2023-10-06T03:00:13.832 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T03:00:13.832 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:00:13.832 DEBUG:teuthology.orchestra.run.smithi174:> import glob 2023-10-06T03:00:13.832 DEBUG:teuthology.orchestra.run.smithi174:> import re 2023-10-06T03:00:13.832 DEBUG:teuthology.orchestra.run.smithi174:> import os 2023-10-06T03:00:13.832 DEBUG:teuthology.orchestra.run.smithi174:> import subprocess 2023-10-06T03:00:13.832 DEBUG:teuthology.orchestra.run.smithi174:> 2023-10-06T03:00:13.833 DEBUG:teuthology.orchestra.run.smithi174:> def _find_admin_socket(client_name): 2023-10-06T03:00:13.833 DEBUG:teuthology.orchestra.run.smithi174:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-06T03:00:13.833 DEBUG:teuthology.orchestra.run.smithi174:> files = glob.glob(asok_path) 2023-10-06T03:00:13.833 DEBUG:teuthology.orchestra.run.smithi174:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-06T03:00:13.833 DEBUG:teuthology.orchestra.run.smithi174:> 2023-10-06T03:00:13.833 DEBUG:teuthology.orchestra.run.smithi174:> # Given a non-glob path, it better be there 2023-10-06T03:00:13.833 DEBUG:teuthology.orchestra.run.smithi174:> if "*" not in asok_path: 2023-10-06T03:00:13.833 DEBUG:teuthology.orchestra.run.smithi174:> assert(len(files) == 1) 2023-10-06T03:00:13.833 DEBUG:teuthology.orchestra.run.smithi174:> return files[0] 2023-10-06T03:00:13.833 DEBUG:teuthology.orchestra.run.smithi174:> 2023-10-06T03:00:13.833 DEBUG:teuthology.orchestra.run.smithi174:> for f in files: 2023-10-06T03:00:13.833 DEBUG:teuthology.orchestra.run.smithi174:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:00:13.833 DEBUG:teuthology.orchestra.run.smithi174:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:00:13.834 DEBUG:teuthology.orchestra.run.smithi174:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:00:13.834 DEBUG:teuthology.orchestra.run.smithi174:> contents = proc_f.read() 2023-10-06T03:00:13.834 DEBUG:teuthology.orchestra.run.smithi174:> if mountpoint in contents: 2023-10-06T03:00:13.834 DEBUG:teuthology.orchestra.run.smithi174:> return f 2023-10-06T03:00:13.834 DEBUG:teuthology.orchestra.run.smithi174:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:00:13.834 DEBUG:teuthology.orchestra.run.smithi174:> 2023-10-06T03:00:13.834 DEBUG:teuthology.orchestra.run.smithi174:> print(_find_admin_socket("client.2")) 2023-10-06T03:00:13.834 DEBUG:teuthology.orchestra.run.smithi174:> ' 2023-10-06T03:00:13.917 INFO:teuthology.orchestra.run.smithi174.stdout:/var/run/ceph/ceph-client.2.28580.asok 2023-10-06T03:00:14.101 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.28580.asok 2023-10-06T03:00:14.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:14.102 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.28580.asok status 2023-10-06T03:00:14.195 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2023-10-06T03:00:14.195 INFO:teuthology.orchestra.run.smithi174.stdout: "metadata": { 2023-10-06T03:00:14.195 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:00:14.195 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:00:14.195 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "2", 2023-10-06T03:00:14.195 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi174", 2023-10-06T03:00:14.196 INFO:teuthology.orchestra.run.smithi174.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-06T03:00:14.196 INFO:teuthology.orchestra.run.smithi174.stdout: "pid": "28580", 2023-10-06T03:00:14.196 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2023-10-06T03:00:14.196 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2023-10-06T03:00:14.196 INFO:teuthology.orchestra.run.smithi174.stdout: "dentry_count": 0, 2023-10-06T03:00:14.196 INFO:teuthology.orchestra.run.smithi174.stdout: "dentry_pinned_count": 0, 2023-10-06T03:00:14.196 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4741, 2023-10-06T03:00:14.196 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": { 2023-10-06T03:00:14.197 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2023-10-06T03:00:14.197 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2023-10-06T03:00:14.197 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 4741 2023-10-06T03:00:14.197 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2023-10-06T03:00:14.197 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2023-10-06T03:00:14.197 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2023-10-06T03:00:14.197 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.174:0", 2023-10-06T03:00:14.197 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 3646752205 2023-10-06T03:00:14.197 INFO:teuthology.orchestra.run.smithi174.stdout: } 2023-10-06T03:00:14.197 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2023-10-06T03:00:14.197 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2023-10-06T03:00:14.198 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2023-10-06T03:00:14.198 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.174:0", 2023-10-06T03:00:14.198 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 3646752205 2023-10-06T03:00:14.198 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2023-10-06T03:00:14.198 INFO:teuthology.orchestra.run.smithi174.stdout: "inst_str": "client.4741 172.21.15.174:0/3646752205", 2023-10-06T03:00:14.198 INFO:teuthology.orchestra.run.smithi174.stdout: "addr_str": "172.21.15.174:0/3646752205", 2023-10-06T03:00:14.198 INFO:teuthology.orchestra.run.smithi174.stdout: "inode_count": 1, 2023-10-06T03:00:14.198 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_epoch": 6, 2023-10-06T03:00:14.198 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_epoch": 24, 2023-10-06T03:00:14.198 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:00:14.199 INFO:teuthology.orchestra.run.smithi174.stdout: "blocklisted": false, 2023-10-06T03:00:14.199 INFO:teuthology.orchestra.run.smithi174.stdout: "fs_name": "cephfs" 2023-10-06T03:00:14.199 INFO:teuthology.orchestra.run.smithi174.stdout:} 2023-10-06T03:00:14.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:14.204 DEBUG:teuthology.orchestra.run.smithi124:> stat --file-system '--printf=%T 2023-10-06T03:00:14.204 DEBUG:teuthology.orchestra.run.smithi124:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:14.213 INFO:teuthology.orchestra.run.smithi124.stdout:fuseblk 2023-10-06T03:00:14.213 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:14.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:14.213 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:14.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:14.274 DEBUG:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2023-10-06T03:00:14.274 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-06T03:00:14.282 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2023-10-06T03:00:14.283 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-06T03:00:14.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:14.283 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:00:14.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:14.301 DEBUG:teuthology.orchestra.run.smithi174:> stat --file-system '--printf=%T 2023-10-06T03:00:14.301 DEBUG:teuthology.orchestra.run.smithi174:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-06T03:00:14.309 INFO:teuthology.orchestra.run.smithi174.stdout:fuseblk 2023-10-06T03:00:14.309 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-06T03:00:14.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:14.309 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T03:00:14.323 INFO:teuthology.run_tasks:Running task pexec... 2023-10-06T03:00:14.333 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-06T03:00:14.333 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T03:00:14.333 DEBUG:teuthology.orchestra.run.smithi124:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-06T03:00:14.334 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T03:00:14.334 DEBUG:teuthology.orchestra.run.smithi158:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-06T03:00:14.334 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi174.front.sepia.ceph.com 2023-10-06T03:00:14.334 DEBUG:teuthology.orchestra.run.smithi174:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-06T03:00:14.370 INFO:teuthology.orchestra.run.smithi158.stderr:--2023-10-06 03:00:14-- http://download.ceph.com/qa/mdtest-1.9.3.tgz 2023-10-06T03:00:14.372 INFO:teuthology.orchestra.run.smithi158.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-10-06T03:00:14.411 INFO:teuthology.orchestra.run.smithi124.stderr:--2023-10-06 03:00:14-- http://download.ceph.com/qa/mdtest-1.9.3.tgz 2023-10-06T03:00:14.412 INFO:teuthology.orchestra.run.smithi124.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-10-06T03:00:14.414 INFO:teuthology.orchestra.run.smithi174.stderr:--2023-10-06 03:00:14-- http://download.ceph.com/qa/mdtest-1.9.3.tgz 2023-10-06T03:00:14.416 INFO:teuthology.orchestra.run.smithi174.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-10-06T03:00:14.448 INFO:teuthology.orchestra.run.smithi158.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-10-06T03:00:14.474 INFO:teuthology.orchestra.run.smithi124.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-10-06T03:00:14.491 INFO:teuthology.orchestra.run.smithi174.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-10-06T03:00:14.524 INFO:teuthology.orchestra.run.smithi158.stderr:HTTP request sent, awaiting response... 200 OK 2023-10-06T03:00:14.525 INFO:teuthology.orchestra.run.smithi158.stderr:Length: 36252 (35K) [application/octet-stream] 2023-10-06T03:00:14.525 INFO:teuthology.orchestra.run.smithi158.stderr:Saving to: 'mdtest-1.9.3.tgz' 2023-10-06T03:00:14.525 INFO:teuthology.orchestra.run.smithi158.stderr: 2023-10-06T03:00:14.535 INFO:teuthology.orchestra.run.smithi124.stderr:HTTP request sent, awaiting response... 200 OK 2023-10-06T03:00:14.535 INFO:teuthology.orchestra.run.smithi124.stderr:Length: 36252 (35K) [application/octet-stream] 2023-10-06T03:00:14.535 INFO:teuthology.orchestra.run.smithi124.stderr:Saving to: 'mdtest-1.9.3.tgz' 2023-10-06T03:00:14.535 INFO:teuthology.orchestra.run.smithi124.stderr: 2023-10-06T03:00:14.569 INFO:teuthology.orchestra.run.smithi174.stderr:HTTP request sent, awaiting response... 200 OK 2023-10-06T03:00:14.569 INFO:teuthology.orchestra.run.smithi174.stderr:Length: 36252 (35K) [application/octet-stream] 2023-10-06T03:00:14.569 INFO:teuthology.orchestra.run.smithi174.stderr:Saving to: 'mdtest-1.9.3.tgz' 2023-10-06T03:00:14.569 INFO:teuthology.orchestra.run.smithi174.stderr: 2023-10-06T03:00:14.599 INFO:teuthology.orchestra.run.smithi124.stderr: 0K .......... .......... .......... ..... 100% 551K=0.06s 2023-10-06T03:00:14.599 INFO:teuthology.orchestra.run.smithi124.stderr: 2023-10-06T03:00:14.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-06 03:00:14 (551 KB/s) - 'mdtest-1.9.3.tgz' saved [36252/36252] 2023-10-06T03:00:14.599 INFO:teuthology.orchestra.run.smithi124.stderr: 2023-10-06T03:00:14.603 INFO:teuthology.orchestra.run.smithi158.stderr: 0K .......... .......... .......... ..... 100% 452K=0.08s 2023-10-06T03:00:14.603 INFO:teuthology.orchestra.run.smithi158.stderr: 2023-10-06T03:00:14.603 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-06 03:00:14 (452 KB/s) - 'mdtest-1.9.3.tgz' saved [36252/36252] 2023-10-06T03:00:14.603 INFO:teuthology.orchestra.run.smithi158.stderr: 2023-10-06T03:00:14.608 INFO:teuthology.orchestra.run.smithi124.stdout:COPYRIGHT 2023-10-06T03:00:14.608 INFO:teuthology.orchestra.run.smithi124.stdout:Makefile 2023-10-06T03:00:14.608 INFO:teuthology.orchestra.run.smithi124.stdout:README 2023-10-06T03:00:14.608 INFO:teuthology.orchestra.run.smithi124.stdout:RELEASE_LOG 2023-10-06T03:00:14.608 INFO:teuthology.orchestra.run.smithi124.stdout:mdtest.1 2023-10-06T03:00:14.608 INFO:teuthology.orchestra.run.smithi124.stdout:mdtest.c 2023-10-06T03:00:14.609 INFO:teuthology.orchestra.run.smithi124.stdout:scripts/ 2023-10-06T03:00:14.609 INFO:teuthology.orchestra.run.smithi124.stdout:scripts/env_to_db.tcsh 2023-10-06T03:00:14.610 INFO:teuthology.orchestra.run.smithi124.stdout:scripts/mdtest_wrapper.py 2023-10-06T03:00:14.610 INFO:teuthology.orchestra.run.smithi124.stdout:scripts/paramCatch.py 2023-10-06T03:00:14.610 INFO:teuthology.orchestra.run.smithi124.stdout:scripts/tester.py 2023-10-06T03:00:14.610 INFO:teuthology.orchestra.run.smithi124.stdout:scripts/WRAPPER_README 2023-10-06T03:00:14.611 INFO:teuthology.orchestra.run.smithi158.stdout:COPYRIGHT 2023-10-06T03:00:14.611 INFO:teuthology.orchestra.run.smithi158.stdout:Makefile 2023-10-06T03:00:14.612 INFO:teuthology.orchestra.run.smithi158.stdout:README 2023-10-06T03:00:14.612 INFO:teuthology.orchestra.run.smithi158.stdout:RELEASE_LOG 2023-10-06T03:00:14.612 INFO:teuthology.orchestra.run.smithi158.stdout:mdtest.1 2023-10-06T03:00:14.612 INFO:teuthology.orchestra.run.smithi158.stdout:mdtest.c 2023-10-06T03:00:14.613 INFO:teuthology.orchestra.run.smithi158.stdout:scripts/ 2023-10-06T03:00:14.613 INFO:teuthology.orchestra.run.smithi158.stdout:scripts/env_to_db.tcsh 2023-10-06T03:00:14.613 INFO:teuthology.orchestra.run.smithi158.stdout:scripts/mdtest_wrapper.py 2023-10-06T03:00:14.613 INFO:teuthology.orchestra.run.smithi158.stdout:scripts/paramCatch.py 2023-10-06T03:00:14.613 INFO:teuthology.orchestra.run.smithi158.stdout:scripts/tester.py 2023-10-06T03:00:14.613 INFO:teuthology.orchestra.run.smithi158.stdout:scripts/WRAPPER_README 2023-10-06T03:00:14.631 INFO:teuthology.orchestra.run.smithi124.stdout:mpicc -DLinux -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D__USE_LARGEFILE64=1 -g -o mdtest mdtest.c -lm 2023-10-06T03:00:14.641 INFO:teuthology.orchestra.run.smithi158.stdout:mpicc -DLinux -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D__USE_LARGEFILE64=1 -g -o mdtest mdtest.c -lm 2023-10-06T03:00:14.647 INFO:teuthology.orchestra.run.smithi174.stderr: 0K .......... .......... .......... ..... 100% 450K=0.08s 2023-10-06T03:00:14.648 INFO:teuthology.orchestra.run.smithi174.stderr: 2023-10-06T03:00:14.648 INFO:teuthology.orchestra.run.smithi174.stderr:2023-10-06 03:00:14 (450 KB/s) - 'mdtest-1.9.3.tgz' saved [36252/36252] 2023-10-06T03:00:14.648 INFO:teuthology.orchestra.run.smithi174.stderr: 2023-10-06T03:00:14.656 INFO:teuthology.orchestra.run.smithi174.stdout:COPYRIGHT 2023-10-06T03:00:14.656 INFO:teuthology.orchestra.run.smithi174.stdout:Makefile 2023-10-06T03:00:14.656 INFO:teuthology.orchestra.run.smithi174.stdout:README 2023-10-06T03:00:14.656 INFO:teuthology.orchestra.run.smithi174.stdout:RELEASE_LOG 2023-10-06T03:00:14.656 INFO:teuthology.orchestra.run.smithi174.stdout:mdtest.1 2023-10-06T03:00:14.656 INFO:teuthology.orchestra.run.smithi174.stdout:mdtest.c 2023-10-06T03:00:14.657 INFO:teuthology.orchestra.run.smithi174.stdout:scripts/ 2023-10-06T03:00:14.657 INFO:teuthology.orchestra.run.smithi174.stdout:scripts/env_to_db.tcsh 2023-10-06T03:00:14.657 INFO:teuthology.orchestra.run.smithi174.stdout:scripts/mdtest_wrapper.py 2023-10-06T03:00:14.657 INFO:teuthology.orchestra.run.smithi174.stdout:scripts/paramCatch.py 2023-10-06T03:00:14.657 INFO:teuthology.orchestra.run.smithi174.stdout:scripts/tester.py 2023-10-06T03:00:14.658 INFO:teuthology.orchestra.run.smithi174.stdout:scripts/WRAPPER_README 2023-10-06T03:00:14.671 INFO:teuthology.orchestra.run.smithi174.stdout:mpicc -DLinux -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D__USE_LARGEFILE64=1 -g -o mdtest mdtest.c -lm 2023-10-06T03:00:15.221 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c: In function 'main': 2023-10-06T03:00:15.221 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2492:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-10-06T03:00:15.221 INFO:teuthology.orchestra.run.smithi124.stderr: 2492 | fprintf( stdout, "read_bytes : %llu\n", read_bytes ); 2023-10-06T03:00:15.221 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~^ ~~~~~~~~~~ 2023-10-06T03:00:15.221 INFO:teuthology.orchestra.run.smithi124.stderr: | | | 2023-10-06T03:00:15.221 INFO:teuthology.orchestra.run.smithi124.stderr: | | size_t {aka long unsigned int} 2023-10-06T03:00:15.221 INFO:teuthology.orchestra.run.smithi124.stderr: | long long unsigned int 2023-10-06T03:00:15.221 INFO:teuthology.orchestra.run.smithi124.stderr: | %lu 2023-10-06T03:00:15.221 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2510:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-10-06T03:00:15.222 INFO:teuthology.orchestra.run.smithi124.stderr: 2510 | fprintf( stdout, "write_bytes : %llu\n", write_bytes ); 2023-10-06T03:00:15.222 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~^ ~~~~~~~~~~~ 2023-10-06T03:00:15.222 INFO:teuthology.orchestra.run.smithi124.stderr: | | | 2023-10-06T03:00:15.222 INFO:teuthology.orchestra.run.smithi124.stderr: | | size_t {aka long unsigned int} 2023-10-06T03:00:15.222 INFO:teuthology.orchestra.run.smithi124.stderr: | long long unsigned int 2023-10-06T03:00:15.222 INFO:teuthology.orchestra.run.smithi124.stderr: | %lu 2023-10-06T03:00:15.231 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c: In function 'create_remove_items_helper': 2023-10-06T03:00:15.231 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:670:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-10-06T03:00:15.231 INFO:teuthology.orchestra.run.smithi124.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.231 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.231 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:670:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-10-06T03:00:15.231 INFO:teuthology.orchestra.run.smithi124.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.232 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.232 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:414:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-10-06T03:00:15.232 INFO:teuthology.orchestra.run.smithi124.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.232 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.232 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:414:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-10-06T03:00:15.232 INFO:teuthology.orchestra.run.smithi124.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.232 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.232 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:376:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.232 INFO:teuthology.orchestra.run.smithi124.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.232 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.232 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:376:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-10-06T03:00:15.232 INFO:teuthology.orchestra.run.smithi124.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.233 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.233 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:341:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.233 INFO:teuthology.orchestra.run.smithi124.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.233 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.233 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:341:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-10-06T03:00:15.233 INFO:teuthology.orchestra.run.smithi124.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.233 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.233 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c: In function 'collective_helper': 2023-10-06T03:00:15.233 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:820:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-10-06T03:00:15.233 INFO:teuthology.orchestra.run.smithi124.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.233 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.234 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:820:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-10-06T03:00:15.234 INFO:teuthology.orchestra.run.smithi124.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.234 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.234 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:776:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-10-06T03:00:15.234 INFO:teuthology.orchestra.run.smithi124.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.234 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.234 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:776:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-10-06T03:00:15.234 INFO:teuthology.orchestra.run.smithi124.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.235 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.235 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:747:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.235 INFO:teuthology.orchestra.run.smithi124.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.235 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.235 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:747:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-10-06T03:00:15.236 INFO:teuthology.orchestra.run.smithi124.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.236 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.236 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:722:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.236 INFO:teuthology.orchestra.run.smithi124.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.236 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.236 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:722:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-10-06T03:00:15.236 INFO:teuthology.orchestra.run.smithi124.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.236 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.236 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c: In function 'create_remove_items': 2023-10-06T03:00:15.236 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:893:21: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.236 INFO:teuthology.orchestra.run.smithi124.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-10-06T03:00:15.236 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~ 2023-10-06T03:00:15.237 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:893:4: note: 'sprintf' output between 4 and 4118 bytes into a destination of size 4096 2023-10-06T03:00:15.237 INFO:teuthology.orchestra.run.smithi124.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-10-06T03:00:15.237 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.238 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c: In function 'mdtest_stat': 2023-10-06T03:00:15.238 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:990:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.238 INFO:teuthology.orchestra.run.smithi124.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-10-06T03:00:15.238 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~~~ 2023-10-06T03:00:15.238 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:990:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-10-06T03:00:15.238 INFO:teuthology.orchestra.run.smithi124.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-10-06T03:00:15.238 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.238 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:984:26: warning: '%s' directive writing up to 4095 bytes into a region of size 4092 [-Wformat-overflow=] 2023-10-06T03:00:15.239 INFO:teuthology.orchestra.run.smithi124.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-10-06T03:00:15.239 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~~~ 2023-10-06T03:00:15.239 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:984:7: note: 'sprintf' output between 6 and 4120 bytes into a destination of size 4096 2023-10-06T03:00:15.239 INFO:teuthology.orchestra.run.smithi124.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-10-06T03:00:15.239 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.239 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:999:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.239 INFO:teuthology.orchestra.run.smithi124.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.239 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~ 2023-10-06T03:00:15.239 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:999:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-10-06T03:00:15.239 INFO:teuthology.orchestra.run.smithi124.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.239 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.239 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1005:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.240 INFO:teuthology.orchestra.run.smithi124.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.240 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~ 2023-10-06T03:00:15.240 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1005:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-10-06T03:00:15.240 INFO:teuthology.orchestra.run.smithi124.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.240 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.240 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1011:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-10-06T03:00:15.240 INFO:teuthology.orchestra.run.smithi124.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-10-06T03:00:15.240 INFO:teuthology.orchestra.run.smithi124.stderr: | ^ 2023-10-06T03:00:15.240 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1011:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-10-06T03:00:15.240 INFO:teuthology.orchestra.run.smithi124.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-10-06T03:00:15.240 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.240 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c: In function 'mdtest_read': 2023-10-06T03:00:15.241 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1148:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.241 INFO:teuthology.orchestra.run.smithi124.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-10-06T03:00:15.241 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~~~ 2023-10-06T03:00:15.241 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1148:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-10-06T03:00:15.241 INFO:teuthology.orchestra.run.smithi124.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-10-06T03:00:15.241 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.241 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1157:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.241 INFO:teuthology.orchestra.run.smithi124.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.241 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~ 2023-10-06T03:00:15.241 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1157:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-10-06T03:00:15.241 INFO:teuthology.orchestra.run.smithi124.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.241 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.242 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1163:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.242 INFO:teuthology.orchestra.run.smithi124.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.242 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~ 2023-10-06T03:00:15.242 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1163:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-10-06T03:00:15.242 INFO:teuthology.orchestra.run.smithi124.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.242 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.242 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1169:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-10-06T03:00:15.242 INFO:teuthology.orchestra.run.smithi124.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-10-06T03:00:15.242 INFO:teuthology.orchestra.run.smithi124.stderr: | ^ 2023-10-06T03:00:15.242 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1169:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-10-06T03:00:15.242 INFO:teuthology.orchestra.run.smithi124.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-10-06T03:00:15.242 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.243 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c: In function 'collective_create_remove': 2023-10-06T03:00:15.243 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1328:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.243 INFO:teuthology.orchestra.run.smithi124.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.243 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.243 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1328:9: note: 'sprintf' output between 17 and 4112 bytes into a destination of size 4096 2023-10-06T03:00:15.243 INFO:teuthology.orchestra.run.smithi124.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.243 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.243 INFO:teuthology.orchestra.run.smithi124.stderr: 1329 | (0+(0*nstride))%ntasks); 2023-10-06T03:00:15.243 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.243 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1330:38: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.243 INFO:teuthology.orchestra.run.smithi124.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.243 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.243 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1330:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.244 INFO:teuthology.orchestra.run.smithi124.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.244 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.244 INFO:teuthology.orchestra.run.smithi124.stderr: 1331 | (0+(1*nstride))%ntasks); 2023-10-06T03:00:15.244 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.244 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1332:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.244 INFO:teuthology.orchestra.run.smithi124.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.244 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.244 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1332:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.244 INFO:teuthology.orchestra.run.smithi124.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.244 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.244 INFO:teuthology.orchestra.run.smithi124.stderr: 1333 | (0+(2*nstride))%ntasks); 2023-10-06T03:00:15.244 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.245 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1334:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.245 INFO:teuthology.orchestra.run.smithi124.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.245 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.245 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1334:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.245 INFO:teuthology.orchestra.run.smithi124.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.245 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.245 INFO:teuthology.orchestra.run.smithi124.stderr: 1335 | (0+(3*nstride))%ntasks); 2023-10-06T03:00:15.245 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.245 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1336:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.245 INFO:teuthology.orchestra.run.smithi124.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.245 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.245 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1336:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.246 INFO:teuthology.orchestra.run.smithi124.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.246 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.246 INFO:teuthology.orchestra.run.smithi124.stderr: 1337 | (0+(4*nstride))%ntasks); 2023-10-06T03:00:15.246 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.246 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1293:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.246 INFO:teuthology.orchestra.run.smithi124.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.246 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.246 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1293:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.246 INFO:teuthology.orchestra.run.smithi124.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.246 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.246 INFO:teuthology.orchestra.run.smithi124.stderr: 1294 | (i+(0*nstride))%ntasks); 2023-10-06T03:00:15.246 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.247 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1295:42: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.247 INFO:teuthology.orchestra.run.smithi124.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.247 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.247 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1295:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.247 INFO:teuthology.orchestra.run.smithi124.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.247 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.247 INFO:teuthology.orchestra.run.smithi124.stderr: 1296 | (i+(1*nstride))%ntasks); 2023-10-06T03:00:15.247 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.247 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1297:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.247 INFO:teuthology.orchestra.run.smithi124.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.247 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.247 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1297:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.248 INFO:teuthology.orchestra.run.smithi124.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.248 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.248 INFO:teuthology.orchestra.run.smithi124.stderr: 1298 | (i+(2*nstride))%ntasks); 2023-10-06T03:00:15.248 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.248 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1299:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.248 INFO:teuthology.orchestra.run.smithi124.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.248 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.248 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1299:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.248 INFO:teuthology.orchestra.run.smithi124.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.248 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.248 INFO:teuthology.orchestra.run.smithi124.stderr: 1300 | (i+(3*nstride))%ntasks); 2023-10-06T03:00:15.248 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.249 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1301:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.249 INFO:teuthology.orchestra.run.smithi124.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.249 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.249 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:1301:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.249 INFO:teuthology.orchestra.run.smithi124.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.249 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.249 INFO:teuthology.orchestra.run.smithi124.stderr: 1302 | (i+(4*nstride))%ntasks); 2023-10-06T03:00:15.249 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.251 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c: In function 'create_remove_directory_tree': 2023-10-06T03:00:15.251 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2281:24: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.251 INFO:teuthology.orchestra.run.smithi124.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-10-06T03:00:15.251 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ 2023-10-06T03:00:15.252 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2281:7: note: 'sprintf' output between 4 and 4109 bytes into a destination of size 4096 2023-10-06T03:00:15.252 INFO:teuthology.orchestra.run.smithi124.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-10-06T03:00:15.252 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.252 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2225:24: warning: '.' directive writing 1 byte into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.252 INFO:teuthology.orchestra.run.smithi124.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-10-06T03:00:15.252 INFO:teuthology.orchestra.run.smithi124.stderr: | ^ 2023-10-06T03:00:15.252 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2225:5: note: 'sprintf' output 5 or more bytes (assuming 4100) into a destination of size 4096 2023-10-06T03:00:15.252 INFO:teuthology.orchestra.run.smithi124.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-10-06T03:00:15.252 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.252 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c: In function 'main': 2023-10-06T03:00:15.252 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2725:34: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.252 INFO:teuthology.orchestra.run.smithi124.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-10-06T03:00:15.253 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ 2023-10-06T03:00:15.253 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2725:13: note: 'sprintf' output between 3 and 4108 bytes into a destination of size 4096 2023-10-06T03:00:15.253 INFO:teuthology.orchestra.run.smithi124.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-10-06T03:00:15.253 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.253 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2826:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.253 INFO:teuthology.orchestra.run.smithi124.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.253 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.253 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2826:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.253 INFO:teuthology.orchestra.run.smithi124.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.253 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.253 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2827:43: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.253 INFO:teuthology.orchestra.run.smithi124.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.254 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.254 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2827:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.254 INFO:teuthology.orchestra.run.smithi124.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.254 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.254 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2828:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.254 INFO:teuthology.orchestra.run.smithi124.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.254 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.254 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2828:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.254 INFO:teuthology.orchestra.run.smithi124.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.254 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.254 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2829:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.254 INFO:teuthology.orchestra.run.smithi124.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.255 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.255 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2829:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.255 INFO:teuthology.orchestra.run.smithi124.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.255 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.255 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2830:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.255 INFO:teuthology.orchestra.run.smithi124.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.255 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.255 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2830:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.255 INFO:teuthology.orchestra.run.smithi124.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.255 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.255 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2848:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.255 INFO:teuthology.orchestra.run.smithi124.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.255 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.256 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2848:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.256 INFO:teuthology.orchestra.run.smithi124.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.256 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.256 INFO:teuthology.orchestra.run.smithi124.stderr: 2849 | (rank+(0*nstride))%i); 2023-10-06T03:00:15.256 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.256 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2850:50: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.256 INFO:teuthology.orchestra.run.smithi124.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.256 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.256 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2850:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.256 INFO:teuthology.orchestra.run.smithi124.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.256 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.256 INFO:teuthology.orchestra.run.smithi124.stderr: 2851 | (rank+(1*nstride))%i); 2023-10-06T03:00:15.257 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.257 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2852:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.257 INFO:teuthology.orchestra.run.smithi124.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.257 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.257 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2852:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.257 INFO:teuthology.orchestra.run.smithi124.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.257 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.257 INFO:teuthology.orchestra.run.smithi124.stderr: 2853 | (rank+(2*nstride))%i); 2023-10-06T03:00:15.257 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.257 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2854:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.257 INFO:teuthology.orchestra.run.smithi124.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.257 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.257 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2854:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.258 INFO:teuthology.orchestra.run.smithi124.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.258 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.258 INFO:teuthology.orchestra.run.smithi124.stderr: 2855 | (rank+(3*nstride))%i); 2023-10-06T03:00:15.258 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.258 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2856:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.258 INFO:teuthology.orchestra.run.smithi124.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.258 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.258 INFO:teuthology.orchestra.run.smithi124.stderr:mdtest.c:2856:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.258 INFO:teuthology.orchestra.run.smithi124.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.258 INFO:teuthology.orchestra.run.smithi124.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.258 INFO:teuthology.orchestra.run.smithi124.stderr: 2857 | (rank+(4*nstride))%i); 2023-10-06T03:00:15.258 INFO:teuthology.orchestra.run.smithi124.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.274 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'main': 2023-10-06T03:00:15.274 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2492:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-10-06T03:00:15.274 INFO:teuthology.orchestra.run.smithi174.stderr: 2492 | fprintf( stdout, "read_bytes : %llu\n", read_bytes ); 2023-10-06T03:00:15.274 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~^ ~~~~~~~~~~ 2023-10-06T03:00:15.274 INFO:teuthology.orchestra.run.smithi174.stderr: | | | 2023-10-06T03:00:15.275 INFO:teuthology.orchestra.run.smithi174.stderr: | | size_t {aka long unsigned int} 2023-10-06T03:00:15.275 INFO:teuthology.orchestra.run.smithi174.stderr: | long long unsigned int 2023-10-06T03:00:15.275 INFO:teuthology.orchestra.run.smithi174.stderr: | %lu 2023-10-06T03:00:15.275 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2510:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-10-06T03:00:15.275 INFO:teuthology.orchestra.run.smithi174.stderr: 2510 | fprintf( stdout, "write_bytes : %llu\n", write_bytes ); 2023-10-06T03:00:15.275 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~^ ~~~~~~~~~~~ 2023-10-06T03:00:15.275 INFO:teuthology.orchestra.run.smithi174.stderr: | | | 2023-10-06T03:00:15.276 INFO:teuthology.orchestra.run.smithi174.stderr: | | size_t {aka long unsigned int} 2023-10-06T03:00:15.276 INFO:teuthology.orchestra.run.smithi174.stderr: | long long unsigned int 2023-10-06T03:00:15.276 INFO:teuthology.orchestra.run.smithi174.stderr: | %lu 2023-10-06T03:00:15.277 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c: In function 'main': 2023-10-06T03:00:15.277 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2492:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-10-06T03:00:15.277 INFO:teuthology.orchestra.run.smithi158.stderr: 2492 | fprintf( stdout, "read_bytes : %llu\n", read_bytes ); 2023-10-06T03:00:15.277 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~^ ~~~~~~~~~~ 2023-10-06T03:00:15.278 INFO:teuthology.orchestra.run.smithi158.stderr: | | | 2023-10-06T03:00:15.278 INFO:teuthology.orchestra.run.smithi158.stderr: | | size_t {aka long unsigned int} 2023-10-06T03:00:15.278 INFO:teuthology.orchestra.run.smithi158.stderr: | long long unsigned int 2023-10-06T03:00:15.278 INFO:teuthology.orchestra.run.smithi158.stderr: | %lu 2023-10-06T03:00:15.279 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2510:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-10-06T03:00:15.279 INFO:teuthology.orchestra.run.smithi158.stderr: 2510 | fprintf( stdout, "write_bytes : %llu\n", write_bytes ); 2023-10-06T03:00:15.279 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~^ ~~~~~~~~~~~ 2023-10-06T03:00:15.279 INFO:teuthology.orchestra.run.smithi158.stderr: | | | 2023-10-06T03:00:15.279 INFO:teuthology.orchestra.run.smithi158.stderr: | | size_t {aka long unsigned int} 2023-10-06T03:00:15.279 INFO:teuthology.orchestra.run.smithi158.stderr: | long long unsigned int 2023-10-06T03:00:15.279 INFO:teuthology.orchestra.run.smithi158.stderr: | %lu 2023-10-06T03:00:15.294 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'create_remove_items_helper': 2023-10-06T03:00:15.294 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:670:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-10-06T03:00:15.294 INFO:teuthology.orchestra.run.smithi174.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.295 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.295 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:670:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-10-06T03:00:15.295 INFO:teuthology.orchestra.run.smithi174.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.295 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.295 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:414:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-10-06T03:00:15.295 INFO:teuthology.orchestra.run.smithi174.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.295 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.295 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:414:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-10-06T03:00:15.295 INFO:teuthology.orchestra.run.smithi174.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.295 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.295 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:376:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.295 INFO:teuthology.orchestra.run.smithi174.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.296 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.296 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:376:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-10-06T03:00:15.296 INFO:teuthology.orchestra.run.smithi174.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.296 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.296 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:341:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.296 INFO:teuthology.orchestra.run.smithi174.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.296 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.296 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:341:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-10-06T03:00:15.296 INFO:teuthology.orchestra.run.smithi174.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.296 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.296 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'collective_helper': 2023-10-06T03:00:15.296 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:820:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-10-06T03:00:15.297 INFO:teuthology.orchestra.run.smithi174.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.297 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.297 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:820:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-10-06T03:00:15.297 INFO:teuthology.orchestra.run.smithi174.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.297 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.297 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:776:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-10-06T03:00:15.297 INFO:teuthology.orchestra.run.smithi174.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.297 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.297 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:776:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-10-06T03:00:15.298 INFO:teuthology.orchestra.run.smithi174.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.298 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.298 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:747:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.298 INFO:teuthology.orchestra.run.smithi174.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.298 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.298 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:747:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-10-06T03:00:15.298 INFO:teuthology.orchestra.run.smithi174.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.298 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.298 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:722:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.298 INFO:teuthology.orchestra.run.smithi174.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.299 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.299 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:722:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-10-06T03:00:15.299 INFO:teuthology.orchestra.run.smithi174.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.299 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.299 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'create_remove_items': 2023-10-06T03:00:15.299 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:893:21: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.299 INFO:teuthology.orchestra.run.smithi174.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-10-06T03:00:15.299 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~ 2023-10-06T03:00:15.299 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:893:4: note: 'sprintf' output between 4 and 4118 bytes into a destination of size 4096 2023-10-06T03:00:15.299 INFO:teuthology.orchestra.run.smithi174.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-10-06T03:00:15.300 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.301 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'mdtest_stat': 2023-10-06T03:00:15.301 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:990:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.301 INFO:teuthology.orchestra.run.smithi174.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-10-06T03:00:15.301 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~ 2023-10-06T03:00:15.302 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:990:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-10-06T03:00:15.302 INFO:teuthology.orchestra.run.smithi174.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-10-06T03:00:15.302 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.302 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:984:26: warning: '%s' directive writing up to 4095 bytes into a region of size 4092 [-Wformat-overflow=] 2023-10-06T03:00:15.302 INFO:teuthology.orchestra.run.smithi174.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-10-06T03:00:15.302 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~ 2023-10-06T03:00:15.302 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:984:7: note: 'sprintf' output between 6 and 4120 bytes into a destination of size 4096 2023-10-06T03:00:15.302 INFO:teuthology.orchestra.run.smithi174.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-10-06T03:00:15.302 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.303 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:999:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.303 INFO:teuthology.orchestra.run.smithi174.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.303 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~ 2023-10-06T03:00:15.303 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:999:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-10-06T03:00:15.303 INFO:teuthology.orchestra.run.smithi174.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.303 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.303 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1005:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.303 INFO:teuthology.orchestra.run.smithi174.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.303 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~ 2023-10-06T03:00:15.303 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1005:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-10-06T03:00:15.303 INFO:teuthology.orchestra.run.smithi174.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.304 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.304 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1011:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-10-06T03:00:15.304 INFO:teuthology.orchestra.run.smithi174.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-10-06T03:00:15.304 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2023-10-06T03:00:15.304 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1011:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-10-06T03:00:15.304 INFO:teuthology.orchestra.run.smithi174.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-10-06T03:00:15.304 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.304 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'mdtest_read': 2023-10-06T03:00:15.305 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1148:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.305 INFO:teuthology.orchestra.run.smithi174.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-10-06T03:00:15.305 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~ 2023-10-06T03:00:15.305 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1148:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-10-06T03:00:15.305 INFO:teuthology.orchestra.run.smithi174.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-10-06T03:00:15.305 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.305 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1157:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.305 INFO:teuthology.orchestra.run.smithi174.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.305 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~ 2023-10-06T03:00:15.305 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1157:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-10-06T03:00:15.305 INFO:teuthology.orchestra.run.smithi174.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.306 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.306 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1163:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.306 INFO:teuthology.orchestra.run.smithi174.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.306 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~ 2023-10-06T03:00:15.306 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1163:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-10-06T03:00:15.306 INFO:teuthology.orchestra.run.smithi174.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.306 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.306 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1169:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-10-06T03:00:15.306 INFO:teuthology.orchestra.run.smithi174.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-10-06T03:00:15.306 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2023-10-06T03:00:15.307 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1169:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-10-06T03:00:15.307 INFO:teuthology.orchestra.run.smithi174.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-10-06T03:00:15.307 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.307 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'collective_create_remove': 2023-10-06T03:00:15.307 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1328:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.307 INFO:teuthology.orchestra.run.smithi174.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.307 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.307 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1328:9: note: 'sprintf' output between 17 and 4112 bytes into a destination of size 4096 2023-10-06T03:00:15.307 INFO:teuthology.orchestra.run.smithi174.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.307 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.307 INFO:teuthology.orchestra.run.smithi174.stderr: 1329 | (0+(0*nstride))%ntasks); 2023-10-06T03:00:15.308 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.308 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1330:38: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.308 INFO:teuthology.orchestra.run.smithi174.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.308 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.308 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1330:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.308 INFO:teuthology.orchestra.run.smithi174.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.308 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.308 INFO:teuthology.orchestra.run.smithi174.stderr: 1331 | (0+(1*nstride))%ntasks); 2023-10-06T03:00:15.308 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.308 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1332:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.308 INFO:teuthology.orchestra.run.smithi174.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.309 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.309 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1332:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.309 INFO:teuthology.orchestra.run.smithi174.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.309 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.309 INFO:teuthology.orchestra.run.smithi174.stderr: 1333 | (0+(2*nstride))%ntasks); 2023-10-06T03:00:15.309 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.309 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1334:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.309 INFO:teuthology.orchestra.run.smithi174.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.309 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.310 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1334:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.310 INFO:teuthology.orchestra.run.smithi174.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.310 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.310 INFO:teuthology.orchestra.run.smithi174.stderr: 1335 | (0+(3*nstride))%ntasks); 2023-10-06T03:00:15.310 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.310 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1336:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.310 INFO:teuthology.orchestra.run.smithi174.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.310 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.310 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1336:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.311 INFO:teuthology.orchestra.run.smithi174.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.311 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.311 INFO:teuthology.orchestra.run.smithi174.stderr: 1337 | (0+(4*nstride))%ntasks); 2023-10-06T03:00:15.311 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.311 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1293:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.311 INFO:teuthology.orchestra.run.smithi174.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.311 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.311 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1293:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.311 INFO:teuthology.orchestra.run.smithi174.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.311 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.311 INFO:teuthology.orchestra.run.smithi174.stderr: 1294 | (i+(0*nstride))%ntasks); 2023-10-06T03:00:15.312 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.312 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1295:42: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.312 INFO:teuthology.orchestra.run.smithi174.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.312 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.312 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1295:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.312 INFO:teuthology.orchestra.run.smithi174.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.312 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.312 INFO:teuthology.orchestra.run.smithi174.stderr: 1296 | (i+(1*nstride))%ntasks); 2023-10-06T03:00:15.312 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.312 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1297:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.313 INFO:teuthology.orchestra.run.smithi174.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.313 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.313 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1297:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.313 INFO:teuthology.orchestra.run.smithi174.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.313 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.313 INFO:teuthology.orchestra.run.smithi174.stderr: 1298 | (i+(2*nstride))%ntasks); 2023-10-06T03:00:15.313 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.313 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1299:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.313 INFO:teuthology.orchestra.run.smithi174.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.313 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.314 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1299:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.314 INFO:teuthology.orchestra.run.smithi174.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.314 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.314 INFO:teuthology.orchestra.run.smithi174.stderr: 1300 | (i+(3*nstride))%ntasks); 2023-10-06T03:00:15.314 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.314 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1301:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.314 INFO:teuthology.orchestra.run.smithi174.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.314 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.314 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1301:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.315 INFO:teuthology.orchestra.run.smithi174.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.315 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.315 INFO:teuthology.orchestra.run.smithi174.stderr: 1302 | (i+(4*nstride))%ntasks); 2023-10-06T03:00:15.315 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.317 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'create_remove_directory_tree': 2023-10-06T03:00:15.317 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2281:24: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.317 INFO:teuthology.orchestra.run.smithi174.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-10-06T03:00:15.317 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ 2023-10-06T03:00:15.317 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2281:7: note: 'sprintf' output between 4 and 4109 bytes into a destination of size 4096 2023-10-06T03:00:15.317 INFO:teuthology.orchestra.run.smithi174.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-10-06T03:00:15.317 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.318 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2225:24: warning: '.' directive writing 1 byte into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.318 INFO:teuthology.orchestra.run.smithi174.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-10-06T03:00:15.318 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2023-10-06T03:00:15.318 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2225:5: note: 'sprintf' output 5 or more bytes (assuming 4100) into a destination of size 4096 2023-10-06T03:00:15.318 INFO:teuthology.orchestra.run.smithi174.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-10-06T03:00:15.318 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.319 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'main': 2023-10-06T03:00:15.319 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2725:34: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.319 INFO:teuthology.orchestra.run.smithi174.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-10-06T03:00:15.319 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ 2023-10-06T03:00:15.319 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2725:13: note: 'sprintf' output between 3 and 4108 bytes into a destination of size 4096 2023-10-06T03:00:15.319 INFO:teuthology.orchestra.run.smithi174.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-10-06T03:00:15.319 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.319 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2826:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.319 INFO:teuthology.orchestra.run.smithi174.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.320 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.320 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2826:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.320 INFO:teuthology.orchestra.run.smithi174.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.320 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.320 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2827:43: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.320 INFO:teuthology.orchestra.run.smithi174.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.320 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.320 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2827:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.320 INFO:teuthology.orchestra.run.smithi174.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.320 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.321 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2828:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.321 INFO:teuthology.orchestra.run.smithi174.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.321 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.321 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2828:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.321 INFO:teuthology.orchestra.run.smithi174.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.321 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.322 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2829:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.322 INFO:teuthology.orchestra.run.smithi174.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.322 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.322 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2829:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.323 INFO:teuthology.orchestra.run.smithi174.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.323 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.323 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2830:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.323 INFO:teuthology.orchestra.run.smithi174.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.323 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.323 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2830:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.323 INFO:teuthology.orchestra.run.smithi174.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.323 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.324 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2848:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.324 INFO:teuthology.orchestra.run.smithi174.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.324 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.324 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2848:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.324 INFO:teuthology.orchestra.run.smithi174.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.324 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.324 INFO:teuthology.orchestra.run.smithi174.stderr: 2849 | (rank+(0*nstride))%i); 2023-10-06T03:00:15.324 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.324 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2850:50: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.324 INFO:teuthology.orchestra.run.smithi174.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.325 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.325 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2850:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.325 INFO:teuthology.orchestra.run.smithi174.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.325 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.325 INFO:teuthology.orchestra.run.smithi174.stderr: 2851 | (rank+(1*nstride))%i); 2023-10-06T03:00:15.325 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.325 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2852:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.326 INFO:teuthology.orchestra.run.smithi174.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.326 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.326 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2852:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.326 INFO:teuthology.orchestra.run.smithi174.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.326 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.326 INFO:teuthology.orchestra.run.smithi174.stderr: 2853 | (rank+(2*nstride))%i); 2023-10-06T03:00:15.326 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.326 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2854:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.326 INFO:teuthology.orchestra.run.smithi174.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.326 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.327 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2854:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.327 INFO:teuthology.orchestra.run.smithi174.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.327 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.327 INFO:teuthology.orchestra.run.smithi174.stderr: 2855 | (rank+(3*nstride))%i); 2023-10-06T03:00:15.327 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.327 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2856:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.327 INFO:teuthology.orchestra.run.smithi174.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.328 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.328 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:2856:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.328 INFO:teuthology.orchestra.run.smithi174.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.328 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.328 INFO:teuthology.orchestra.run.smithi174.stderr: 2857 | (rank+(4*nstride))%i); 2023-10-06T03:00:15.328 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.333 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c: In function 'create_remove_items_helper': 2023-10-06T03:00:15.333 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:670:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-10-06T03:00:15.333 INFO:teuthology.orchestra.run.smithi158.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.333 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.334 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:670:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-10-06T03:00:15.334 INFO:teuthology.orchestra.run.smithi158.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.334 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.335 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:414:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-10-06T03:00:15.336 INFO:teuthology.orchestra.run.smithi158.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.336 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.336 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:414:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-10-06T03:00:15.336 INFO:teuthology.orchestra.run.smithi158.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.336 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.336 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:376:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.336 INFO:teuthology.orchestra.run.smithi158.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.337 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.337 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:376:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-10-06T03:00:15.337 INFO:teuthology.orchestra.run.smithi158.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.337 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.337 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:341:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.337 INFO:teuthology.orchestra.run.smithi158.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.337 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.337 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:341:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-10-06T03:00:15.338 INFO:teuthology.orchestra.run.smithi158.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.338 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.338 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c: In function 'collective_helper': 2023-10-06T03:00:15.338 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:820:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-10-06T03:00:15.338 INFO:teuthology.orchestra.run.smithi158.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.338 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.338 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:820:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-10-06T03:00:15.338 INFO:teuthology.orchestra.run.smithi158.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.338 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.339 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:776:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-10-06T03:00:15.339 INFO:teuthology.orchestra.run.smithi158.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.339 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.339 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:776:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-10-06T03:00:15.339 INFO:teuthology.orchestra.run.smithi158.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.339 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.339 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:747:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.339 INFO:teuthology.orchestra.run.smithi158.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.339 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.340 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:747:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-10-06T03:00:15.340 INFO:teuthology.orchestra.run.smithi158.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-10-06T03:00:15.340 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.340 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:722:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.340 INFO:teuthology.orchestra.run.smithi158.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.340 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~ 2023-10-06T03:00:15.340 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:722:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-10-06T03:00:15.340 INFO:teuthology.orchestra.run.smithi158.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-10-06T03:00:15.340 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.340 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c: In function 'create_remove_items': 2023-10-06T03:00:15.340 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:893:21: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.341 INFO:teuthology.orchestra.run.smithi158.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-10-06T03:00:15.341 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~ 2023-10-06T03:00:15.341 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:893:4: note: 'sprintf' output between 4 and 4118 bytes into a destination of size 4096 2023-10-06T03:00:15.341 INFO:teuthology.orchestra.run.smithi158.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-10-06T03:00:15.341 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.341 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c: In function 'mdtest_stat': 2023-10-06T03:00:15.341 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:990:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.341 INFO:teuthology.orchestra.run.smithi158.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-10-06T03:00:15.341 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~~~ 2023-10-06T03:00:15.341 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:990:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-10-06T03:00:15.341 INFO:teuthology.orchestra.run.smithi158.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-10-06T03:00:15.342 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.342 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:984:26: warning: '%s' directive writing up to 4095 bytes into a region of size 4092 [-Wformat-overflow=] 2023-10-06T03:00:15.342 INFO:teuthology.orchestra.run.smithi158.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-10-06T03:00:15.342 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~~~ 2023-10-06T03:00:15.342 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:984:7: note: 'sprintf' output between 6 and 4120 bytes into a destination of size 4096 2023-10-06T03:00:15.342 INFO:teuthology.orchestra.run.smithi158.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-10-06T03:00:15.342 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.342 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:999:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.342 INFO:teuthology.orchestra.run.smithi158.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.343 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~ 2023-10-06T03:00:15.343 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:999:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-10-06T03:00:15.343 INFO:teuthology.orchestra.run.smithi158.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.343 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.343 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1005:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.343 INFO:teuthology.orchestra.run.smithi158.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.343 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~ 2023-10-06T03:00:15.343 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1005:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-10-06T03:00:15.343 INFO:teuthology.orchestra.run.smithi158.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.343 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.344 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1011:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-10-06T03:00:15.344 INFO:teuthology.orchestra.run.smithi158.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-10-06T03:00:15.344 INFO:teuthology.orchestra.run.smithi158.stderr: | ^ 2023-10-06T03:00:15.344 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1011:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-10-06T03:00:15.344 INFO:teuthology.orchestra.run.smithi158.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-10-06T03:00:15.344 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.344 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c: In function 'mdtest_read': 2023-10-06T03:00:15.344 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1148:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-10-06T03:00:15.344 INFO:teuthology.orchestra.run.smithi158.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-10-06T03:00:15.344 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~~~ 2023-10-06T03:00:15.345 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1148:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-10-06T03:00:15.345 INFO:teuthology.orchestra.run.smithi158.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-10-06T03:00:15.345 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.345 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1157:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.345 INFO:teuthology.orchestra.run.smithi158.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.345 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~ 2023-10-06T03:00:15.345 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1157:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-10-06T03:00:15.345 INFO:teuthology.orchestra.run.smithi158.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.345 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.345 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1163:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.345 INFO:teuthology.orchestra.run.smithi158.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.346 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~ 2023-10-06T03:00:15.346 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1163:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-10-06T03:00:15.346 INFO:teuthology.orchestra.run.smithi158.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-10-06T03:00:15.346 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.346 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1169:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-10-06T03:00:15.346 INFO:teuthology.orchestra.run.smithi158.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-10-06T03:00:15.346 INFO:teuthology.orchestra.run.smithi158.stderr: | ^ 2023-10-06T03:00:15.346 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1169:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-10-06T03:00:15.346 INFO:teuthology.orchestra.run.smithi158.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-10-06T03:00:15.346 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.346 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c: In function 'collective_create_remove': 2023-10-06T03:00:15.347 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1328:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.347 INFO:teuthology.orchestra.run.smithi158.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.347 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.347 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1328:9: note: 'sprintf' output between 17 and 4112 bytes into a destination of size 4096 2023-10-06T03:00:15.347 INFO:teuthology.orchestra.run.smithi158.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.347 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.347 INFO:teuthology.orchestra.run.smithi158.stderr: 1329 | (0+(0*nstride))%ntasks); 2023-10-06T03:00:15.347 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.347 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1330:38: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.347 INFO:teuthology.orchestra.run.smithi158.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.347 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.348 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1330:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.348 INFO:teuthology.orchestra.run.smithi158.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.348 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.348 INFO:teuthology.orchestra.run.smithi158.stderr: 1331 | (0+(1*nstride))%ntasks); 2023-10-06T03:00:15.348 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.348 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1332:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.348 INFO:teuthology.orchestra.run.smithi158.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.348 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.348 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1332:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.348 INFO:teuthology.orchestra.run.smithi158.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.348 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.348 INFO:teuthology.orchestra.run.smithi158.stderr: 1333 | (0+(2*nstride))%ntasks); 2023-10-06T03:00:15.349 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.349 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1334:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.349 INFO:teuthology.orchestra.run.smithi158.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.349 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.349 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1334:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.349 INFO:teuthology.orchestra.run.smithi158.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.349 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.349 INFO:teuthology.orchestra.run.smithi158.stderr: 1335 | (0+(3*nstride))%ntasks); 2023-10-06T03:00:15.349 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.349 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1336:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.349 INFO:teuthology.orchestra.run.smithi158.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.350 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.350 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1336:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.350 INFO:teuthology.orchestra.run.smithi158.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.350 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.350 INFO:teuthology.orchestra.run.smithi158.stderr: 1337 | (0+(4*nstride))%ntasks); 2023-10-06T03:00:15.350 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.350 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1293:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.350 INFO:teuthology.orchestra.run.smithi158.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.350 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.350 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1293:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.350 INFO:teuthology.orchestra.run.smithi158.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.351 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.351 INFO:teuthology.orchestra.run.smithi158.stderr: 1294 | (i+(0*nstride))%ntasks); 2023-10-06T03:00:15.351 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.351 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1295:42: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.351 INFO:teuthology.orchestra.run.smithi158.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.351 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.351 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1295:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.351 INFO:teuthology.orchestra.run.smithi158.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.351 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.351 INFO:teuthology.orchestra.run.smithi158.stderr: 1296 | (i+(1*nstride))%ntasks); 2023-10-06T03:00:15.352 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.352 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1297:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.352 INFO:teuthology.orchestra.run.smithi158.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.352 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.352 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1297:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.352 INFO:teuthology.orchestra.run.smithi158.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.352 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.352 INFO:teuthology.orchestra.run.smithi158.stderr: 1298 | (i+(2*nstride))%ntasks); 2023-10-06T03:00:15.352 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.353 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1299:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.353 INFO:teuthology.orchestra.run.smithi158.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.353 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.353 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1299:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.353 INFO:teuthology.orchestra.run.smithi158.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.353 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.353 INFO:teuthology.orchestra.run.smithi158.stderr: 1300 | (i+(3*nstride))%ntasks); 2023-10-06T03:00:15.353 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.353 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1301:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.354 INFO:teuthology.orchestra.run.smithi158.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.354 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.354 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:1301:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.354 INFO:teuthology.orchestra.run.smithi158.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.354 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.354 INFO:teuthology.orchestra.run.smithi158.stderr: 1302 | (i+(4*nstride))%ntasks); 2023-10-06T03:00:15.354 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.354 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c: In function 'create_remove_directory_tree': 2023-10-06T03:00:15.354 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2281:24: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.354 INFO:teuthology.orchestra.run.smithi158.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-10-06T03:00:15.355 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ 2023-10-06T03:00:15.355 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2281:7: note: 'sprintf' output between 4 and 4109 bytes into a destination of size 4096 2023-10-06T03:00:15.355 INFO:teuthology.orchestra.run.smithi158.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-10-06T03:00:15.355 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.355 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2225:24: warning: '.' directive writing 1 byte into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.355 INFO:teuthology.orchestra.run.smithi158.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-10-06T03:00:15.355 INFO:teuthology.orchestra.run.smithi158.stderr: | ^ 2023-10-06T03:00:15.355 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2225:5: note: 'sprintf' output 5 or more bytes (assuming 4100) into a destination of size 4096 2023-10-06T03:00:15.355 INFO:teuthology.orchestra.run.smithi158.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-10-06T03:00:15.355 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.357 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c: In function 'main': 2023-10-06T03:00:15.358 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2725:34: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.358 INFO:teuthology.orchestra.run.smithi158.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-10-06T03:00:15.358 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ 2023-10-06T03:00:15.358 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2725:13: note: 'sprintf' output between 3 and 4108 bytes into a destination of size 4096 2023-10-06T03:00:15.358 INFO:teuthology.orchestra.run.smithi158.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-10-06T03:00:15.358 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.358 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2826:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.358 INFO:teuthology.orchestra.run.smithi158.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.358 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.359 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2826:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.359 INFO:teuthology.orchestra.run.smithi158.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.359 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.359 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2827:43: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.359 INFO:teuthology.orchestra.run.smithi158.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.359 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.359 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2827:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.359 INFO:teuthology.orchestra.run.smithi158.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.359 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.359 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2828:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.360 INFO:teuthology.orchestra.run.smithi158.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.360 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.360 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2828:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.360 INFO:teuthology.orchestra.run.smithi158.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.360 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.360 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2829:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.360 INFO:teuthology.orchestra.run.smithi158.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.360 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.360 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2829:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.360 INFO:teuthology.orchestra.run.smithi158.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.361 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.361 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2830:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-10-06T03:00:15.361 INFO:teuthology.orchestra.run.smithi158.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.361 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-10-06T03:00:15.361 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2830:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-10-06T03:00:15.361 INFO:teuthology.orchestra.run.smithi158.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-10-06T03:00:15.361 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.361 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2848:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.361 INFO:teuthology.orchestra.run.smithi158.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.361 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.362 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2848:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.362 INFO:teuthology.orchestra.run.smithi158.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.362 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.362 INFO:teuthology.orchestra.run.smithi158.stderr: 2849 | (rank+(0*nstride))%i); 2023-10-06T03:00:15.362 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.362 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2850:50: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.362 INFO:teuthology.orchestra.run.smithi158.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.362 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.363 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2850:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.363 INFO:teuthology.orchestra.run.smithi158.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.363 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.363 INFO:teuthology.orchestra.run.smithi158.stderr: 2851 | (rank+(1*nstride))%i); 2023-10-06T03:00:15.363 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.363 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2852:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.363 INFO:teuthology.orchestra.run.smithi158.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.363 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.363 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2852:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.363 INFO:teuthology.orchestra.run.smithi158.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.363 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.364 INFO:teuthology.orchestra.run.smithi158.stderr: 2853 | (rank+(2*nstride))%i); 2023-10-06T03:00:15.364 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.364 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2854:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.364 INFO:teuthology.orchestra.run.smithi158.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.364 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.364 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2854:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.364 INFO:teuthology.orchestra.run.smithi158.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.364 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.364 INFO:teuthology.orchestra.run.smithi158.stderr: 2855 | (rank+(3*nstride))%i); 2023-10-06T03:00:15.365 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.365 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2856:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-10-06T03:00:15.365 INFO:teuthology.orchestra.run.smithi158.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.365 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~ 2023-10-06T03:00:15.365 INFO:teuthology.orchestra.run.smithi158.stderr:mdtest.c:2856:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-10-06T03:00:15.365 INFO:teuthology.orchestra.run.smithi158.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-10-06T03:00:15.365 INFO:teuthology.orchestra.run.smithi158.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.365 INFO:teuthology.orchestra.run.smithi158.stderr: 2857 | (rank+(4*nstride))%i); 2023-10-06T03:00:15.365 INFO:teuthology.orchestra.run.smithi158.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-10-06T03:00:15.669 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:15.698 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:15.761 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:15.761 INFO:teuthology.run_tasks:Running task ssh_keys... 2023-10-06T03:00:15.809 DEBUG:teuthology.orchestra.run.smithi027:> echo 'StrictHostKeyChecking no 2023-10-06T03:00:15.809 DEBUG:teuthology.orchestra.run.smithi027:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2023-10-06T03:00:15.811 DEBUG:teuthology.orchestra.run.smithi123:> echo 'StrictHostKeyChecking no 2023-10-06T03:00:15.812 DEBUG:teuthology.orchestra.run.smithi123:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2023-10-06T03:00:15.814 DEBUG:teuthology.orchestra.run.smithi124:> echo 'StrictHostKeyChecking no 2023-10-06T03:00:15.814 DEBUG:teuthology.orchestra.run.smithi124:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2023-10-06T03:00:15.817 DEBUG:teuthology.orchestra.run.smithi158:> echo 'StrictHostKeyChecking no 2023-10-06T03:00:15.817 DEBUG:teuthology.orchestra.run.smithi158:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2023-10-06T03:00:15.819 DEBUG:teuthology.orchestra.run.smithi174:> echo 'StrictHostKeyChecking no 2023-10-06T03:00:15.819 DEBUG:teuthology.orchestra.run.smithi174:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2023-10-06T03:00:15.826 INFO:teuthology.task.ssh_keys:generated public key AAAAB3NzaC1yc2EAAAADAQABAAABAQDZJ3cUC+6pdJfoRRDPU75qxfwynAQKmWkPN/u5GrUbZuOCGAY6ULJtksCfLtOR8nRV6+Fgt89LDfbFwTw7R7Wcn6bltn/6cslyJegIUyROkwzHEpFOL9mmvRiD/U/ClqthOQLWqznWzoznSP0QU+hsRxkwcfH8wKUYaXBHb/5XcmnB825oU9g6QbJw6f03YktAvF8ymGnAYCx/IbQtOauR91TXRrJ1V1zHNx7ntoB/4y17PGXryWhNiY49dKmy5FOD1GOEEeEyOllfC/z6i/3SAhhtrAF01oUL1zbApuzRS+uAGY++hCJ9WkdPT0yIYKrUKAGAiZfRyv8WTYzavoTJ 2023-10-06T03:00:15.826 INFO:teuthology.task.ssh_keys:pushing keys to smithi027.front.sepia.ceph.com for ubuntu 2023-10-06T03:00:15.826 DEBUG:teuthology.orchestra.run.smithi027:> rm -f -- /home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:15.864 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T03:00:15.864 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:15.865 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:15.873 DEBUG:teuthology.orchestra.run.smithi027:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:00:15.878 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T03:00:15.878 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:00:15.883 DEBUG:teuthology.orchestra.run.smithi027:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:15:883687 2023-10-06T03:00:15.933 INFO:teuthology.orchestra.run.smithi027.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:15:883687' 2023-10-06T03:00:15.934 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-06T03:00:15.934 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2023-10-06T03:00:15.941 INFO:teuthology.task.ssh_keys:pushing keys to smithi123.front.sepia.ceph.com for ubuntu 2023-10-06T03:00:15.941 DEBUG:teuthology.orchestra.run.smithi123:> rm -f -- /home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:15.948 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T03:00:15.948 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:15.948 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:15.957 DEBUG:teuthology.orchestra.run.smithi123:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:00:15.962 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T03:00:15.963 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:00:16.012 DEBUG:teuthology.orchestra.run.smithi123:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:16:011793 2023-10-06T03:00:16.021 INFO:teuthology.orchestra.run.smithi123.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:16:011793' 2023-10-06T03:00:16.021 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-06T03:00:16.021 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2023-10-06T03:00:16.028 INFO:teuthology.task.ssh_keys:pushing keys to smithi124.front.sepia.ceph.com for ubuntu 2023-10-06T03:00:16.028 DEBUG:teuthology.orchestra.run.smithi124:> rm -f -- /home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:16.035 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T03:00:16.035 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:16.035 DEBUG:teuthology.orchestra.run.smithi124:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:16.043 DEBUG:teuthology.orchestra.run.smithi124:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:00:16.049 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T03:00:16.049 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:00:16.097 DEBUG:teuthology.orchestra.run.smithi124:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:16:097657 2023-10-06T03:00:16.105 INFO:teuthology.orchestra.run.smithi124.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:16:097657' 2023-10-06T03:00:16.105 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T03:00:16.105 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2023-10-06T03:00:16.111 INFO:teuthology.task.ssh_keys:pushing keys to smithi158.front.sepia.ceph.com for ubuntu 2023-10-06T03:00:16.112 DEBUG:teuthology.orchestra.run.smithi158:> rm -f -- /home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:16.118 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T03:00:16.118 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:16.118 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:16.126 DEBUG:teuthology.orchestra.run.smithi158:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:00:16.131 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T03:00:16.131 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:00:16.137 DEBUG:teuthology.orchestra.run.smithi158:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:16:137090 2023-10-06T03:00:16.186 INFO:teuthology.orchestra.run.smithi158.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:16:137090' 2023-10-06T03:00:16.187 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-06T03:00:16.187 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2023-10-06T03:00:16.193 INFO:teuthology.task.ssh_keys:pushing keys to smithi174.front.sepia.ceph.com for ubuntu 2023-10-06T03:00:16.193 DEBUG:teuthology.orchestra.run.smithi174:> rm -f -- /home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:16.200 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T03:00:16.200 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:16.200 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2023-10-06T03:00:16.208 DEBUG:teuthology.orchestra.run.smithi174:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:00:16.214 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T03:00:16.214 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:00:16.263 DEBUG:teuthology.orchestra.run.smithi174:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:16:263371 2023-10-06T03:00:16.270 INFO:teuthology.orchestra.run.smithi174.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:16:263371' 2023-10-06T03:00:16.271 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-10-06T03:00:16.271 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2023-10-06T03:00:16.278 INFO:teuthology.run_tasks:Running task mpi... 2023-10-06T03:00:16.290 DEBUG:teuthology.orchestra.run.smithi124:> mpiexec --version 2023-10-06T03:00:16.314 INFO:teuthology.orchestra.run.smithi124.stdout:HYDRA build details: 2023-10-06T03:00:16.314 INFO:teuthology.orchestra.run.smithi124.stdout: Version: 3.3.2 2023-10-06T03:00:16.314 INFO:teuthology.orchestra.run.smithi124.stdout: Release Date: Tue Nov 12 21:23:16 CST 2019 2023-10-06T03:00:16.314 INFO:teuthology.orchestra.run.smithi124.stdout: CC: gcc -Wl,-Bsymbolic-functions -Wl,-z,relro 2023-10-06T03:00:16.314 INFO:teuthology.orchestra.run.smithi124.stdout: CXX: g++ -Wl,-Bsymbolic-functions -Wl,-z,relro 2023-10-06T03:00:16.314 INFO:teuthology.orchestra.run.smithi124.stdout: F77: f77 -Wl,-Bsymbolic-functions -Wl,-z,relro 2023-10-06T03:00:16.315 INFO:teuthology.orchestra.run.smithi124.stdout: F90: f95 -Wl,-Bsymbolic-functions -Wl,-z,relro 2023-10-06T03:00:16.315 INFO:teuthology.orchestra.run.smithi124.stdout: Configure options: '--disable-option-checking' '--prefix=/usr' '--build=x86_64-linux-gnu' '--includedir=${prefix}/include' '--mandir=${prefix}/share/man' '--infodir=${prefix}/share/info' '--sysconfdir=/etc' '--localstatedir=/var' '--disable-silent-rules' '--libdir=${prefix}/lib/x86_64-linux-gnu' '--runstatedir=/run' '--disable-maintainer-mode' '--disable-dependency-tracking' '--with-libfabric' '--enable-shared' '--enable-fortran=all' '--disable-rpath' '--disable-wrapper-rpath' '--sysconfdir=/etc/mpich' '--libdir=/usr/lib/x86_64-linux-gnu' '--includedir=/usr/include/x86_64-linux-gnu/mpich' '--docdir=/usr/share/doc/mpich' 'CPPFLAGS= -Wdate-time -D_FORTIFY_SOURCE=2 -I/build/mpich-VeuB8Z/mpich-3.3.2/src/mpl/include -I/build/mpich-VeuB8Z/mpich-3.3.2/src/mpl/include -I/build/mpich-VeuB8Z/mpich-3.3.2/src/openpa/src -I/build/mpich-VeuB8Z/mpich-3.3.2/src/openpa/src -D_REENTRANT -I/build/mpich-VeuB8Z/mpich-3.3.2/src/mpi/romio/include' 'CFLAGS= -g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -Wformat -Werror=format-security -O2' 'CXXFLAGS= -g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -Wformat -Werror=format-security -O2' 'FFLAGS= -g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -O2' 'FCFLAGS= -g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -cpp -O2' 'BASH_SHELL=/bin/bash' 'build_alias=x86_64-linux-gnu' 'MPICHLIB_CFLAGS=-g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -Wformat -Werror=format-security' 'MPICHLIB_CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' 'MPICHLIB_CXXFLAGS=-g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -Wformat -Werror=format-security' 'MPICHLIB_FFLAGS=-g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong' 'MPICHLIB_FCFLAGS=-g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -cpp' 'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro' 'FC=f95' 'F77=f77' 'MPILIBNAME=mpich' '--cache-file=/dev/null' '--srcdir=.' 'CC=gcc' 'LIBS=' 'MPLLIBNAME=mpl' 2023-10-06T03:00:16.315 INFO:teuthology.orchestra.run.smithi124.stdout: Process Manager: pmi 2023-10-06T03:00:16.315 INFO:teuthology.orchestra.run.smithi124.stdout: Launchers available: ssh rsh fork slurm ll lsf sge manual persist 2023-10-06T03:00:16.315 INFO:teuthology.orchestra.run.smithi124.stdout: Topology libraries available: hwloc 2023-10-06T03:00:16.315 INFO:teuthology.orchestra.run.smithi124.stdout: Resource management kernels available: user slurm ll lsf sge pbs cobalt 2023-10-06T03:00:16.315 INFO:teuthology.orchestra.run.smithi124.stdout: Checkpointing libraries available: 2023-10-06T03:00:16.315 INFO:teuthology.orchestra.run.smithi124.stdout: Demux engines available: poll select 2023-10-06T03:00:16.316 DEBUG:teuthology.orchestra.run.smithi158:> mpiexec --version 2023-10-06T03:00:16.333 INFO:teuthology.orchestra.run.smithi158.stdout:HYDRA build details: 2023-10-06T03:00:16.333 INFO:teuthology.orchestra.run.smithi158.stdout: Version: 3.3.2 2023-10-06T03:00:16.333 INFO:teuthology.orchestra.run.smithi158.stdout: Release Date: Tue Nov 12 21:23:16 CST 2019 2023-10-06T03:00:16.333 INFO:teuthology.orchestra.run.smithi158.stdout: CC: gcc -Wl,-Bsymbolic-functions -Wl,-z,relro 2023-10-06T03:00:16.333 INFO:teuthology.orchestra.run.smithi158.stdout: CXX: g++ -Wl,-Bsymbolic-functions -Wl,-z,relro 2023-10-06T03:00:16.333 INFO:teuthology.orchestra.run.smithi158.stdout: F77: f77 -Wl,-Bsymbolic-functions -Wl,-z,relro 2023-10-06T03:00:16.333 INFO:teuthology.orchestra.run.smithi158.stdout: F90: f95 -Wl,-Bsymbolic-functions -Wl,-z,relro 2023-10-06T03:00:16.333 INFO:teuthology.orchestra.run.smithi158.stdout: Configure options: '--disable-option-checking' '--prefix=/usr' '--build=x86_64-linux-gnu' '--includedir=${prefix}/include' '--mandir=${prefix}/share/man' '--infodir=${prefix}/share/info' '--sysconfdir=/etc' '--localstatedir=/var' '--disable-silent-rules' '--libdir=${prefix}/lib/x86_64-linux-gnu' '--runstatedir=/run' '--disable-maintainer-mode' '--disable-dependency-tracking' '--with-libfabric' '--enable-shared' '--enable-fortran=all' '--disable-rpath' '--disable-wrapper-rpath' '--sysconfdir=/etc/mpich' '--libdir=/usr/lib/x86_64-linux-gnu' '--includedir=/usr/include/x86_64-linux-gnu/mpich' '--docdir=/usr/share/doc/mpich' 'CPPFLAGS= -Wdate-time -D_FORTIFY_SOURCE=2 -I/build/mpich-VeuB8Z/mpich-3.3.2/src/mpl/include -I/build/mpich-VeuB8Z/mpich-3.3.2/src/mpl/include -I/build/mpich-VeuB8Z/mpich-3.3.2/src/openpa/src -I/build/mpich-VeuB8Z/mpich-3.3.2/src/openpa/src -D_REENTRANT -I/build/mpich-VeuB8Z/mpich-3.3.2/src/mpi/romio/include' 'CFLAGS= -g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -Wformat -Werror=format-security -O2' 'CXXFLAGS= -g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -Wformat -Werror=format-security -O2' 'FFLAGS= -g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -O2' 'FCFLAGS= -g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -cpp -O2' 'BASH_SHELL=/bin/bash' 'build_alias=x86_64-linux-gnu' 'MPICHLIB_CFLAGS=-g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -Wformat -Werror=format-security' 'MPICHLIB_CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' 'MPICHLIB_CXXFLAGS=-g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -Wformat -Werror=format-security' 'MPICHLIB_FFLAGS=-g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong' 'MPICHLIB_FCFLAGS=-g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -cpp' 'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro' 'FC=f95' 'F77=f77' 'MPILIBNAME=mpich' '--cache-file=/dev/null' '--srcdir=.' 'CC=gcc' 'LIBS=' 'MPLLIBNAME=mpl' 2023-10-06T03:00:16.333 INFO:teuthology.orchestra.run.smithi158.stdout: Process Manager: pmi 2023-10-06T03:00:16.333 INFO:teuthology.orchestra.run.smithi158.stdout: Launchers available: ssh rsh fork slurm ll lsf sge manual persist 2023-10-06T03:00:16.334 INFO:teuthology.orchestra.run.smithi158.stdout: Topology libraries available: hwloc 2023-10-06T03:00:16.334 INFO:teuthology.orchestra.run.smithi158.stdout: Resource management kernels available: user slurm ll lsf sge pbs cobalt 2023-10-06T03:00:16.334 INFO:teuthology.orchestra.run.smithi158.stdout: Checkpointing libraries available: 2023-10-06T03:00:16.334 INFO:teuthology.orchestra.run.smithi158.stdout: Demux engines available: poll select 2023-10-06T03:00:16.334 DEBUG:teuthology.orchestra.run.smithi174:> mpiexec --version 2023-10-06T03:00:16.352 INFO:teuthology.orchestra.run.smithi174.stdout:HYDRA build details: 2023-10-06T03:00:16.352 INFO:teuthology.orchestra.run.smithi174.stdout: Version: 3.3.2 2023-10-06T03:00:16.352 INFO:teuthology.orchestra.run.smithi174.stdout: Release Date: Tue Nov 12 21:23:16 CST 2019 2023-10-06T03:00:16.352 INFO:teuthology.orchestra.run.smithi174.stdout: CC: gcc -Wl,-Bsymbolic-functions -Wl,-z,relro 2023-10-06T03:00:16.353 INFO:teuthology.orchestra.run.smithi174.stdout: CXX: g++ -Wl,-Bsymbolic-functions -Wl,-z,relro 2023-10-06T03:00:16.353 INFO:teuthology.orchestra.run.smithi174.stdout: F77: f77 -Wl,-Bsymbolic-functions -Wl,-z,relro 2023-10-06T03:00:16.353 INFO:teuthology.orchestra.run.smithi174.stdout: F90: f95 -Wl,-Bsymbolic-functions -Wl,-z,relro 2023-10-06T03:00:16.353 INFO:teuthology.orchestra.run.smithi174.stdout: Configure options: '--disable-option-checking' '--prefix=/usr' '--build=x86_64-linux-gnu' '--includedir=${prefix}/include' '--mandir=${prefix}/share/man' '--infodir=${prefix}/share/info' '--sysconfdir=/etc' '--localstatedir=/var' '--disable-silent-rules' '--libdir=${prefix}/lib/x86_64-linux-gnu' '--runstatedir=/run' '--disable-maintainer-mode' '--disable-dependency-tracking' '--with-libfabric' '--enable-shared' '--enable-fortran=all' '--disable-rpath' '--disable-wrapper-rpath' '--sysconfdir=/etc/mpich' '--libdir=/usr/lib/x86_64-linux-gnu' '--includedir=/usr/include/x86_64-linux-gnu/mpich' '--docdir=/usr/share/doc/mpich' 'CPPFLAGS= -Wdate-time -D_FORTIFY_SOURCE=2 -I/build/mpich-VeuB8Z/mpich-3.3.2/src/mpl/include -I/build/mpich-VeuB8Z/mpich-3.3.2/src/mpl/include -I/build/mpich-VeuB8Z/mpich-3.3.2/src/openpa/src -I/build/mpich-VeuB8Z/mpich-3.3.2/src/openpa/src -D_REENTRANT -I/build/mpich-VeuB8Z/mpich-3.3.2/src/mpi/romio/include' 'CFLAGS= -g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -Wformat -Werror=format-security -O2' 'CXXFLAGS= -g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -Wformat -Werror=format-security -O2' 'FFLAGS= -g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -O2' 'FCFLAGS= -g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -cpp -O2' 'BASH_SHELL=/bin/bash' 'build_alias=x86_64-linux-gnu' 'MPICHLIB_CFLAGS=-g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -Wformat -Werror=format-security' 'MPICHLIB_CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' 'MPICHLIB_CXXFLAGS=-g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -Wformat -Werror=format-security' 'MPICHLIB_FFLAGS=-g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong' 'MPICHLIB_FCFLAGS=-g -O2 -fdebug-prefix-map=/build/mpich-VeuB8Z/mpich-3.3.2=. -fstack-protector-strong -cpp' 'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro' 'FC=f95' 'F77=f77' 'MPILIBNAME=mpich' '--cache-file=/dev/null' '--srcdir=.' 'CC=gcc' 'LIBS=' 'MPLLIBNAME=mpl' 2023-10-06T03:00:16.353 INFO:teuthology.orchestra.run.smithi174.stdout: Process Manager: pmi 2023-10-06T03:00:16.353 INFO:teuthology.orchestra.run.smithi174.stdout: Launchers available: ssh rsh fork slurm ll lsf sge manual persist 2023-10-06T03:00:16.353 INFO:teuthology.orchestra.run.smithi174.stdout: Topology libraries available: hwloc 2023-10-06T03:00:16.353 INFO:teuthology.orchestra.run.smithi174.stdout: Resource management kernels available: user slurm ll lsf sge pbs cobalt 2023-10-06T03:00:16.353 INFO:teuthology.orchestra.run.smithi174.stdout: Checkpointing libraries available: 2023-10-06T03:00:16.353 INFO:teuthology.orchestra.run.smithi174.stdout: Demux engines available: poll select 2023-10-06T03:00:16.354 INFO:teuthology.task.mpi:MPI version 3.3.2 2023-10-06T03:00:16.354 INFO:teuthology.task.mpi:mpi rank 0 is: ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T03:00:16.354 INFO:teuthology.task.mpi:mpi nodes: [172.21.15.124, 172.21.15.158, 172.21.15.174] 2023-10-06T03:00:16.354 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-06T03:00:16.354 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/mpi-hosts 2023-10-06T03:00:16.361 INFO:teuthology.task.mpi:mpiexec on ubuntu@smithi124.front.sepia.ceph.com: /home/ubuntu/cephtest/mdtest-1.9.3/mdtest -d /home/ubuntu/cephtest/gmnt -I 20 -z 5 -b 2 -R 2023-10-06T03:00:16.361 DEBUG:teuthology.orchestra.run.smithi124:> mpiexec -f /home/ubuntu/cephtest/mpi-hosts /home/ubuntu/cephtest/mdtest-1.9.3/mdtest -d /home/ubuntu/cephtest/gmnt -I 20 -z 5 -b 2 -R 2023-10-06T03:00:16.460 INFO:teuthology.orchestra.run.smithi124.stderr:Warning: Permanently added '172.21.15.158' (ECDSA) to the list of known hosts. 2023-10-06T03:00:16.461 INFO:teuthology.orchestra.run.smithi124.stderr:Warning: Permanently added '172.21.15.174' (ECDSA) to the list of known hosts. 2023-10-06T03:00:16.745 INFO:teuthology.orchestra.run.smithi124.stdout:-- started at 10/06/2023 03:00:16 -- 2023-10-06T03:00:16.745 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T03:00:16.746 INFO:teuthology.orchestra.run.smithi124.stdout:mdtest-1.9.3 was launched with 3 total task(s) on 3 node(s) 2023-10-06T03:00:16.746 INFO:teuthology.orchestra.run.smithi124.stdout:Command line used: /home/ubuntu/cephtest/mdtest-1.9.3/mdtest -d /home/ubuntu/cephtest/gmnt -I 20 -z 5 -b 2 -R 2023-10-06T03:00:16.746 INFO:teuthology.orchestra.run.smithi124.stdout:Path: /home/ubuntu/cephtest 2023-10-06T03:00:16.746 INFO:teuthology.orchestra.run.smithi124.stdout:FS: 915.8 GiB Used FS: 1.5% Inodes: 58.2 Mi Used Inodes: 0.5% 2023-10-06T03:00:16.746 INFO:teuthology.orchestra.run.smithi124.stdout:random seed: 1696561216 2023-10-06T03:00:16.747 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T03:00:16.747 INFO:teuthology.orchestra.run.smithi124.stdout:3 tasks, 3780 files/directories 2023-10-06T03:00:20.680 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:20.683 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:20.685 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:20.687 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:20.690 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:50.997 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:51.000 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:51.003 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:51.005 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:51.008 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:21.076 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:21.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:21.081 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:21.083 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:21.086 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:51.145 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:51.149 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:51.152 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:51.155 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:51.158 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:21.222 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:21.225 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:21.228 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:21.230 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:21.232 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:51.314 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:51.317 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:51.319 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:51.322 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:51.324 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:21.377 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:21.379 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:21.382 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:21.384 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:21.387 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:51.470 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:51.473 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:51.475 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:51.478 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:51.480 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:21.586 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:21.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:21.592 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:21.594 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:21.596 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:51.682 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:51.685 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:51.687 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:51.689 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:51.692 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:05:21.847 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:05:21.849 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:05:21.852 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:05:21.854 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:05:21.856 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:05:51.909 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:05:51.912 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:05:51.914 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:05:51.916 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:05:51.919 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:21.988 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:21.991 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:21.993 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:21.995 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:21.998 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:52.095 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:52.098 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:52.101 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:52.103 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:52.105 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:22.163 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:22.166 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:22.169 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:22.171 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:22.174 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:52.220 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:52.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:52.225 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:52.228 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:52.230 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:08:22.301 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:08:22.304 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:08:22.307 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:08:22.310 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:08:22.313 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:08:52.366 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:08:52.368 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:08:52.370 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:08:52.372 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:08:52.375 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:09:22.444 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:09:22.447 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:09:22.449 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:09:22.452 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:09:22.455 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:09:36.069 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T03:09:36.069 INFO:teuthology.orchestra.run.smithi124.stdout:SUMMARY: (of 1 iterations) 2023-10-06T03:09:36.069 INFO:teuthology.orchestra.run.smithi124.stdout: Operation Max Min Mean Std Dev 2023-10-06T03:09:36.069 INFO:teuthology.orchestra.run.smithi124.stdout: --------- --- --- ---- ------- 2023-10-06T03:09:36.070 INFO:teuthology.orchestra.run.smithi124.stdout: Directory creation: 218.432 218.432 218.432 0.000 2023-10-06T03:09:36.070 INFO:teuthology.orchestra.run.smithi124.stdout: Directory stat : 942.148 942.148 942.148 0.000 2023-10-06T03:09:36.070 INFO:teuthology.orchestra.run.smithi124.stdout: Directory removal : 7.853 7.853 7.853 0.000 2023-10-06T03:09:36.070 INFO:teuthology.orchestra.run.smithi124.stdout: File creation : 169.314 169.314 169.314 0.000 2023-10-06T03:09:36.070 INFO:teuthology.orchestra.run.smithi124.stdout: File stat : 2358.201 2358.201 2358.201 0.000 2023-10-06T03:09:36.070 INFO:teuthology.orchestra.run.smithi124.stdout: File read : 476.001 476.001 476.001 0.000 2023-10-06T03:09:36.070 INFO:teuthology.orchestra.run.smithi124.stdout: File removal : 161.900 161.900 161.900 0.000 2023-10-06T03:09:36.070 INFO:teuthology.orchestra.run.smithi124.stdout: Tree creation : 223.831 223.831 223.831 0.000 2023-10-06T03:09:36.070 INFO:teuthology.orchestra.run.smithi124.stdout: Tree removal : 60.405 60.405 60.405 0.000 2023-10-06T03:09:36.070 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-06T03:09:36.070 INFO:teuthology.orchestra.run.smithi124.stdout:-- finished at 10/06/2023 03:09:36 -- 2023-10-06T03:09:36.255 INFO:teuthology.task.mpi:mpi task completed 2023-10-06T03:09:36.256 DEBUG:teuthology.orchestra.run.smithi124:> rm /home/ubuntu/cephtest/mpi-hosts 2023-10-06T03:09:36.262 INFO:teuthology.run_tasks:Running task pexec... 2023-10-06T03:09:36.273 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-06T03:09:36.274 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T03:09:36.274 DEBUG:teuthology.orchestra.run.smithi124:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-06T03:09:36.274 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T03:09:36.275 DEBUG:teuthology.orchestra.run.smithi158:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-06T03:09:36.275 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi174.front.sepia.ceph.com 2023-10-06T03:09:36.275 DEBUG:teuthology.orchestra.run.smithi174:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-06T03:09:36.319 DEBUG:teuthology.parallel:result is None 2023-10-06T03:09:36.325 DEBUG:teuthology.parallel:result is None 2023-10-06T03:09:36.326 DEBUG:teuthology.parallel:result is None 2023-10-06T03:09:36.326 DEBUG:teuthology.run_tasks:Unwinding manager ssh_keys 2023-10-06T03:09:36.335 INFO:teuthology.task.ssh_keys:Cleaning up SSH keys 2023-10-06T03:09:36.335 INFO:teuthology.task.ssh_keys:cleaning up keys added for testing 2023-10-06T03:09:36.336 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi027.front.sepia.ceph.com 2023-10-06T03:09:36.336 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/.ssh/id_rsa 2023-10-06T03:09:36.343 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:09:36.391 DEBUG:teuthology.orchestra.run.smithi027:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.397 INFO:teuthology.orchestra.run.smithi027.stdout:"600" 2023-10-06T03:09:36.398 DEBUG:teuthology.orchestra.run.smithi027:> mv -- /home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:15:883687 /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.406 DEBUG:teuthology.orchestra.run.smithi027:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.412 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi123.front.sepia.ceph.com 2023-10-06T03:09:36.412 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/.ssh/id_rsa 2023-10-06T03:09:36.420 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:09:36.467 DEBUG:teuthology.orchestra.run.smithi123:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.473 INFO:teuthology.orchestra.run.smithi123.stdout:"600" 2023-10-06T03:09:36.474 DEBUG:teuthology.orchestra.run.smithi123:> mv -- /home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:16:011793 /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.481 DEBUG:teuthology.orchestra.run.smithi123:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.486 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi124.front.sepia.ceph.com 2023-10-06T03:09:36.486 DEBUG:teuthology.orchestra.run.smithi124:> rm -- /home/ubuntu/.ssh/id_rsa 2023-10-06T03:09:36.493 DEBUG:teuthology.orchestra.run.smithi124:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:09:36.499 DEBUG:teuthology.orchestra.run.smithi124:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.506 INFO:teuthology.orchestra.run.smithi124.stdout:"600" 2023-10-06T03:09:36.506 DEBUG:teuthology.orchestra.run.smithi124:> mv -- /home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:16:097657 /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.510 DEBUG:teuthology.orchestra.run.smithi124:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.569 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi158.front.sepia.ceph.com 2023-10-06T03:09:36.570 DEBUG:teuthology.orchestra.run.smithi158:> rm -- /home/ubuntu/.ssh/id_rsa 2023-10-06T03:09:36.577 DEBUG:teuthology.orchestra.run.smithi158:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:09:36.585 DEBUG:teuthology.orchestra.run.smithi158:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.639 INFO:teuthology.orchestra.run.smithi158.stdout:"600" 2023-10-06T03:09:36.639 DEBUG:teuthology.orchestra.run.smithi158:> mv -- /home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:16:137090 /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.647 DEBUG:teuthology.orchestra.run.smithi158:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.697 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi174.front.sepia.ceph.com 2023-10-06T03:09:36.698 DEBUG:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/.ssh/id_rsa 2023-10-06T03:09:36.707 DEBUG:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2023-10-06T03:09:36.756 DEBUG:teuthology.orchestra.run.smithi174:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.762 INFO:teuthology.orchestra.run.smithi174.stdout:"600" 2023-10-06T03:09:36.762 DEBUG:teuthology.orchestra.run.smithi174:> mv -- /home/ubuntu/.ssh/authorized_keys_2023-10-06_03:00:16:263371 /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.769 DEBUG:teuthology.orchestra.run.smithi174:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2023-10-06T03:09:36.775 DEBUG:teuthology.orchestra.run.smithi027:> rm /home/ubuntu/.ssh/config 2023-10-06T03:09:36.778 DEBUG:teuthology.orchestra.run.smithi123:> rm /home/ubuntu/.ssh/config 2023-10-06T03:09:36.781 DEBUG:teuthology.orchestra.run.smithi124:> rm /home/ubuntu/.ssh/config 2023-10-06T03:09:36.783 DEBUG:teuthology.orchestra.run.smithi158:> rm /home/ubuntu/.ssh/config 2023-10-06T03:09:36.786 DEBUG:teuthology.orchestra.run.smithi174:> rm /home/ubuntu/.ssh/config 2023-10-06T03:09:36.793 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-06T03:09:36.806 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-06T03:09:36.806 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi124.front.sepia.ceph.com... 2023-10-06T03:09:36.806 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:09:36.806 DEBUG:teuthology.orchestra.run.smithi124:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T03:09:36.835 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi124.stderr:ceph-fuse[28627]: fuse finished with error 0 and tester_r 0 2023-10-06T03:09:36.836 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:09:42.937 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T03:09:42.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:09:42.937 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:09:42.961 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2023-10-06T03:09:42.962 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:09:42.962 DEBUG:teuthology.orchestra.run.smithi158:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-06T03:09:42.994 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[28531]: fuse finished with error 0 and tester_r 0 2023-10-06T03:09:42.994 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:09:49.096 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T03:09:49.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:09:49.097 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:09:49.113 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi174.front.sepia.ceph.com... 2023-10-06T03:09:49.113 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:09:49.113 DEBUG:teuthology.orchestra.run.smithi174:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-06T03:09:49.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi174.stderr:ceph-fuse[28580]: fuse finished with error 0 and tester_r 0 2023-10-06T03:09:49.139 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:09:52.524 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:09:52.527 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:09:52.529 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:09:52.531 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:09:52.534 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:09:55.240 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2023-10-06T03:09:55.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:09:55.240 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T03:09:55.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:09:55.260 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-06T03:09:55.267 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:09:55.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:09:55.267 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:09:55.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:09:55.283 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-10-06T03:09:55.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:09:55.473 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2023-10-06T03:09:55.480 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 0) 2023-10-06T03:09:55.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:09:55.481 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:09:55.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:09:55.497 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2023-10-06T03:09:55.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:09:55.663 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-06T03:09:55.671 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:09:55.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:09:55.671 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:09:55.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:09:55.732 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link delete ceph-brx 2023-10-06T03:09:55.845 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T03:09:55.854 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T03:09:55.855 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:09:55.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.965+0000 7fe159729700 1 Processor -- start 2023-10-06T03:09:55.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.965+0000 7fe159729700 1 -- start start 2023-10-06T03:09:55.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe159729700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe1540b9c50 0x7fe1540ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:55.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe159729700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15409ef80 con 0x7fe1540bb2c0 2023-10-06T03:09:55.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe159729700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1540a3990 con 0x7fe1540a3550 2023-10-06T03:09:55.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe159729700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1540a0f20 con 0x7fe1540b9c50 2023-10-06T03:09:55.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe1537fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe1540bb2c0 0x7fe15406c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46190/0 (socket says 172.21.15.27:46190) 2023-10-06T03:09:55.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe1537fe700 1 -- 172.21.15.27:0/4150879990 learned_addr learned my addr 172.21.15.27:0/4150879990 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:09:55.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe153fff700 1 --2- 172.21.15.27:0/4150879990 >> v2:172.21.15.123:3300/0 conn(0x7fe1540b9c50 0x7fe1540ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:55.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002241617 0 0) 0x7fe15409ef80 con 0x7fe1540bb2c0 2023-10-06T03:09:55.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe13c003570 con 0x7fe1540bb2c0 2023-10-06T03:09:55.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4279256087 0 0) 0x7fe13c003570 con 0x7fe1540bb2c0 2023-10-06T03:09:55.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 >> v2:172.21.15.123:3300/0 conn(0x7fe1540b9c50 msgr2=0x7fe1540ba020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:09:55.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 --2- 172.21.15.27:0/4150879990 >> v2:172.21.15.123:3300/0 conn(0x7fe1540b9c50 0x7fe1540ba020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:55.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 >> v1:172.21.15.123:6789/0 conn(0x7fe1540a3550 legacy=0x7fe15409f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:55.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1540a2c50 con 0x7fe1540bb2c0 2023-10-06T03:09:55.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1323929577 0 0) 0x7fe1440017f0 con 0x7fe1540bb2c0 2023-10-06T03:09:55.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 >> v1:172.21.15.27:6789/0 conn(0x7fe1540bb2c0 legacy=0x7fe15406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:55.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 --2- 172.21.15.27:0/4150879990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe13c003a60 0x7fe13c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:55.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 --2- 172.21.15.27:0/4150879990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c004810 0x7fe13c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:55.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 --2- 172.21.15.27:0/4150879990 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe13c0051c0 0x7fe13c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c00c050 con 0x7fe13c003a60 2023-10-06T03:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe153fff700 1 --2- 172.21.15.27:0/4150879990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe13c003a60 0x7fe13c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c00c190 con 0x7fe13c004810 2023-10-06T03:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c00c350 con 0x7fe13c0051c0 2023-10-06T03:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe1537fe700 1 --2- 172.21.15.27:0/4150879990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c004810 0x7fe13c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe158f28700 1 --2- 172.21.15.27:0/4150879990 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe13c0051c0 0x7fe13c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe153fff700 1 -- 172.21.15.27:0/4150879990 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe13c0051c0 msgr2=0x7fe13c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe153fff700 1 --2- 172.21.15.27:0/4150879990 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe13c0051c0 0x7fe13c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe153fff700 1 -- 172.21.15.27:0/4150879990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c004810 msgr2=0x7fe13c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe153fff700 1 --2- 172.21.15.27:0/4150879990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c004810 0x7fe13c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe153fff700 1 -- 172.21.15.27:0/4150879990 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c003570 con 0x7fe13c003a60 2023-10-06T03:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe158f28700 1 -- 172.21.15.27:0/4150879990 reap_dead start 2023-10-06T03:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe153fff700 1 --2- 172.21.15.27:0/4150879990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe13c003a60 0x7fe13c003e30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe148009c00 tx=0x7fe1480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409c8c4fc90e865a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14800e710 con 0x7fe13c003a60 2023-10-06T03:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14800e870 con 0x7fe13c003a60 2023-10-06T03:09:55.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.969+0000 7fe152ffd700 1 -- 172.21.15.27:0/4150879990 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14800ec30 con 0x7fe13c003a60 2023-10-06T03:09:55.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 -- 172.21.15.27:0/4150879990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe13c003a60 msgr2=0x7fe13c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:55.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 --2- 172.21.15.27:0/4150879990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe13c003a60 0x7fe13c003e30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe148009c00 tx=0x7fe1480091a0 comp rx=0 tx=0).stop 2023-10-06T03:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 -- 172.21.15.27:0/4150879990 shutdown_connections 2023-10-06T03:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 --2- 172.21.15.27:0/4150879990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe13c003a60 0x7fe13c003e30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 -- 172.21.15.27:0/4150879990 >> 172.21.15.27:0/4150879990 conn(0x7fe15406eb10 msgr2=0x7fe1540ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 -- 172.21.15.27:0/4150879990 shutdown_connections 2023-10-06T03:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 -- 172.21.15.27:0/4150879990 wait complete. 2023-10-06T03:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 Processor -- start 2023-10-06T03:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 -- start start 2023-10-06T03:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe13c003a60 0x7fe1541626a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe154068550 0x7fe15414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154162be0 0x7fe15414b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:55.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe154153b30 con 0x7fe154162be0 2023-10-06T03:09:55.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe154163440 con 0x7fe154068550 2023-10-06T03:09:55.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe159729700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe154153850 con 0x7fe13c003a60 2023-10-06T03:09:55.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe158f28700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154162be0 0x7fe15414b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:55.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe158f28700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154162be0 0x7fe15414b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50762/0 (socket says 172.21.15.27:50762) 2023-10-06T03:09:55.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe153fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe13c003a60 0x7fe1541626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:55.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe158f28700 1 -- 172.21.15.27:0/4086202838 learned_addr learned my addr 172.21.15.27:0/4086202838 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.973+0000 7fe1537fe700 1 --2- 172.21.15.27:0/4086202838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe154068550 0x7fe15414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.977+0000 7fe158f28700 1 -- 172.21.15.27:0/4086202838 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe13c003a60 msgr2=0x7fe1541626a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.977+0000 7fe158f28700 1 --2- 172.21.15.27:0/4086202838 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe13c003a60 0x7fe1541626a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.977+0000 7fe158f28700 1 -- 172.21.15.27:0/4086202838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe154068550 msgr2=0x7fe15414b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.977+0000 7fe158f28700 1 --2- 172.21.15.27:0/4086202838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe154068550 0x7fe15414b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.977+0000 7fe158f28700 1 -- 172.21.15.27:0/4086202838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1541630d0 con 0x7fe154162be0 2023-10-06T03:09:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.977+0000 7fe158f28700 1 --2- 172.21.15.27:0/4086202838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154162be0 0x7fe15414b680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe15406f300 tx=0x7fe14c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.977+0000 7fe13bfff700 1 -- 172.21.15.27:0/4086202838 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c018070 con 0x7fe154162be0 2023-10-06T03:09:55.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.977+0000 7fe13bfff700 1 -- 172.21.15.27:0/4086202838 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c006820 con 0x7fe154162be0 2023-10-06T03:09:55.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.977+0000 7fe159729700 1 -- 172.21.15.27:0/4086202838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15414bbc0 con 0x7fe154162be0 2023-10-06T03:09:55.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.977+0000 7fe13bfff700 1 -- 172.21.15.27:0/4086202838 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c006ba0 con 0x7fe154162be0 2023-10-06T03:09:55.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.977+0000 7fe159729700 1 -- 172.21.15.27:0/4086202838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe154069f70 con 0x7fe154162be0 2023-10-06T03:09:55.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.977+0000 7fe159729700 1 -- 172.21.15.27:0/4086202838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1540674b0 con 0x7fe154162be0 2023-10-06T03:09:55.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.977+0000 7fe13bfff700 1 -- 172.21.15.27:0/4086202838 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe14c006fd0 con 0x7fe154162be0 2023-10-06T03:09:55.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.981+0000 7fe13bfff700 1 --2- 172.21.15.27:0/4086202838 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe140060550 0x7fe140062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:55.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.981+0000 7fe13bfff700 1 -- 172.21.15.27:0/4086202838 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe14c07c390 con 0x7fe154162be0 2023-10-06T03:09:55.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.981+0000 7fe153fff700 1 --2- 172.21.15.27:0/4086202838 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe140060550 0x7fe140062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:55.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.981+0000 7fe153fff700 1 --2- 172.21.15.27:0/4086202838 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe140060550 0x7fe140062a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe1480091e0 tx=0x7fe14801a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:55.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:55.985+0000 7fe13bfff700 1 -- 172.21.15.27:0/4086202838 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe14c04c740 con 0x7fe154162be0 2023-10-06T03:09:56.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.149+0000 7fe159729700 1 -- 172.21.15.27:0/4086202838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe154069f70 con 0x7fe154162be0 2023-10-06T03:09:56.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.153+0000 7fe13bfff700 1 -- 172.21.15.27:0/4086202838 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16961 (secure 0 0 0) 0x7fe154069f70 con 0x7fe154162be0 2023-10-06T03:09:56.154 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:09:56.154 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":26,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T03:00:34.725027+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:59:47.570918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:51.949130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:52.638817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:09:56.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.153+0000 7fe159729700 1 -- 172.21.15.27:0/4086202838 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe140060550 msgr2=0x7fe140062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.153+0000 7fe159729700 1 --2- 172.21.15.27:0/4086202838 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe140060550 0x7fe140062a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe1480091e0 tx=0x7fe14801a000 comp rx=0 tx=0).stop 2023-10-06T03:09:56.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.153+0000 7fe159729700 1 -- 172.21.15.27:0/4086202838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154162be0 msgr2=0x7fe15414b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.153+0000 7fe159729700 1 --2- 172.21.15.27:0/4086202838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154162be0 0x7fe15414b680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe15406f300 tx=0x7fe14c007d10 comp rx=0 tx=0).stop 2023-10-06T03:09:56.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.153+0000 7fe159729700 1 -- 172.21.15.27:0/4086202838 shutdown_connections 2023-10-06T03:09:56.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.153+0000 7fe159729700 1 --2- 172.21.15.27:0/4086202838 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fe140060550 0x7fe140062a00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.153+0000 7fe159729700 1 --2- 172.21.15.27:0/4086202838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154162be0 0x7fe15414b680 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.153+0000 7fe159729700 1 --2- 172.21.15.27:0/4086202838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe154068550 0x7fe15414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.153+0000 7fe159729700 1 --2- 172.21.15.27:0/4086202838 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe13c003a60 0x7fe1541626a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.153+0000 7fe159729700 1 -- 172.21.15.27:0/4086202838 >> 172.21.15.27:0/4086202838 conn(0x7fe15406eb10 msgr2=0x7fe15409f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:56.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.153+0000 7fe159729700 1 -- 172.21.15.27:0/4086202838 shutdown_connections 2023-10-06T03:09:56.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.153+0000 7fe159729700 1 -- 172.21.15.27:0/4086202838 wait complete. 2023-10-06T03:09:56.168 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:09:56.169 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:09:56.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.269+0000 7f6931e84700 1 Processor -- start 2023-10-06T03:09:56.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.269+0000 7f6931e84700 1 -- start start 2023-10-06T03:09:56.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931e84700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f692c0b9c50 0x7f692c0ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931e84700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f692c0a3550 0x7f692c09f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931e84700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c09ef80 con 0x7f692c0bb2c0 2023-10-06T03:09:56.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931e84700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692c0a0f20 con 0x7f692c0b9c50 2023-10-06T03:09:56.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931e84700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c0a39d0 con 0x7f692c0a3550 2023-10-06T03:09:56.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f692bfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f692c0bb2c0 0x7f692c06c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46200/0 (socket says 172.21.15.27:46200) 2023-10-06T03:09:56.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f692bfff700 1 -- 172.21.15.27:0/1564053396 learned_addr learned my addr 172.21.15.27:0/1564053396 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:09:56.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6930e82700 1 --2- 172.21.15.27:0/1564053396 >> v2:172.21.15.123:3300/0 conn(0x7f692c0b9c50 0x7f692c0ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931683700 1 --2- 172.21.15.27:0/1564053396 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f692c0a3550 0x7f692c09f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f692b7fe700 1 -- 172.21.15.27:0/1564053396 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445434782 0 0) 0x7f692c09ef80 con 0x7f692c0bb2c0 2023-10-06T03:09:56.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f692b7fe700 1 -- 172.21.15.27:0/1564053396 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6918003570 con 0x7f692c0bb2c0 2023-10-06T03:09:56.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6930e82700 1 -- 172.21.15.27:0/1564053396 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f692c0a3550 msgr2=0x7f692c09f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:09:56.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6930e82700 1 --2- 172.21.15.27:0/1564053396 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f692c0a3550 0x7f692c09f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6930e82700 1 -- 172.21.15.27:0/1564053396 >> v1:172.21.15.27:6789/0 conn(0x7f692c0bb2c0 legacy=0x7f692c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f692b7fe700 1 -- 172.21.15.27:0/1564053396 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2514739332 0 0) 0x7f6918003570 con 0x7f692c0bb2c0 2023-10-06T03:09:56.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6930e82700 1 -- 172.21.15.27:0/1564053396 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c0a2c50 con 0x7f692c0b9c50 2023-10-06T03:09:56.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6930e82700 1 --2- 172.21.15.27:0/1564053396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f692c0b9c50 0x7f692c0ba020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f691c009e60 tx=0x7f691c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d4eb424bef16e99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f692b7fe700 1 -- 172.21.15.27:0/1564053396 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c00e070 con 0x7f692c0b9c50 2023-10-06T03:09:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f692b7fe700 1 -- 172.21.15.27:0/1564053396 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c00b7a0 con 0x7f692c0b9c50 2023-10-06T03:09:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f692b7fe700 1 -- 172.21.15.27:0/1564053396 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914001470 con 0x7f692c0b9c50 2023-10-06T03:09:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931e84700 1 -- 172.21.15.27:0/1564053396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f692c0b9c50 msgr2=0x7f692c0ba020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931e84700 1 --2- 172.21.15.27:0/1564053396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f692c0b9c50 0x7f692c0ba020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f691c009e60 tx=0x7f691c009780 comp rx=0 tx=0).stop 2023-10-06T03:09:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931e84700 1 -- 172.21.15.27:0/1564053396 shutdown_connections 2023-10-06T03:09:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931e84700 1 --2- 172.21.15.27:0/1564053396 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f692c0a3550 0x7f692c09f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931e84700 1 --2- 172.21.15.27:0/1564053396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f692c0b9c50 0x7f692c0ba020 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931e84700 1 -- 172.21.15.27:0/1564053396 >> 172.21.15.27:0/1564053396 conn(0x7f692c06eb10 msgr2=0x7f692c0ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:56.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931e84700 1 -- 172.21.15.27:0/1564053396 shutdown_connections 2023-10-06T03:09:56.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.273+0000 7f6931e84700 1 -- 172.21.15.27:0/1564053396 wait complete. 2023-10-06T03:09:56.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6931e84700 1 Processor -- start 2023-10-06T03:09:56.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6931e84700 1 -- start start 2023-10-06T03:09:56.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6931e84700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f692c0a3550 0x7f692c153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6931e84700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f692c0b9c50 0x7f692c14c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6931e84700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f692c0bb2c0 0x7f692c14cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6931e84700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c06b520 con 0x7f692c0b9c50 2023-10-06T03:09:56.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6931e84700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c069090 con 0x7f692c0a3550 2023-10-06T03:09:56.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6931e84700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c153a80 con 0x7f692c0bb2c0 2023-10-06T03:09:56.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f692bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f692c0b9c50 0x7f692c14c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f692bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f692c0b9c50 0x7f692c14c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50778/0 (socket says 172.21.15.27:50778) 2023-10-06T03:09:56.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6930e82700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f692c0a3550 0x7f692c153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f692bfff700 1 -- 172.21.15.27:0/2035814341 learned_addr learned my addr 172.21.15.27:0/2035814341 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:56.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6931683700 1 --2- 172.21.15.27:0/2035814341 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f692c0bb2c0 0x7f692c14cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f692bfff700 1 -- 172.21.15.27:0/2035814341 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f692c0bb2c0 msgr2=0x7f692c14cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f692bfff700 1 --2- 172.21.15.27:0/2035814341 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f692c0bb2c0 0x7f692c14cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f692bfff700 1 -- 172.21.15.27:0/2035814341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f692c0a3550 msgr2=0x7f692c153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f692bfff700 1 --2- 172.21.15.27:0/2035814341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f692c0a3550 0x7f692c153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f692bfff700 1 -- 172.21.15.27:0/2035814341 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c009a20 con 0x7f692c0b9c50 2023-10-06T03:09:56.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f692bfff700 1 --2- 172.21.15.27:0/2035814341 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f692c0b9c50 0x7f692c14c6b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f691400cb90 tx=0x7f6914001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:56.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6928ff9700 1 -- 172.21.15.27:0/2035814341 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914007150 con 0x7f692c0b9c50 2023-10-06T03:09:56.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6928ff9700 1 -- 172.21.15.27:0/2035814341 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69140072d0 con 0x7f692c0b9c50 2023-10-06T03:09:56.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6931e84700 1 -- 172.21.15.27:0/2035814341 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692c069330 con 0x7f692c0b9c50 2023-10-06T03:09:56.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6928ff9700 1 -- 172.21.15.27:0/2035814341 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914007690 con 0x7f692c0b9c50 2023-10-06T03:09:56.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.277+0000 7f6931e84700 1 -- 172.21.15.27:0/2035814341 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c15f5b0 con 0x7f692c0b9c50 2023-10-06T03:09:56.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.281+0000 7f6931e84700 1 -- 172.21.15.27:0/2035814341 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692c0674b0 con 0x7f692c0b9c50 2023-10-06T03:09:56.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.281+0000 7f6928ff9700 1 -- 172.21.15.27:0/2035814341 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6914004a40 con 0x7f692c0b9c50 2023-10-06T03:09:56.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.281+0000 7f6928ff9700 1 --2- 172.21.15.27:0/2035814341 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f690c060550 0x7f690c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.281+0000 7f6928ff9700 1 -- 172.21.15.27:0/2035814341 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f691407c020 con 0x7f692c0b9c50 2023-10-06T03:09:56.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.281+0000 7f6930e82700 1 --2- 172.21.15.27:0/2035814341 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f690c060550 0x7f690c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.281+0000 7f6930e82700 1 --2- 172.21.15.27:0/2035814341 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f690c060550 0x7f690c062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f691c0099f0 tx=0x7f691c018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:56.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.289+0000 7f6928ff9700 1 -- 172.21.15.27:0/2035814341 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f691404c4f0 con 0x7f692c0b9c50 2023-10-06T03:09:56.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.441+0000 7f6931e84700 1 -- 172.21.15.27:0/2035814341 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f692c04b600 con 0x7f690c060550 2023-10-06T03:09:56.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.461+0000 7f6928ff9700 1 -- 172.21.15.27:0/2035814341 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310316 (secure 0 0 0) 0x7f692c04b600 con 0x7f690c060550 2023-10-06T03:09:56.468 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:09:56.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.469+0000 7f6931e84700 1 -- 172.21.15.27:0/2035814341 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f690c060550 msgr2=0x7f690c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.469+0000 7f6931e84700 1 --2- 172.21.15.27:0/2035814341 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f690c060550 0x7f690c062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f691c0099f0 tx=0x7f691c018000 comp rx=0 tx=0).stop 2023-10-06T03:09:56.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.469+0000 7f6931e84700 1 -- 172.21.15.27:0/2035814341 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f692c0b9c50 msgr2=0x7f692c14c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.469+0000 7f6931e84700 1 --2- 172.21.15.27:0/2035814341 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f692c0b9c50 0x7f692c14c6b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f691400cb90 tx=0x7f6914001ab0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.469+0000 7f6931e84700 1 -- 172.21.15.27:0/2035814341 shutdown_connections 2023-10-06T03:09:56.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.469+0000 7f6931e84700 1 --2- 172.21.15.27:0/2035814341 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f690c060550 0x7f690c062a00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.469+0000 7f6931e84700 1 --2- 172.21.15.27:0/2035814341 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f692c0bb2c0 0x7f692c14cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.469+0000 7f6931e84700 1 --2- 172.21.15.27:0/2035814341 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f692c0b9c50 0x7f692c14c6b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.469+0000 7f6931e84700 1 --2- 172.21.15.27:0/2035814341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f692c0a3550 0x7f692c153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.469+0000 7f6931e84700 1 -- 172.21.15.27:0/2035814341 >> 172.21.15.27:0/2035814341 conn(0x7f692c06eb10 msgr2=0x7f692c0a1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:56.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.469+0000 7f6931e84700 1 -- 172.21.15.27:0/2035814341 shutdown_connections 2023-10-06T03:09:56.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.469+0000 7f6931e84700 1 -- 172.21.15.27:0/2035814341 wait complete. 2023-10-06T03:09:56.472 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-10-06T03:09:56.484 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2023-10-06T03:09:55.183383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76103972,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":599,"num_read_kb":1179,"num_write":11705,"num_write_kb":82701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20586,"ondisk_log_size":20586,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2570144,"kb_used_data":150880,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752404576,"statfs":{"total":773094113280,"available":770462285824,"internally_reserved":0,"allocated":154501120,"data_stored":153061288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":69,"apply_latency_ms":69,"commit_latency_ns":69000000,"apply_latency_ns":69000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1161,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004546"},"pg_stats":[{"pgid":"4.3f","version":"26'91","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205300+0000","last_change":"2023-10-06T02:59:53.681789+0000","last_active":"2023-10-06T03:09:49.205300+0000","last_peered":"2023-10-06T03:09:49.205300+0000","last_clean":"2023-10-06T03:09:49.205300+0000","last_became_active":"2023-10-06T02:59:53.681495+0000","last_became_peered":"2023-10-06T02:59:53.681495+0000","last_unstale":"2023-10-06T03:09:49.205300+0000","last_undegraded":"2023-10-06T03:09:49.205300+0000","last_fullsized":"2023-10-06T03:09:49.205300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:19.626429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194862+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T03:09:49.194862+0000","last_peered":"2023-10-06T03:09:49.194862+0000","last_clean":"2023-10-06T03:09:49.194862+0000","last_became_active":"2023-10-06T02:59:53.681849+0000","last_became_peered":"2023-10-06T02:59:53.681849+0000","last_unstale":"2023-10-06T03:09:49.194862+0000","last_undegraded":"2023-10-06T03:09:49.194862+0000","last_fullsized":"2023-10-06T03:09:49.194862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"26'65","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195589+0000","last_change":"2023-10-06T02:59:53.679536+0000","last_active":"2023-10-06T03:09:49.195589+0000","last_peered":"2023-10-06T03:09:49.195589+0000","last_clean":"2023-10-06T03:09:49.195589+0000","last_became_active":"2023-10-06T02:59:53.678264+0000","last_became_peered":"2023-10-06T02:59:53.678264+0000","last_unstale":"2023-10-06T03:09:49.195589+0000","last_undegraded":"2023-10-06T03:09:49.195589+0000","last_fullsized":"2023-10-06T03:09:49.195589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:18.566933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"26'76","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.178090+0000","last_change":"2023-10-06T02:59:53.671821+0000","last_active":"2023-10-06T03:09:49.178090+0000","last_peered":"2023-10-06T03:09:49.178090+0000","last_clean":"2023-10-06T03:09:49.178090+0000","last_became_active":"2023-10-06T02:59:53.671555+0000","last_became_peered":"2023-10-06T02:59:53.671555+0000","last_unstale":"2023-10-06T03:09:49.178090+0000","last_undegraded":"2023-10-06T03:09:49.178090+0000","last_fullsized":"2023-10-06T03:09:49.178090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:36:28.006545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"26'85","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205702+0000","last_change":"2023-10-06T02:59:53.682691+0000","last_active":"2023-10-06T03:09:49.205702+0000","last_peered":"2023-10-06T03:09:49.205702+0000","last_clean":"2023-10-06T03:09:49.205702+0000","last_became_active":"2023-10-06T02:59:53.682399+0000","last_became_peered":"2023-10-06T02:59:53.682399+0000","last_unstale":"2023-10-06T03:09:49.205702+0000","last_undegraded":"2023-10-06T03:09:49.205702+0000","last_fullsized":"2023-10-06T03:09:49.205702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195685+0000","last_change":"2023-10-06T02:59:53.678208+0000","last_active":"2023-10-06T03:09:49.195685+0000","last_peered":"2023-10-06T03:09:49.195685+0000","last_clean":"2023-10-06T03:09:49.195685+0000","last_became_active":"2023-10-06T02:59:53.676481+0000","last_became_peered":"2023-10-06T02:59:53.676481+0000","last_unstale":"2023-10-06T03:09:49.195685+0000","last_undegraded":"2023-10-06T03:09:49.195685+0000","last_fullsized":"2023-10-06T03:09:49.195685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:42.767531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"26'93","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194495+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T03:09:49.194495+0000","last_peered":"2023-10-06T03:09:49.194495+0000","last_clean":"2023-10-06T03:09:49.194495+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:09:49.194495+0000","last_undegraded":"2023-10-06T03:09:49.194495+0000","last_fullsized":"2023-10-06T03:09:49.194495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"26'77","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196046+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T03:09:49.196046+0000","last_peered":"2023-10-06T03:09:49.196046+0000","last_clean":"2023-10-06T03:09:49.196046+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:09:49.196046+0000","last_undegraded":"2023-10-06T03:09:49.196046+0000","last_fullsized":"2023-10-06T03:09:49.196046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"26'89","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205683+0000","last_change":"2023-10-06T02:59:53.680395+0000","last_active":"2023-10-06T03:09:49.205683+0000","last_peered":"2023-10-06T03:09:49.205683+0000","last_clean":"2023-10-06T03:09:49.205683+0000","last_became_active":"2023-10-06T02:59:53.680086+0000","last_became_peered":"2023-10-06T02:59:53.680086+0000","last_unstale":"2023-10-06T03:09:49.205683+0000","last_undegraded":"2023-10-06T03:09:49.205683+0000","last_fullsized":"2023-10-06T03:09:49.205683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"26'73","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.189574+0000","last_change":"2023-10-06T02:59:53.675582+0000","last_active":"2023-10-06T03:09:49.189574+0000","last_peered":"2023-10-06T03:09:49.189574+0000","last_clean":"2023-10-06T03:09:49.189574+0000","last_became_active":"2023-10-06T02:59:53.675243+0000","last_became_peered":"2023-10-06T02:59:53.675243+0000","last_unstale":"2023-10-06T03:09:49.189574+0000","last_undegraded":"2023-10-06T03:09:49.189574+0000","last_fullsized":"2023-10-06T03:09:49.189574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194979+0000","last_change":"2023-10-06T02:59:53.679489+0000","last_active":"2023-10-06T03:09:49.194979+0000","last_peered":"2023-10-06T03:09:49.194979+0000","last_clean":"2023-10-06T03:09:49.194979+0000","last_became_active":"2023-10-06T02:59:53.678985+0000","last_became_peered":"2023-10-06T02:59:53.678985+0000","last_unstale":"2023-10-06T03:09:49.194979+0000","last_undegraded":"2023-10-06T03:09:49.194979+0000","last_fullsized":"2023-10-06T03:09:49.194979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:12.576010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.199369+0000","last_change":"2023-10-06T02:59:53.682799+0000","last_active":"2023-10-06T03:09:49.199369+0000","last_peered":"2023-10-06T03:09:49.199369+0000","last_clean":"2023-10-06T03:09:49.199369+0000","last_became_active":"2023-10-06T02:59:53.682464+0000","last_became_peered":"2023-10-06T02:59:53.682464+0000","last_unstale":"2023-10-06T03:09:49.199369+0000","last_undegraded":"2023-10-06T03:09:49.199369+0000","last_fullsized":"2023-10-06T03:09:49.199369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:06.403449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"26'84","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192420+0000","last_change":"2023-10-06T03:00:34.741799+0000","last_active":"2023-10-06T03:09:49.192420+0000","last_peered":"2023-10-06T03:09:49.192420+0000","last_clean":"2023-10-06T03:09:49.192420+0000","last_became_active":"2023-10-06T03:00:34.741173+0000","last_became_peered":"2023-10-06T03:00:34.741173+0000","last_unstale":"2023-10-06T03:09:49.192420+0000","last_undegraded":"2023-10-06T03:09:49.192420+0000","last_fullsized":"2023-10-06T03:09:49.192420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:30.493018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"26'74","reported_seq":85,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191870+0000","last_change":"2023-10-06T02:59:53.673321+0000","last_active":"2023-10-06T03:09:49.191870+0000","last_peered":"2023-10-06T03:09:49.191870+0000","last_clean":"2023-10-06T03:09:49.191870+0000","last_became_active":"2023-10-06T02:59:53.672957+0000","last_became_peered":"2023-10-06T02:59:53.672957+0000","last_unstale":"2023-10-06T03:09:49.191870+0000","last_undegraded":"2023-10-06T03:09:49.191870+0000","last_fullsized":"2023-10-06T03:09:49.191870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"26'78","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195086+0000","last_change":"2023-10-06T02:59:53.686669+0000","last_active":"2023-10-06T03:09:49.195086+0000","last_peered":"2023-10-06T03:09:49.195086+0000","last_clean":"2023-10-06T03:09:49.195086+0000","last_became_active":"2023-10-06T02:59:53.686352+0000","last_became_peered":"2023-10-06T02:59:53.686352+0000","last_unstale":"2023-10-06T03:09:49.195086+0000","last_undegraded":"2023-10-06T03:09:49.195086+0000","last_fullsized":"2023-10-06T03:09:49.195086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"26'88","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.197410+0000","last_change":"2023-10-06T02:59:53.680975+0000","last_active":"2023-10-06T03:09:49.197410+0000","last_peered":"2023-10-06T03:09:49.197410+0000","last_clean":"2023-10-06T03:09:49.197410+0000","last_became_active":"2023-10-06T02:59:53.678449+0000","last_became_peered":"2023-10-06T02:59:53.678449+0000","last_unstale":"2023-10-06T03:09:49.197410+0000","last_undegraded":"2023-10-06T03:09:49.197410+0000","last_fullsized":"2023-10-06T03:09:49.197410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:18.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205375+0000","last_change":"2023-10-06T02:59:53.680344+0000","last_active":"2023-10-06T03:09:49.205375+0000","last_peered":"2023-10-06T03:09:49.205375+0000","last_clean":"2023-10-06T03:09:49.205375+0000","last_became_active":"2023-10-06T02:59:53.680028+0000","last_became_peered":"2023-10-06T02:59:53.680028+0000","last_unstale":"2023-10-06T03:09:49.205375+0000","last_undegraded":"2023-10-06T03:09:49.205375+0000","last_fullsized":"2023-10-06T03:09:49.205375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"26'76","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191223+0000","last_change":"2023-10-06T02:59:53.678143+0000","last_active":"2023-10-06T03:09:49.191223+0000","last_peered":"2023-10-06T03:09:49.191223+0000","last_clean":"2023-10-06T03:09:49.191223+0000","last_became_active":"2023-10-06T02:59:53.676602+0000","last_became_peered":"2023-10-06T02:59:53.676602+0000","last_unstale":"2023-10-06T03:09:49.191223+0000","last_undegraded":"2023-10-06T03:09:49.191223+0000","last_fullsized":"2023-10-06T03:09:49.191223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:29.621147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196673+0000","last_change":"2023-10-06T02:59:53.675935+0000","last_active":"2023-10-06T03:09:49.196673+0000","last_peered":"2023-10-06T03:09:49.196673+0000","last_clean":"2023-10-06T03:09:49.196673+0000","last_became_active":"2023-10-06T02:59:53.675657+0000","last_became_peered":"2023-10-06T02:59:53.675657+0000","last_unstale":"2023-10-06T03:09:49.196673+0000","last_undegraded":"2023-10-06T03:09:49.196673+0000","last_fullsized":"2023-10-06T03:09:49.196673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:56.862647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191684+0000","last_change":"2023-10-06T02:59:53.673043+0000","last_active":"2023-10-06T03:09:49.191684+0000","last_peered":"2023-10-06T03:09:49.191684+0000","last_clean":"2023-10-06T03:09:49.191684+0000","last_became_active":"2023-10-06T02:59:53.672690+0000","last_became_peered":"2023-10-06T02:59:53.672690+0000","last_unstale":"2023-10-06T03:09:49.191684+0000","last_undegraded":"2023-10-06T03:09:49.191684+0000","last_fullsized":"2023-10-06T03:09:49.191684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"26'83","reported_seq":94,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194716+0000","last_change":"2023-10-06T02:59:53.684492+0000","last_active":"2023-10-06T03:09:49.194716+0000","last_peered":"2023-10-06T03:09:49.194716+0000","last_clean":"2023-10-06T03:09:49.194716+0000","last_became_active":"2023-10-06T02:59:53.684145+0000","last_became_peered":"2023-10-06T02:59:53.684145+0000","last_unstale":"2023-10-06T03:09:49.194716+0000","last_undegraded":"2023-10-06T03:09:49.194716+0000","last_fullsized":"2023-10-06T03:09:49.194716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"26'88","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200847+0000","last_change":"2023-10-06T02:59:53.683256+0000","last_active":"2023-10-06T03:09:49.200847+0000","last_peered":"2023-10-06T03:09:49.200847+0000","last_clean":"2023-10-06T03:09:49.200847+0000","last_became_active":"2023-10-06T02:59:53.682948+0000","last_became_peered":"2023-10-06T02:59:53.682948+0000","last_unstale":"2023-10-06T03:09:49.200847+0000","last_undegraded":"2023-10-06T03:09:49.200847+0000","last_fullsized":"2023-10-06T03:09:49.200847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"26'69","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206413+0000","last_change":"2023-10-06T02:59:53.675936+0000","last_active":"2023-10-06T03:09:49.206413+0000","last_peered":"2023-10-06T03:09:49.206413+0000","last_clean":"2023-10-06T03:09:49.206413+0000","last_became_active":"2023-10-06T02:59:53.675319+0000","last_became_peered":"2023-10-06T02:59:53.675319+0000","last_unstale":"2023-10-06T03:09:49.206413+0000","last_undegraded":"2023-10-06T03:09:49.206413+0000","last_fullsized":"2023-10-06T03:09:49.206413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195262+0000","last_change":"2023-10-06T02:59:53.686758+0000","last_active":"2023-10-06T03:09:49.195262+0000","last_peered":"2023-10-06T03:09:49.195262+0000","last_clean":"2023-10-06T03:09:49.195262+0000","last_became_active":"2023-10-06T02:59:53.686007+0000","last_became_peered":"2023-10-06T02:59:53.686007+0000","last_unstale":"2023-10-06T03:09:49.195262+0000","last_undegraded":"2023-10-06T03:09:49.195262+0000","last_fullsized":"2023-10-06T03:09:49.195262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"26'91","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200675+0000","last_change":"2023-10-06T02:59:53.682853+0000","last_active":"2023-10-06T03:09:49.200675+0000","last_peered":"2023-10-06T03:09:49.200675+0000","last_clean":"2023-10-06T03:09:49.200675+0000","last_became_active":"2023-10-06T02:59:53.682511+0000","last_became_peered":"2023-10-06T02:59:53.682511+0000","last_unstale":"2023-10-06T03:09:49.200675+0000","last_undegraded":"2023-10-06T03:09:49.200675+0000","last_fullsized":"2023-10-06T03:09:49.200675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"26'98","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196456+0000","last_change":"2023-10-06T02:59:53.682001+0000","last_active":"2023-10-06T03:09:49.196456+0000","last_peered":"2023-10-06T03:09:49.196456+0000","last_clean":"2023-10-06T03:09:49.196456+0000","last_became_active":"2023-10-06T02:59:53.681732+0000","last_became_peered":"2023-10-06T02:59:53.681732+0000","last_unstale":"2023-10-06T03:09:49.196456+0000","last_undegraded":"2023-10-06T03:09:49.196456+0000","last_fullsized":"2023-10-06T03:09:49.196456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.173694+0000","last_change":"2023-10-06T02:59:53.676598+0000","last_active":"2023-10-06T03:09:49.173694+0000","last_peered":"2023-10-06T03:09:49.173694+0000","last_clean":"2023-10-06T03:09:49.173694+0000","last_became_active":"2023-10-06T02:59:53.676284+0000","last_became_peered":"2023-10-06T02:59:53.676284+0000","last_unstale":"2023-10-06T03:09:49.173694+0000","last_undegraded":"2023-10-06T03:09:49.173694+0000","last_fullsized":"2023-10-06T03:09:49.173694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"26'61","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195455+0000","last_change":"2023-10-06T02:59:53.687275+0000","last_active":"2023-10-06T03:09:49.195455+0000","last_peered":"2023-10-06T03:09:49.195455+0000","last_clean":"2023-10-06T03:09:49.195455+0000","last_became_active":"2023-10-06T02:59:53.686912+0000","last_became_peered":"2023-10-06T02:59:53.686912+0000","last_unstale":"2023-10-06T03:09:49.195455+0000","last_undegraded":"2023-10-06T03:09:49.195455+0000","last_fullsized":"2023-10-06T03:09:49.195455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203610+0000","last_change":"2023-10-06T02:59:53.685421+0000","last_active":"2023-10-06T03:09:49.203610+0000","last_peered":"2023-10-06T03:09:49.203610+0000","last_clean":"2023-10-06T03:09:49.203610+0000","last_became_active":"2023-10-06T02:59:53.684806+0000","last_became_peered":"2023-10-06T02:59:53.684806+0000","last_unstale":"2023-10-06T03:09:49.203610+0000","last_undegraded":"2023-10-06T03:09:49.203610+0000","last_fullsized":"2023-10-06T03:09:49.203610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191736+0000","last_change":"2023-10-06T02:59:53.676085+0000","last_active":"2023-10-06T03:09:49.191736+0000","last_peered":"2023-10-06T03:09:49.191736+0000","last_clean":"2023-10-06T03:09:49.191736+0000","last_became_active":"2023-10-06T02:59:53.675718+0000","last_became_peered":"2023-10-06T02:59:53.675718+0000","last_unstale":"2023-10-06T03:09:49.191736+0000","last_undegraded":"2023-10-06T03:09:49.191736+0000","last_fullsized":"2023-10-06T03:09:49.191736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:00.548441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206351+0000","last_change":"2023-10-06T02:59:53.676118+0000","last_active":"2023-10-06T03:09:49.206351+0000","last_peered":"2023-10-06T03:09:49.206351+0000","last_clean":"2023-10-06T03:09:49.206351+0000","last_became_active":"2023-10-06T02:59:53.675682+0000","last_became_peered":"2023-10-06T02:59:53.675682+0000","last_unstale":"2023-10-06T03:09:49.206351+0000","last_undegraded":"2023-10-06T03:09:49.206351+0000","last_fullsized":"2023-10-06T03:09:49.206351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192921+0000","last_change":"2023-10-06T02:59:53.673225+0000","last_active":"2023-10-06T03:09:49.192921+0000","last_peered":"2023-10-06T03:09:49.192921+0000","last_clean":"2023-10-06T03:09:49.192921+0000","last_became_active":"2023-10-06T02:59:53.672930+0000","last_became_peered":"2023-10-06T02:59:53.672930+0000","last_unstale":"2023-10-06T03:09:49.192921+0000","last_undegraded":"2023-10-06T03:09:49.192921+0000","last_fullsized":"2023-10-06T03:09:49.192921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:02.845187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195360+0000","last_change":"2023-10-06T02:59:53.678742+0000","last_active":"2023-10-06T03:09:49.195360+0000","last_peered":"2023-10-06T03:09:49.195360+0000","last_clean":"2023-10-06T03:09:49.195360+0000","last_became_active":"2023-10-06T02:59:53.678471+0000","last_became_peered":"2023-10-06T02:59:53.678471+0000","last_unstale":"2023-10-06T03:09:49.195360+0000","last_undegraded":"2023-10-06T03:09:49.195360+0000","last_fullsized":"2023-10-06T03:09:49.195360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'1517","reported_seq":1529,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.502219+0000","last_change":"2023-10-06T02:59:53.297136+0000","last_active":"2023-10-06T03:09:37.502219+0000","last_peered":"2023-10-06T03:09:37.502219+0000","last_clean":"2023-10-06T03:09:37.502219+0000","last_became_active":"2023-10-06T02:59:53.296816+0000","last_became_peered":"2023-10-06T02:59:53.296816+0000","last_unstale":"2023-10-06T03:09:37.502219+0000","last_undegraded":"2023-10-06T03:09:37.502219+0000","last_fullsized":"2023-10-06T03:09:37.502219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:58.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1406,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'65","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.175064+0000","last_change":"2023-10-06T02:59:53.684876+0000","last_active":"2023-10-06T03:09:49.175064+0000","last_peered":"2023-10-06T03:09:49.175064+0000","last_clean":"2023-10-06T03:09:49.175064+0000","last_became_active":"2023-10-06T02:59:53.684522+0000","last_became_peered":"2023-10-06T02:59:53.684522+0000","last_unstale":"2023-10-06T03:09:49.175064+0000","last_undegraded":"2023-10-06T03:09:49.175064+0000","last_fullsized":"2023-10-06T03:09:49.175064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"26'125","reported_seq":137,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.507239+0000","last_change":"2023-10-06T02:59:53.292700+0000","last_active":"2023-10-06T03:09:37.507239+0000","last_peered":"2023-10-06T03:09:37.507239+0000","last_clean":"2023-10-06T03:09:37.507239+0000","last_became_active":"2023-10-06T02:59:53.292378+0000","last_became_peered":"2023-10-06T02:59:53.292378+0000","last_unstale":"2023-10-06T03:09:37.507239+0000","last_undegraded":"2023-10-06T03:09:37.507239+0000","last_fullsized":"2023-10-06T03:09:37.507239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204649+0000","last_change":"2023-10-06T02:59:53.675542+0000","last_active":"2023-10-06T03:09:49.204649+0000","last_peered":"2023-10-06T03:09:49.204649+0000","last_clean":"2023-10-06T03:09:49.204649+0000","last_became_active":"2023-10-06T02:59:53.675219+0000","last_became_peered":"2023-10-06T02:59:53.675219+0000","last_unstale":"2023-10-06T03:09:49.204649+0000","last_undegraded":"2023-10-06T03:09:49.204649+0000","last_fullsized":"2023-10-06T03:09:49.204649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"26'124","reported_seq":136,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.177954+0000","last_change":"2023-10-06T02:59:53.302122+0000","last_active":"2023-10-06T03:08:41.177954+0000","last_peered":"2023-10-06T03:08:41.177954+0000","last_clean":"2023-10-06T03:08:41.177954+0000","last_became_active":"2023-10-06T02:59:53.301737+0000","last_became_peered":"2023-10-06T02:59:53.301737+0000","last_unstale":"2023-10-06T03:08:41.177954+0000","last_undegraded":"2023-10-06T03:08:41.177954+0000","last_fullsized":"2023-10-06T03:08:41.177954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203476+0000","last_change":"2023-10-06T02:59:53.684854+0000","last_active":"2023-10-06T03:09:49.203476+0000","last_peered":"2023-10-06T03:09:49.203476+0000","last_clean":"2023-10-06T03:09:49.203476+0000","last_became_active":"2023-10-06T02:59:53.684527+0000","last_became_peered":"2023-10-06T02:59:53.684527+0000","last_unstale":"2023-10-06T03:09:49.203476+0000","last_undegraded":"2023-10-06T03:09:49.203476+0000","last_fullsized":"2023-10-06T03:09:49.203476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"26'135","reported_seq":147,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.502731+0000","last_change":"2023-10-06T02:59:53.294103+0000","last_active":"2023-10-06T03:09:37.502731+0000","last_peered":"2023-10-06T03:09:37.502731+0000","last_clean":"2023-10-06T03:09:37.502731+0000","last_became_active":"2023-10-06T02:59:53.293707+0000","last_became_peered":"2023-10-06T02:59:53.293707+0000","last_unstale":"2023-10-06T03:09:37.502731+0000","last_undegraded":"2023-10-06T03:09:37.502731+0000","last_fullsized":"2023-10-06T03:09:37.502731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"26'118","reported_seq":130,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505440+0000","last_change":"2023-10-06T02:59:53.296507+0000","last_active":"2023-10-06T03:09:37.505440+0000","last_peered":"2023-10-06T03:09:37.505440+0000","last_clean":"2023-10-06T03:09:37.505440+0000","last_became_active":"2023-10-06T02:59:53.296230+0000","last_became_peered":"2023-10-06T02:59:53.296230+0000","last_unstale":"2023-10-06T03:09:37.505440+0000","last_undegraded":"2023-10-06T03:09:37.505440+0000","last_fullsized":"2023-10-06T03:09:37.505440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"26'90","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.176351+0000","last_change":"2023-10-06T02:59:53.684046+0000","last_active":"2023-10-06T03:09:49.176351+0000","last_peered":"2023-10-06T03:09:49.176351+0000","last_clean":"2023-10-06T03:09:49.176351+0000","last_became_active":"2023-10-06T02:59:53.683705+0000","last_became_peered":"2023-10-06T02:59:53.683705+0000","last_unstale":"2023-10-06T03:09:49.176351+0000","last_undegraded":"2023-10-06T03:09:49.176351+0000","last_fullsized":"2023-10-06T03:09:49.176351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'106","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.175579+0000","last_change":"2023-10-06T02:59:53.296465+0000","last_active":"2023-10-06T03:08:41.175579+0000","last_peered":"2023-10-06T03:08:41.175579+0000","last_clean":"2023-10-06T03:08:41.175579+0000","last_became_active":"2023-10-06T02:59:53.296225+0000","last_became_peered":"2023-10-06T02:59:53.296225+0000","last_unstale":"2023-10-06T03:08:41.175579+0000","last_undegraded":"2023-10-06T03:08:41.175579+0000","last_fullsized":"2023-10-06T03:08:41.175579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'81","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.198537+0000","last_change":"2023-10-06T02:59:53.683216+0000","last_active":"2023-10-06T03:09:49.198537+0000","last_peered":"2023-10-06T03:09:49.198537+0000","last_clean":"2023-10-06T03:09:49.198537+0000","last_became_active":"2023-10-06T02:59:53.682938+0000","last_became_peered":"2023-10-06T02:59:53.682938+0000","last_unstale":"2023-10-06T03:09:49.198537+0000","last_undegraded":"2023-10-06T03:09:49.198537+0000","last_fullsized":"2023-10-06T03:09:49.198537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"26'620","reported_seq":632,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.502276+0000","last_change":"2023-10-06T02:59:53.293929+0000","last_active":"2023-10-06T03:09:37.502276+0000","last_peered":"2023-10-06T03:09:37.502276+0000","last_clean":"2023-10-06T03:09:37.502276+0000","last_became_active":"2023-10-06T02:59:53.293602+0000","last_became_peered":"2023-10-06T02:59:53.293602+0000","last_unstale":"2023-10-06T03:09:37.502276+0000","last_undegraded":"2023-10-06T03:09:37.502276+0000","last_fullsized":"2023-10-06T03:09:37.502276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196618+0000","last_change":"2023-10-06T02:59:53.672111+0000","last_active":"2023-10-06T03:09:49.196618+0000","last_peered":"2023-10-06T03:09:49.196618+0000","last_clean":"2023-10-06T03:09:49.196618+0000","last_became_active":"2023-10-06T02:59:53.671511+0000","last_became_peered":"2023-10-06T02:59:53.671511+0000","last_unstale":"2023-10-06T03:09:49.196618+0000","last_undegraded":"2023-10-06T03:09:49.196618+0000","last_fullsized":"2023-10-06T03:09:49.196618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'134","reported_seq":146,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.170376+0000","last_change":"2023-10-06T02:59:53.300059+0000","last_active":"2023-10-06T03:08:41.170376+0000","last_peered":"2023-10-06T03:08:41.170376+0000","last_clean":"2023-10-06T03:08:41.170376+0000","last_became_active":"2023-10-06T02:59:53.299715+0000","last_became_peered":"2023-10-06T02:59:53.299715+0000","last_unstale":"2023-10-06T03:08:41.170376+0000","last_undegraded":"2023-10-06T03:08:41.170376+0000","last_fullsized":"2023-10-06T03:08:41.170376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"26'94","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200602+0000","last_change":"2023-10-06T02:59:53.683331+0000","last_active":"2023-10-06T03:09:49.200602+0000","last_peered":"2023-10-06T03:09:49.200602+0000","last_clean":"2023-10-06T03:09:49.200602+0000","last_became_active":"2023-10-06T02:59:53.682994+0000","last_became_peered":"2023-10-06T02:59:53.682994+0000","last_unstale":"2023-10-06T03:09:49.200602+0000","last_undegraded":"2023-10-06T03:09:49.200602+0000","last_fullsized":"2023-10-06T03:09:49.200602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'618","reported_seq":630,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.504933+0000","last_change":"2023-10-06T02:59:53.301126+0000","last_active":"2023-10-06T03:09:38.504933+0000","last_peered":"2023-10-06T03:09:38.504933+0000","last_clean":"2023-10-06T03:09:38.504933+0000","last_became_active":"2023-10-06T02:59:53.300850+0000","last_became_peered":"2023-10-06T02:59:53.300850+0000","last_unstale":"2023-10-06T03:09:38.504933+0000","last_undegraded":"2023-10-06T03:09:38.504933+0000","last_fullsized":"2023-10-06T03:09:38.504933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204076+0000","last_change":"2023-10-06T02:59:53.678930+0000","last_active":"2023-10-06T03:09:49.204076+0000","last_peered":"2023-10-06T03:09:49.204076+0000","last_clean":"2023-10-06T03:09:49.204076+0000","last_became_active":"2023-10-06T02:59:53.678630+0000","last_became_peered":"2023-10-06T02:59:53.678630+0000","last_unstale":"2023-10-06T03:09:49.204076+0000","last_undegraded":"2023-10-06T03:09:49.204076+0000","last_fullsized":"2023-10-06T03:09:49.204076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:14.961350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'128","reported_seq":140,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:42.163802+0000","last_change":"2023-10-06T02:59:53.291521+0000","last_active":"2023-10-06T03:08:42.163802+0000","last_peered":"2023-10-06T03:08:42.163802+0000","last_clean":"2023-10-06T03:08:42.163802+0000","last_became_active":"2023-10-06T02:59:53.290773+0000","last_became_peered":"2023-10-06T02:59:53.290773+0000","last_unstale":"2023-10-06T03:08:42.163802+0000","last_undegraded":"2023-10-06T03:08:42.163802+0000","last_fullsized":"2023-10-06T03:08:42.163802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.198768+0000","last_change":"2023-10-06T02:59:53.678188+0000","last_active":"2023-10-06T03:09:49.198768+0000","last_peered":"2023-10-06T03:09:49.198768+0000","last_clean":"2023-10-06T03:09:49.198768+0000","last_became_active":"2023-10-06T02:59:53.676507+0000","last_became_peered":"2023-10-06T02:59:53.676507+0000","last_unstale":"2023-10-06T03:09:49.198768+0000","last_undegraded":"2023-10-06T03:09:49.198768+0000","last_fullsized":"2023-10-06T03:09:49.198768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"26'126","reported_seq":138,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.500688+0000","last_change":"2023-10-06T02:59:53.289980+0000","last_active":"2023-10-06T03:09:37.500688+0000","last_peered":"2023-10-06T03:09:37.500688+0000","last_clean":"2023-10-06T03:09:37.500688+0000","last_became_active":"2023-10-06T02:59:53.288601+0000","last_became_peered":"2023-10-06T02:59:53.288601+0000","last_unstale":"2023-10-06T03:09:37.500688+0000","last_undegraded":"2023-10-06T03:09:37.500688+0000","last_fullsized":"2023-10-06T03:09:37.500688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:54.630392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191584+0000","last_change":"2023-10-06T02:59:53.675456+0000","last_active":"2023-10-06T03:09:49.191584+0000","last_peered":"2023-10-06T03:09:49.191584+0000","last_clean":"2023-10-06T03:09:49.191584+0000","last_became_active":"2023-10-06T02:59:53.673268+0000","last_became_peered":"2023-10-06T02:59:53.673268+0000","last_unstale":"2023-10-06T03:09:49.191584+0000","last_undegraded":"2023-10-06T03:09:49.191584+0000","last_fullsized":"2023-10-06T03:09:49.191584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'687","reported_seq":699,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505021+0000","last_change":"2023-10-06T02:59:53.298398+0000","last_active":"2023-10-06T03:09:37.505021+0000","last_peered":"2023-10-06T03:09:37.505021+0000","last_clean":"2023-10-06T03:09:37.505021+0000","last_became_active":"2023-10-06T02:59:53.297896+0000","last_became_peered":"2023-10-06T02:59:53.297896+0000","last_unstale":"2023-10-06T03:09:37.505021+0000","last_undegraded":"2023-10-06T03:09:37.505021+0000","last_fullsized":"2023-10-06T03:09:37.505021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205139+0000","last_change":"2023-10-06T02:59:53.679712+0000","last_active":"2023-10-06T03:09:49.205139+0000","last_peered":"2023-10-06T03:09:49.205139+0000","last_clean":"2023-10-06T03:09:49.205139+0000","last_became_active":"2023-10-06T02:59:53.679390+0000","last_became_peered":"2023-10-06T02:59:53.679390+0000","last_unstale":"2023-10-06T03:09:49.205139+0000","last_undegraded":"2023-10-06T03:09:49.205139+0000","last_fullsized":"2023-10-06T03:09:49.205139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:34.124779+0000","last_change":"2023-10-06T02:59:44.074625+0000","last_active":"2023-10-06T03:00:34.124779+0000","last_peered":"2023-10-06T03:00:34.124779+0000","last_clean":"2023-10-06T03:00:34.124779+0000","last_became_active":"2023-10-06T02:59:44.072854+0000","last_became_peered":"2023-10-06T02:59:44.072854+0000","last_unstale":"2023-10-06T03:00:34.124779+0000","last_undegraded":"2023-10-06T03:00:34.124779+0000","last_fullsized":"2023-10-06T03:00:34.124779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_clean_scrub_stamp":"2023-10-06T02:59:43.039151+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:04.936706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.738241+0000","last_change":"2023-10-06T02:59:49.107090+0000","last_active":"2023-10-06T03:00:33.738241+0000","last_peered":"2023-10-06T03:00:33.738241+0000","last_clean":"2023-10-06T03:00:33.738241+0000","last_became_active":"2023-10-06T02:59:49.106619+0000","last_became_peered":"2023-10-06T02:59:49.106619+0000","last_unstale":"2023-10-06T03:00:33.738241+0000","last_undegraded":"2023-10-06T03:00:33.738241+0000","last_fullsized":"2023-10-06T03:00:33.738241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"26'1461","reported_seq":1473,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506597+0000","last_change":"2023-10-06T02:59:53.298769+0000","last_active":"2023-10-06T03:09:37.506597+0000","last_peered":"2023-10-06T03:09:37.506597+0000","last_clean":"2023-10-06T03:09:37.506597+0000","last_became_active":"2023-10-06T02:59:53.298012+0000","last_became_peered":"2023-10-06T02:59:53.298012+0000","last_unstale":"2023-10-06T03:09:37.506597+0000","last_undegraded":"2023-10-06T03:09:37.506597+0000","last_fullsized":"2023-10-06T03:09:37.506597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1461,"log_dups_size":0,"ondisk_log_size":1461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1329,"num_write_kb":8969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.181004+0000","last_change":"2023-10-06T02:59:53.679625+0000","last_active":"2023-10-06T03:09:49.181004+0000","last_peered":"2023-10-06T03:09:49.181004+0000","last_clean":"2023-10-06T03:09:49.181004+0000","last_became_active":"2023-10-06T02:59:53.679200+0000","last_became_peered":"2023-10-06T02:59:53.679200+0000","last_unstale":"2023-10-06T03:09:49.181004+0000","last_undegraded":"2023-10-06T03:09:49.181004+0000","last_fullsized":"2023-10-06T03:09:49.181004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:59.309901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:34.124485+0000","last_change":"2023-10-06T02:59:49.107231+0000","last_active":"2023-10-06T03:00:34.124485+0000","last_peered":"2023-10-06T03:00:34.124485+0000","last_clean":"2023-10-06T03:00:34.124485+0000","last_became_active":"2023-10-06T02:59:49.106878+0000","last_became_peered":"2023-10-06T02:59:49.106878+0000","last_unstale":"2023-10-06T03:00:34.124485+0000","last_undegraded":"2023-10-06T03:00:34.124485+0000","last_fullsized":"2023-10-06T03:00:34.124485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"26'603","reported_seq":1098,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:39.495232+0000","last_change":"2023-10-06T02:59:53.296937+0000","last_active":"2023-10-06T03:09:39.495232+0000","last_peered":"2023-10-06T03:09:39.495232+0000","last_clean":"2023-10-06T03:09:39.495232+0000","last_became_active":"2023-10-06T02:59:53.296171+0000","last_became_peered":"2023-10-06T02:59:53.296171+0000","last_unstale":"2023-10-06T03:09:39.495232+0000","last_undegraded":"2023-10-06T03:09:39.495232+0000","last_fullsized":"2023-10-06T03:09:39.495232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770024,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":483,"num_write_kb":1079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"26'88","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200671+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T03:09:49.200671+0000","last_peered":"2023-10-06T03:09:49.200671+0000","last_clean":"2023-10-06T03:09:49.200671+0000","last_became_active":"2023-10-06T02:59:53.681786+0000","last_became_peered":"2023-10-06T02:59:53.681786+0000","last_unstale":"2023-10-06T03:09:49.200671+0000","last_undegraded":"2023-10-06T03:09:49.200671+0000","last_fullsized":"2023-10-06T03:09:49.200671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.733289+0000","last_change":"2023-10-06T02:59:49.115200+0000","last_active":"2023-10-06T03:00:33.733289+0000","last_peered":"2023-10-06T03:00:33.733289+0000","last_clean":"2023-10-06T03:00:33.733289+0000","last_became_active":"2023-10-06T02:59:49.114769+0000","last_became_peered":"2023-10-06T02:59:49.114769+0000","last_unstale":"2023-10-06T03:00:33.733289+0000","last_undegraded":"2023-10-06T03:00:33.733289+0000","last_fullsized":"2023-10-06T03:00:33.733289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:37.773233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'1468","reported_seq":1480,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:07.312340+0000","last_change":"2023-10-06T02:59:53.298658+0000","last_active":"2023-10-06T03:09:07.312340+0000","last_peered":"2023-10-06T03:09:07.312340+0000","last_clean":"2023-10-06T03:09:07.312340+0000","last_became_active":"2023-10-06T02:59:53.298054+0000","last_became_peered":"2023-10-06T02:59:53.298054+0000","last_unstale":"2023-10-06T03:09:07.312340+0000","last_undegraded":"2023-10-06T03:09:07.312340+0000","last_fullsized":"2023-10-06T03:09:07.312340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1468,"log_dups_size":0,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1335,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.199508+0000","last_change":"2023-10-06T02:59:53.673950+0000","last_active":"2023-10-06T03:09:49.199508+0000","last_peered":"2023-10-06T03:09:49.199508+0000","last_clean":"2023-10-06T03:09:49.199508+0000","last_became_active":"2023-10-06T02:59:53.673677+0000","last_became_peered":"2023-10-06T02:59:53.673677+0000","last_unstale":"2023-10-06T03:09:49.199508+0000","last_undegraded":"2023-10-06T03:09:49.199508+0000","last_fullsized":"2023-10-06T03:09:49.199508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.738308+0000","last_change":"2023-10-06T02:59:49.107944+0000","last_active":"2023-10-06T03:00:33.738308+0000","last_peered":"2023-10-06T03:00:33.738308+0000","last_clean":"2023-10-06T03:00:33.738308+0000","last_became_active":"2023-10-06T02:59:49.107560+0000","last_became_peered":"2023-10-06T02:59:49.107560+0000","last_unstale":"2023-10-06T03:00:33.738308+0000","last_undegraded":"2023-10-06T03:00:33.738308+0000","last_fullsized":"2023-10-06T03:00:33.738308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'122","reported_seq":134,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506182+0000","last_change":"2023-10-06T02:59:53.300945+0000","last_active":"2023-10-06T03:09:37.506182+0000","last_peered":"2023-10-06T03:09:37.506182+0000","last_clean":"2023-10-06T03:09:37.506182+0000","last_became_active":"2023-10-06T02:59:53.300609+0000","last_became_peered":"2023-10-06T02:59:53.300609+0000","last_unstale":"2023-10-06T03:09:37.506182+0000","last_undegraded":"2023-10-06T03:09:37.506182+0000","last_fullsized":"2023-10-06T03:09:37.506182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"26'78","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192720+0000","last_change":"2023-10-06T03:00:34.740673+0000","last_active":"2023-10-06T03:09:49.192720+0000","last_peered":"2023-10-06T03:09:49.192720+0000","last_clean":"2023-10-06T03:09:49.192720+0000","last_became_active":"2023-10-06T03:00:34.740140+0000","last_became_peered":"2023-10-06T03:00:34.740140+0000","last_unstale":"2023-10-06T03:09:49.192720+0000","last_undegraded":"2023-10-06T03:09:49.192720+0000","last_fullsized":"2023-10-06T03:09:49.192720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.929423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'105","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.499293+0000","last_change":"2023-10-06T02:59:53.301191+0000","last_active":"2023-10-06T03:09:37.499293+0000","last_peered":"2023-10-06T03:09:37.499293+0000","last_clean":"2023-10-06T03:09:37.499293+0000","last_became_active":"2023-10-06T02:59:53.300919+0000","last_became_peered":"2023-10-06T02:59:53.300919+0000","last_unstale":"2023-10-06T03:09:37.499293+0000","last_undegraded":"2023-10-06T03:09:37.499293+0000","last_fullsized":"2023-10-06T03:09:37.499293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.741892+0000","last_change":"2023-10-06T02:59:49.108499+0000","last_active":"2023-10-06T03:00:33.741892+0000","last_peered":"2023-10-06T03:00:33.741892+0000","last_clean":"2023-10-06T03:00:33.741892+0000","last_became_active":"2023-10-06T02:59:49.107967+0000","last_became_peered":"2023-10-06T02:59:49.107967+0000","last_unstale":"2023-10-06T03:00:33.741892+0000","last_undegraded":"2023-10-06T03:00:33.741892+0000","last_fullsized":"2023-10-06T03:00:33.741892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195724+0000","last_change":"2023-10-06T02:59:53.676753+0000","last_active":"2023-10-06T03:09:49.195724+0000","last_peered":"2023-10-06T03:09:49.195724+0000","last_clean":"2023-10-06T03:09:49.195724+0000","last_became_active":"2023-10-06T02:59:53.676385+0000","last_became_peered":"2023-10-06T02:59:53.676385+0000","last_unstale":"2023-10-06T03:09:49.195724+0000","last_undegraded":"2023-10-06T03:09:49.195724+0000","last_fullsized":"2023-10-06T03:09:49.195724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"26'115","reported_seq":127,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.178338+0000","last_change":"2023-10-06T02:59:53.303221+0000","last_active":"2023-10-06T03:08:41.178338+0000","last_peered":"2023-10-06T03:08:41.178338+0000","last_clean":"2023-10-06T03:08:41.178338+0000","last_became_active":"2023-10-06T02:59:53.302890+0000","last_became_peered":"2023-10-06T02:59:53.302890+0000","last_unstale":"2023-10-06T03:08:41.178338+0000","last_undegraded":"2023-10-06T03:08:41.178338+0000","last_fullsized":"2023-10-06T03:08:41.178338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:34.125363+0000","last_change":"2023-10-06T02:59:49.102005+0000","last_active":"2023-10-06T03:00:34.125363+0000","last_peered":"2023-10-06T03:00:34.125363+0000","last_clean":"2023-10-06T03:00:34.125363+0000","last_became_active":"2023-10-06T02:59:49.101530+0000","last_became_peered":"2023-10-06T02:59:49.101530+0000","last_unstale":"2023-10-06T03:00:34.125363+0000","last_undegraded":"2023-10-06T03:00:34.125363+0000","last_fullsized":"2023-10-06T03:00:34.125363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.186999+0000","last_change":"2023-10-06T02:59:53.672581+0000","last_active":"2023-10-06T03:09:49.186999+0000","last_peered":"2023-10-06T03:09:49.186999+0000","last_clean":"2023-10-06T03:09:49.186999+0000","last_became_active":"2023-10-06T02:59:53.672299+0000","last_became_peered":"2023-10-06T02:59:53.672299+0000","last_unstale":"2023-10-06T03:09:49.186999+0000","last_undegraded":"2023-10-06T03:09:49.186999+0000","last_fullsized":"2023-10-06T03:09:49.186999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"26'120","reported_seq":132,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.177130+0000","last_change":"2023-10-06T02:59:53.300135+0000","last_active":"2023-10-06T03:08:41.177130+0000","last_peered":"2023-10-06T03:08:41.177130+0000","last_clean":"2023-10-06T03:08:41.177130+0000","last_became_active":"2023-10-06T02:59:53.299271+0000","last_became_peered":"2023-10-06T02:59:53.299271+0000","last_unstale":"2023-10-06T03:08:41.177130+0000","last_undegraded":"2023-10-06T03:08:41.177130+0000","last_fullsized":"2023-10-06T03:08:41.177130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.742127+0000","last_change":"2023-10-06T02:59:49.100171+0000","last_active":"2023-10-06T03:00:33.742127+0000","last_peered":"2023-10-06T03:00:33.742127+0000","last_clean":"2023-10-06T03:00:33.742127+0000","last_became_active":"2023-10-06T02:59:49.099689+0000","last_became_peered":"2023-10-06T02:59:49.099689+0000","last_unstale":"2023-10-06T03:00:33.742127+0000","last_undegraded":"2023-10-06T03:00:33.742127+0000","last_fullsized":"2023-10-06T03:00:33.742127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'94","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203550+0000","last_change":"2023-10-06T02:59:53.685270+0000","last_active":"2023-10-06T03:09:49.203550+0000","last_peered":"2023-10-06T03:09:49.203550+0000","last_clean":"2023-10-06T03:09:49.203550+0000","last_became_active":"2023-10-06T02:59:53.684983+0000","last_became_peered":"2023-10-06T02:59:53.684983+0000","last_unstale":"2023-10-06T03:09:49.203550+0000","last_undegraded":"2023-10-06T03:09:49.203550+0000","last_fullsized":"2023-10-06T03:09:49.203550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:49.904101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'244","reported_seq":256,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.504458+0000","last_change":"2023-10-06T02:59:53.301048+0000","last_active":"2023-10-06T03:09:38.504458+0000","last_peered":"2023-10-06T03:09:38.504458+0000","last_clean":"2023-10-06T03:09:38.504458+0000","last_became_active":"2023-10-06T02:59:53.300086+0000","last_became_peered":"2023-10-06T02:59:53.300086+0000","last_unstale":"2023-10-06T03:09:38.504458+0000","last_undegraded":"2023-10-06T03:09:38.504458+0000","last_fullsized":"2023-10-06T03:09:38.504458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.732387+0000","last_change":"2023-10-06T02:59:49.102935+0000","last_active":"2023-10-06T03:00:33.732387+0000","last_peered":"2023-10-06T03:00:33.732387+0000","last_clean":"2023-10-06T03:00:33.732387+0000","last_became_active":"2023-10-06T02:59:49.102397+0000","last_became_peered":"2023-10-06T02:59:49.102397+0000","last_unstale":"2023-10-06T03:00:33.732387+0000","last_undegraded":"2023-10-06T03:00:33.732387+0000","last_fullsized":"2023-10-06T03:00:33.732387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'77","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192435+0000","last_change":"2023-10-06T02:59:53.676229+0000","last_active":"2023-10-06T03:09:49.192435+0000","last_peered":"2023-10-06T03:09:49.192435+0000","last_clean":"2023-10-06T03:09:49.192435+0000","last_became_active":"2023-10-06T02:59:53.675895+0000","last_became_peered":"2023-10-06T02:59:53.675895+0000","last_unstale":"2023-10-06T03:09:49.192435+0000","last_undegraded":"2023-10-06T03:09:49.192435+0000","last_fullsized":"2023-10-06T03:09:49.192435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:03.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"26'85","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.188557+0000","last_change":"2023-10-06T02:59:53.676843+0000","last_active":"2023-10-06T03:09:49.188557+0000","last_peered":"2023-10-06T03:09:49.188557+0000","last_clean":"2023-10-06T03:09:49.188557+0000","last_became_active":"2023-10-06T02:59:53.676528+0000","last_became_peered":"2023-10-06T02:59:53.676528+0000","last_unstale":"2023-10-06T03:09:49.188557+0000","last_undegraded":"2023-10-06T03:09:49.188557+0000","last_fullsized":"2023-10-06T03:09:49.188557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'529","reported_seq":541,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505437+0000","last_change":"2023-10-06T02:59:53.294557+0000","last_active":"2023-10-06T03:09:37.505437+0000","last_peered":"2023-10-06T03:09:37.505437+0000","last_clean":"2023-10-06T03:09:37.505437+0000","last_became_active":"2023-10-06T02:59:53.291434+0000","last_became_peered":"2023-10-06T02:59:53.291434+0000","last_unstale":"2023-10-06T03:09:37.505437+0000","last_undegraded":"2023-10-06T03:09:37.505437+0000","last_fullsized":"2023-10-06T03:09:37.505437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196820+0000","last_change":"2023-10-06T02:59:53.678204+0000","last_active":"2023-10-06T03:09:49.196820+0000","last_peered":"2023-10-06T03:09:49.196820+0000","last_clean":"2023-10-06T03:09:49.196820+0000","last_became_active":"2023-10-06T02:59:53.677924+0000","last_became_peered":"2023-10-06T02:59:53.677924+0000","last_unstale":"2023-10-06T03:09:49.196820+0000","last_undegraded":"2023-10-06T03:09:49.196820+0000","last_fullsized":"2023-10-06T03:09:49.196820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"26'336","reported_seq":348,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.507759+0000","last_change":"2023-10-06T02:59:53.301253+0000","last_active":"2023-10-06T03:09:38.507759+0000","last_peered":"2023-10-06T03:09:38.507759+0000","last_clean":"2023-10-06T03:09:38.507759+0000","last_became_active":"2023-10-06T02:59:53.300926+0000","last_became_peered":"2023-10-06T02:59:53.300926+0000","last_unstale":"2023-10-06T03:09:38.507759+0000","last_undegraded":"2023-10-06T03:09:38.507759+0000","last_fullsized":"2023-10-06T03:09:38.507759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:21.432516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'135","reported_seq":147,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.500451+0000","last_change":"2023-10-06T02:59:53.292844+0000","last_active":"2023-10-06T03:09:37.500451+0000","last_peered":"2023-10-06T03:09:37.500451+0000","last_clean":"2023-10-06T03:09:37.500451+0000","last_became_active":"2023-10-06T02:59:53.292493+0000","last_became_peered":"2023-10-06T02:59:53.292493+0000","last_unstale":"2023-10-06T03:09:37.500451+0000","last_undegraded":"2023-10-06T03:09:37.500451+0000","last_fullsized":"2023-10-06T03:09:37.500451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"26'94","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206446+0000","last_change":"2023-10-06T02:59:53.676684+0000","last_active":"2023-10-06T03:09:49.206446+0000","last_peered":"2023-10-06T03:09:49.206446+0000","last_clean":"2023-10-06T03:09:49.206446+0000","last_became_active":"2023-10-06T02:59:53.676410+0000","last_became_peered":"2023-10-06T02:59:53.676410+0000","last_unstale":"2023-10-06T03:09:49.206446+0000","last_undegraded":"2023-10-06T03:09:49.206446+0000","last_fullsized":"2023-10-06T03:09:49.206446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"26'122","reported_seq":134,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.501788+0000","last_change":"2023-10-06T02:59:53.293924+0000","last_active":"2023-10-06T03:09:37.501788+0000","last_peered":"2023-10-06T03:09:37.501788+0000","last_clean":"2023-10-06T03:09:37.501788+0000","last_became_active":"2023-10-06T02:59:53.293596+0000","last_became_peered":"2023-10-06T02:59:53.293596+0000","last_unstale":"2023-10-06T03:09:37.501788+0000","last_undegraded":"2023-10-06T03:09:37.501788+0000","last_fullsized":"2023-10-06T03:09:37.501788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"26'91","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203618+0000","last_change":"2023-10-06T02:59:53.673847+0000","last_active":"2023-10-06T03:09:49.203618+0000","last_peered":"2023-10-06T03:09:49.203618+0000","last_clean":"2023-10-06T03:09:49.203618+0000","last_became_active":"2023-10-06T02:59:53.673559+0000","last_became_peered":"2023-10-06T02:59:53.673559+0000","last_unstale":"2023-10-06T03:09:49.203618+0000","last_undegraded":"2023-10-06T03:09:49.203618+0000","last_fullsized":"2023-10-06T03:09:49.203618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"26'76","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.174477+0000","last_change":"2023-10-06T02:59:53.674388+0000","last_active":"2023-10-06T03:09:49.174477+0000","last_peered":"2023-10-06T03:09:49.174477+0000","last_clean":"2023-10-06T03:09:49.174477+0000","last_became_active":"2023-10-06T02:59:53.674086+0000","last_became_peered":"2023-10-06T02:59:53.674086+0000","last_unstale":"2023-10-06T03:09:49.174477+0000","last_undegraded":"2023-10-06T03:09:49.174477+0000","last_fullsized":"2023-10-06T03:09:49.174477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'1576","reported_seq":1588,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.145397+0000","last_change":"2023-10-06T02:59:53.296871+0000","last_active":"2023-10-06T03:09:49.145397+0000","last_peered":"2023-10-06T03:09:49.145397+0000","last_clean":"2023-10-06T03:09:49.145397+0000","last_became_active":"2023-10-06T02:59:53.296550+0000","last_became_peered":"2023-10-06T02:59:53.296550+0000","last_unstale":"2023-10-06T03:09:49.145397+0000","last_undegraded":"2023-10-06T03:09:49.145397+0000","last_fullsized":"2023-10-06T03:09:49.145397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1576,"log_dups_size":0,"ondisk_log_size":1576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7633302,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1449,"num_write_kb":8304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.178500+0000","last_change":"2023-10-06T02:59:53.683771+0000","last_active":"2023-10-06T03:09:49.178500+0000","last_peered":"2023-10-06T03:09:49.178500+0000","last_clean":"2023-10-06T03:09:49.178500+0000","last_became_active":"2023-10-06T02:59:53.683458+0000","last_became_peered":"2023-10-06T02:59:53.683458+0000","last_unstale":"2023-10-06T03:09:49.178500+0000","last_undegraded":"2023-10-06T03:09:49.178500+0000","last_fullsized":"2023-10-06T03:09:49.178500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'118","reported_seq":130,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.168177+0000","last_change":"2023-10-06T02:59:53.301158+0000","last_active":"2023-10-06T03:08:41.168177+0000","last_peered":"2023-10-06T03:08:41.168177+0000","last_clean":"2023-10-06T03:08:41.168177+0000","last_became_active":"2023-10-06T02:59:53.300797+0000","last_became_peered":"2023-10-06T02:59:53.300797+0000","last_unstale":"2023-10-06T03:08:41.168177+0000","last_undegraded":"2023-10-06T03:08:41.168177+0000","last_fullsized":"2023-10-06T03:08:41.168177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"26'77","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203877+0000","last_change":"2023-10-06T02:59:53.683576+0000","last_active":"2023-10-06T03:09:49.203877+0000","last_peered":"2023-10-06T03:09:49.203877+0000","last_clean":"2023-10-06T03:09:49.203877+0000","last_became_active":"2023-10-06T02:59:53.683301+0000","last_became_peered":"2023-10-06T02:59:53.683301+0000","last_unstale":"2023-10-06T03:09:49.203877+0000","last_undegraded":"2023-10-06T03:09:49.203877+0000","last_fullsized":"2023-10-06T03:09:49.203877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'489","reported_seq":501,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.504119+0000","last_change":"2023-10-06T02:59:53.297975+0000","last_active":"2023-10-06T03:09:37.504119+0000","last_peered":"2023-10-06T03:09:37.504119+0000","last_clean":"2023-10-06T03:09:37.504119+0000","last_became_active":"2023-10-06T02:59:53.297724+0000","last_became_peered":"2023-10-06T02:59:53.297724+0000","last_unstale":"2023-10-06T03:09:37.504119+0000","last_undegraded":"2023-10-06T03:09:37.504119+0000","last_fullsized":"2023-10-06T03:09:37.504119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":4283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'74","reported_seq":85,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.201472+0000","last_change":"2023-10-06T02:59:53.684667+0000","last_active":"2023-10-06T03:09:49.201472+0000","last_peered":"2023-10-06T03:09:49.201472+0000","last_clean":"2023-10-06T03:09:49.201472+0000","last_became_active":"2023-10-06T02:59:53.684378+0000","last_became_peered":"2023-10-06T02:59:53.684378+0000","last_unstale":"2023-10-06T03:09:49.201472+0000","last_undegraded":"2023-10-06T03:09:49.201472+0000","last_fullsized":"2023-10-06T03:09:49.201472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:40.914600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"26'935","reported_seq":947,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.503096+0000","last_change":"2023-10-06T02:59:53.298276+0000","last_active":"2023-10-06T03:09:37.503096+0000","last_peered":"2023-10-06T03:09:37.503096+0000","last_clean":"2023-10-06T03:09:37.503096+0000","last_became_active":"2023-10-06T02:59:53.297471+0000","last_became_peered":"2023-10-06T02:59:53.297471+0000","last_unstale":"2023-10-06T03:09:37.503096+0000","last_undegraded":"2023-10-06T03:09:37.503096+0000","last_fullsized":"2023-10-06T03:09:37.503096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":4592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'78","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204791+0000","last_change":"2023-10-06T02:59:53.679138+0000","last_active":"2023-10-06T03:09:49.204791+0000","last_peered":"2023-10-06T03:09:49.204791+0000","last_clean":"2023-10-06T03:09:49.204791+0000","last_became_active":"2023-10-06T02:59:53.678831+0000","last_became_peered":"2023-10-06T02:59:53.678831+0000","last_unstale":"2023-10-06T03:09:49.204791+0000","last_undegraded":"2023-10-06T03:09:49.204791+0000","last_fullsized":"2023-10-06T03:09:49.204791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:25.273960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"26'113","reported_seq":125,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505705+0000","last_change":"2023-10-06T02:59:53.295949+0000","last_active":"2023-10-06T03:09:37.505705+0000","last_peered":"2023-10-06T03:09:37.505705+0000","last_clean":"2023-10-06T03:09:37.505705+0000","last_became_active":"2023-10-06T02:59:53.295697+0000","last_became_peered":"2023-10-06T02:59:53.295697+0000","last_unstale":"2023-10-06T03:09:37.505705+0000","last_undegraded":"2023-10-06T03:09:37.505705+0000","last_fullsized":"2023-10-06T03:09:37.505705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'99","reported_seq":110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203834+0000","last_change":"2023-10-06T02:59:53.673079+0000","last_active":"2023-10-06T03:09:49.203834+0000","last_peered":"2023-10-06T03:09:49.203834+0000","last_clean":"2023-10-06T03:09:49.203834+0000","last_became_active":"2023-10-06T02:59:53.672629+0000","last_became_peered":"2023-10-06T02:59:53.672629+0000","last_unstale":"2023-10-06T03:09:49.203834+0000","last_undegraded":"2023-10-06T03:09:49.203834+0000","last_fullsized":"2023-10-06T03:09:49.203834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'1071","reported_seq":1083,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506322+0000","last_change":"2023-10-06T02:59:53.297170+0000","last_active":"2023-10-06T03:09:37.506322+0000","last_peered":"2023-10-06T03:09:37.506322+0000","last_clean":"2023-10-06T03:09:37.506322+0000","last_became_active":"2023-10-06T02:59:53.296843+0000","last_became_peered":"2023-10-06T02:59:53.296843+0000","last_unstale":"2023-10-06T03:09:37.506322+0000","last_undegraded":"2023-10-06T03:09:37.506322+0000","last_fullsized":"2023-10-06T03:09:37.506322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":8534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"26'89","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206154+0000","last_change":"2023-10-06T02:59:53.675030+0000","last_active":"2023-10-06T03:09:49.206154+0000","last_peered":"2023-10-06T03:09:49.206154+0000","last_clean":"2023-10-06T03:09:49.206154+0000","last_became_active":"2023-10-06T02:59:53.673662+0000","last_became_peered":"2023-10-06T02:59:53.673662+0000","last_unstale":"2023-10-06T03:09:49.206154+0000","last_undegraded":"2023-10-06T03:09:49.206154+0000","last_fullsized":"2023-10-06T03:09:49.206154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"26'537","reported_seq":549,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.501976+0000","last_change":"2023-10-06T02:59:53.299596+0000","last_active":"2023-10-06T03:09:37.501976+0000","last_peered":"2023-10-06T03:09:37.501976+0000","last_clean":"2023-10-06T03:09:37.501976+0000","last_became_active":"2023-10-06T02:59:53.298881+0000","last_became_peered":"2023-10-06T02:59:53.298881+0000","last_unstale":"2023-10-06T03:09:37.501976+0000","last_undegraded":"2023-10-06T03:09:37.501976+0000","last_fullsized":"2023-10-06T03:09:37.501976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.190231+0000","last_change":"2023-10-06T02:59:53.675391+0000","last_active":"2023-10-06T03:09:49.190231+0000","last_peered":"2023-10-06T03:09:49.190231+0000","last_clean":"2023-10-06T03:09:49.190231+0000","last_became_active":"2023-10-06T02:59:53.675092+0000","last_became_peered":"2023-10-06T02:59:53.675092+0000","last_unstale":"2023-10-06T03:09:49.190231+0000","last_undegraded":"2023-10-06T03:09:49.190231+0000","last_fullsized":"2023-10-06T03:09:49.190231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"26'552","reported_seq":564,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.173190+0000","last_change":"2023-10-06T02:59:53.294074+0000","last_active":"2023-10-06T03:08:41.173190+0000","last_peered":"2023-10-06T03:08:41.173190+0000","last_clean":"2023-10-06T03:08:41.173190+0000","last_became_active":"2023-10-06T02:59:53.293752+0000","last_became_peered":"2023-10-06T02:59:53.293752+0000","last_unstale":"2023-10-06T03:08:41.173190+0000","last_undegraded":"2023-10-06T03:08:41.173190+0000","last_fullsized":"2023-10-06T03:08:41.173190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":438,"num_write_kb":4309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":75513604,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":11546,"num_write_kb":80285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151085056,"data_stored":151027208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15189,"ondisk_log_size":15189,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574974,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314548,"kb_used_data":17260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057292,"statfs":{"total":96636764160,"available":96314667008,"internally_reserved":0,"allocated":17674240,"data_stored":17475112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.93400000000000005,"15min":0.85599999999999998},"min":{"1min":0.54000000000000004,"5min":0.497,"15min":0.41099999999999998},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.012,"15min":0.98999999999999999},"min":{"1min":0.72899999999999998,"5min":0.54500000000000004,"15min":0.48099999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.1259999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.58799999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.349,"5min":1.349,"15min":1.389},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.622,"5min":0.52600000000000002,"15min":0.38500000000000001},"max":{"1min":1.008,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.93999999999999995,"15min":0.96699999999999997},"min":{"1min":0.67900000000000005,"5min":0.59799999999999998,"15min":0.55800000000000005},"max":{"1min":1.165,"5min":1.333,"15min":1.4199999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.083,"15min":1.143},"min":{"1min":0.73499999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2450000000000001,"5min":1.3779999999999999,"15min":1.6359999999999999},"last":0.97999999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.89800000000000002,"15min":0.94799999999999995},"min":{"1min":0.64500000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0529999999999999,"5min":1.405,"15min":1.405},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.042,"15min":1.0920000000000001},"min":{"1min":0.81999999999999995,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4319999999999999,"5min":1.4590000000000001,"15min":1.7210000000000001},"last":1.1879999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.875,"15min":0.91100000000000003},"min":{"1min":0.624,"5min":0.624,"15min":0.50600000000000001},"max":{"1min":1.181,"5min":1.1859999999999999,"15min":1.3999999999999999},"last":1.012},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.0469999999999999},"min":{"1min":0.69199999999999995,"5min":0.64400000000000002,"15min":0.57499999999999996},"max":{"1min":1.1850000000000001,"5min":1.395,"15min":1.4590000000000001},"last":1.1599999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.0389999999999999,"15min":1.1539999999999999},"min":{"1min":0.66500000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.51,"5min":1.51,"15min":1.833},"last":1.236},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.018,"15min":1.0549999999999999},"min":{"1min":0.85799999999999998,"5min":0.65600000000000003,"15min":0.59199999999999997},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4990000000000001},"last":1.099}]},{"osd":6,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0669999999999999,"15min":1.119},"min":{"1min":0.80600000000000005,"5min":0.73799999999999999,"15min":0.71399999999999997},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.577},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.149,"15min":1.1899999999999999},"min":{"1min":0.94199999999999995,"5min":0.78100000000000003,"15min":0.76100000000000001},"max":{"1min":1.2949999999999999,"5min":1.5669999999999999,"15min":1.5860000000000001},"last":1.262}]}]},{"osd":6,"up_from":13,"seq":55834574973,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309848,"kb_used_data":4368,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94061992,"statfs":{"total":96636764160,"available":96319479808,"internally_reserved":0,"allocated":4472832,"data_stored":4300972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94199999999999995,"15min":1.026},"min":{"1min":0.54300000000000004,"5min":0.505,"15min":0.49099999999999999},"max":{"1min":1.1950000000000001,"5min":1.343,"15min":6.6989999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98199999999999998,"15min":1.087},"min":{"1min":0.628,"5min":0.54900000000000004,"15min":0.53200000000000003},"max":{"1min":1.302,"5min":1.302,"15min":6.9199999999999999},"last":1.194}]},{"osd":1,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.60999999999999999,"5min":0.56100000000000005,"15min":0.434},"max":{"1min":1.202,"5min":1.282,"15min":1.464},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.88800000000000001,"15min":0.89100000000000001},"min":{"1min":0.57099999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0980000000000001,"5min":1.2849999999999999,"15min":1.2949999999999999},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.89400000000000002,"15min":0.88300000000000001},"min":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.51700000000000002},"max":{"1min":1.0840000000000001,"5min":1.3009999999999999,"15min":1.498},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.91500000000000004,"15min":0.94099999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.171,"5min":1.248,"15min":1.294},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95199999999999996,"15min":0.94099999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.755},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.99299999999999999,"15min":1.012},"min":{"1min":0.69099999999999995,"5min":0.64800000000000002,"15min":0.52500000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.611},"last":1.0620000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90000000000000002,"15min":1.3149999999999999},"min":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.56000000000000005},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":17.757000000000001},"last":1.024},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.099,"15min":1.498},"min":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.536,"5min":1.536,"15min":17.382999999999999},"last":1.3080000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1,"15min":1.133},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.61599999999999999},"max":{"1min":1.3919999999999999,"5min":1.411,"15min":4.3090000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.2490000000000001},"min":{"1min":0.91700000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":4.5709999999999997},"last":1.1080000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.1419999999999999},"min":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.625,"5min":1.625,"15min":1.6990000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.1180000000000001,"15min":1.175},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4590000000000001,"5min":1.5169999999999999,"15min":1.6639999999999999},"last":1.1379999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574974,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326240,"kb_used_data":24856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94045600,"statfs":{"total":96636764160,"available":96302694400,"internally_reserved":0,"allocated":25452544,"data_stored":25273116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.878,"15min":0.88600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.40799999999999997},"max":{"1min":1.0580000000000001,"5min":1.2050000000000001,"15min":1.2849999999999999},"last":1.111},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.98899999999999999,"15min":1.01},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.54800000000000004},"max":{"1min":1.2250000000000001,"5min":1.2629999999999999,"15min":1.3089999999999999},"last":1.012}]},{"osd":1,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.874,"15min":0.89000000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.363},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.91000000000000003,"15min":0.90700000000000003},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.58999999999999997},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2689999999999999},"last":1.194}]},{"osd":2,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.876,"15min":0.90200000000000002},"min":{"1min":0.68000000000000005,"5min":0.621,"15min":0.53400000000000003},"max":{"1min":1.135,"5min":1.27,"15min":1.405},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.69299999999999995,"5min":0.59399999999999997,"15min":0.44500000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.6220000000000001},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.95999999999999996,"15min":0.95399999999999996},"min":{"1min":0.76100000000000001,"5min":0.69599999999999995,"15min":0.59599999999999997},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0580000000000001,"15min":1.048},"min":{"1min":0.84899999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.341,"5min":1.3720000000000001,"15min":1.53},"last":1.044}]},{"osd":4,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.92000000000000004,"15min":0.92300000000000004},"min":{"1min":0.66000000000000003,"5min":0.61399999999999999,"15min":0.46999999999999997},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.135,"5min":1.0800000000000001,"15min":1.069},"min":{"1min":0.88200000000000001,"5min":0.68400000000000005,"15min":0.60599999999999998},"max":{"1min":1.337,"5min":1.4930000000000001,"15min":1.657},"last":1.0840000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0720000000000001,"15min":1.0429999999999999},"min":{"1min":0.76700000000000002,"5min":0.65800000000000003,"15min":0.58399999999999996},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.167},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.093,"15min":1.077},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.441},"max":{"1min":1.536,"5min":1.538,"15min":1.538},"last":1.2569999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.153,"15min":1.1639999999999999},"min":{"1min":0.93400000000000005,"5min":0.748,"15min":0.748},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.542},"last":1.145},{"interface":"front","average":{"1min":1.244,"5min":1.222,"15min":1.2190000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.637,"5min":1.637,"15min":2.048},"last":1.2889999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335192,"kb_used_data":29712,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94036648,"statfs":{"total":96636764160,"available":96293527552,"internally_reserved":0,"allocated":30425088,"data_stored":30237520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.85399999999999998,"15min":0.83299999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0960000000000001,"5min":1.3080000000000001,"15min":1.4830000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.88600000000000001,"15min":0.92100000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.296,"5min":1.341,"15min":1.5289999999999999},"last":0.91200000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.85799999999999998,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.238,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.873,"15min":0.89300000000000002},"min":{"1min":0.58299999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.321,"5min":1.387,"15min":1.387},"last":1.036}]},{"osd":2,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96299999999999997,"15min":0.96699999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2589999999999999,"5min":1.3129999999999999,"15min":1.4159999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0249999999999999,"15min":1.016},"min":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.53700000000000003},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.0960000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94699999999999995,"15min":0.97199999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3859999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96999999999999997,"15min":1.0029999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.56200000000000006},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.97399999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93400000000000005,"15min":0.95799999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.2529999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.02,"15min":1.077},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0129999999999999,"15min":1.0609999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.61299999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0509999999999999,"15min":1.0860000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3759999999999999,"5min":1.454,"15min":1.454},"last":0.94699999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1080000000000001,"15min":1.1739999999999999},"min":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4570000000000001,"5min":1.5629999999999999,"15min":1.7629999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.171,"5min":1.151,"15min":1.21},"min":{"1min":0.753,"5min":0.753,"15min":0.56299999999999994},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.2569999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333692,"kb_used_data":28212,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94038148,"statfs":{"total":96636764160,"available":96295063552,"internally_reserved":0,"allocated":28889088,"data_stored":28711580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.244,"5min":1.2729999999999999,"15min":1.464},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76100000000000001,"15min":0.72399999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.212,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.745,"15min":0.999},"min":{"1min":0.47799999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.222,"5min":1.3049999999999999,"15min":10.970000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.85299999999999998,"15min":0.83899999999999997},"min":{"1min":0.51200000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.387,"5min":1.694,"15min":1.694},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":0.872},"min":{"1min":0.49299999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.107,"5min":1.224,"15min":1.6419999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.90800000000000003,"15min":0.93700000000000006},"min":{"1min":0.60599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.333},"last":0.79400000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98599999999999999,"15min":1.02},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3540000000000001,"5min":1.855,"15min":1.855},"last":0.75},{"interface":"front","average":{"1min":1.101,"5min":1.1000000000000001,"15min":1.1499999999999999},"min":{"1min":0.80000000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.397,"5min":1.792,"15min":2.3570000000000002},"last":1.1040000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0549999999999999,"15min":1.121},"min":{"1min":0.73499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5069999999999999,"5min":1.7410000000000001,"15min":2.218},"last":1.04},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1279999999999999,"15min":1.29},"min":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4550000000000001,"5min":1.5649999999999999,"15min":5.585},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1040000000000001,"15min":1.23},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.77000000000000002},"max":{"1min":1.431,"5min":1.9490000000000001,"15min":5.0860000000000003},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1819999999999999,"15min":1.23},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.591,"5min":1.6679999999999999,"15min":2.3069999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2250000000000001,"15min":1.3600000000000001},"min":{"1min":0.84599999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":5.6239999999999997},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1930000000000001,"15min":1.2909999999999999},"min":{"1min":0.73699999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.482,"5min":2.0950000000000002,"15min":5.1310000000000002},"last":0.91600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313944,"kb_used_data":8464,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94057896,"statfs":{"total":96636764160,"available":96315285504,"internally_reserved":0,"allocated":8667136,"data_stored":8495276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.70899999999999996},"min":{"1min":0.52200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89700000000000002,"5min":1.038,"15min":1.4019999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.746,"15min":0.76300000000000001},"min":{"1min":0.41399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.073,"5min":1.323,"15min":1.8799999999999999},"last":0.81299999999999994}]},{"osd":1,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72199999999999998,"15min":0.73099999999999998},"min":{"1min":0.49299999999999999,"5min":0.375,"15min":0.33300000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83199999999999996,"15min":0.83799999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1719999999999999,"5min":1.252,"15min":1.341},"last":1.1180000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84899999999999998,"15min":0.873},"min":{"1min":0.622,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.875},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.90800000000000003,"15min":0.97899999999999998},"min":{"1min":0.624,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.296,"5min":1.329,"15min":1.587},"last":1.0249999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.96799999999999997,"15min":1.03},"min":{"1min":0.68300000000000005,"5min":0.63900000000000001,"15min":0.56999999999999995},"max":{"1min":1.238,"5min":1.3520000000000001,"15min":1.6779999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.048,"15min":1.109},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4470000000000001,"5min":1.6419999999999999,"15min":1.9350000000000001},"last":0.98299999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0960000000000001,"15min":1.143},"min":{"1min":0.81899999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.1200000000000001},"min":{"1min":0.68300000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3919999999999999,"5min":1.458,"15min":2.048},"last":0.95599999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.149,"15min":1.204},"min":{"1min":0.70499999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.593,"5min":1.6379999999999999,"15min":2.7040000000000002},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.1990000000000001,"15min":1.2490000000000001},"min":{"1min":0.95699999999999996,"5min":0.82499999999999996,"15min":0.68200000000000005},"max":{"1min":1.619,"5min":1.619,"15min":2.2000000000000002},"last":1.282}]},{"osd":7,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1639999999999999,"15min":1.2330000000000001},"min":{"1min":0.73899999999999999,"5min":0.71499999999999997,"15min":0.70999999999999996},"max":{"1min":1.54,"5min":1.633,"15min":2.286},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.2290000000000001,"15min":1.302},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.669,"5min":1.669,"15min":2.3940000000000001},"last":1.1870000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574973,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313944,"kb_used_data":16656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057896,"statfs":{"total":96636764160,"available":96315285504,"internally_reserved":0,"allocated":17055744,"data_stored":16883884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.70099999999999996,"15min":0.68600000000000005},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.23599999999999999},"max":{"1min":1.016,"5min":1.179,"15min":1.179},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.82099999999999995,"15min":0.79800000000000004},"min":{"1min":0.52900000000000003,"5min":0.42299999999999999,"15min":0.39300000000000002},"max":{"1min":1.077,"5min":1.218,"15min":1.3089999999999999},"last":0.99399999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84199999999999997,"15min":0.85999999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36599999999999999},"max":{"1min":1.246,"5min":1.3109999999999999,"15min":1.3169999999999999},"last":1.0329999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.875},"min":{"1min":0.5,"5min":0.5,"15min":0.42299999999999999},"max":{"1min":1.1399999999999999,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83199999999999996,"15min":0.85099999999999998},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.133,"5min":1.2270000000000001,"15min":1.337},"last":0.877}]},{"osd":4,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.95899999999999996,"15min":0.97999999999999998},"min":{"1min":0.66900000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.212,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.115,"15min":1.0980000000000001},"min":{"1min":0.67200000000000004,"5min":0.63800000000000001,"15min":0.437},"max":{"1min":1.556,"5min":1.556,"15min":1.6060000000000001},"last":1.3300000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.075,"15min":1.075},"min":{"1min":0.70399999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4410000000000001,"5min":1.587,"15min":1.587},"last":1.28},{"interface":"front","average":{"1min":1.034,"5min":1.0760000000000001,"15min":1.073},"min":{"1min":0.80500000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.569,"5min":1.911,"15min":1.911},"last":1.244}]},{"osd":6,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1479999999999999,"15min":1.1499999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.70499999999999996},"max":{"1min":1.5049999999999999,"5min":2.081,"15min":2.081},"last":1.532},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1479999999999999,"15min":1.1639999999999999},"min":{"1min":0.72799999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4710000000000001,"5min":1.996,"15min":1.996},"last":1.367}]},{"osd":7,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2050000000000001,"15min":1.1970000000000001},"min":{"1min":0.81000000000000005,"5min":0.71499999999999997,"15min":0.498},"max":{"1min":1.5009999999999999,"5min":1.6879999999999999,"15min":1.8999999999999999},"last":1.466},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.218,"15min":1.2250000000000001},"min":{"1min":0.78900000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.536,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.4350000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322736,"kb_used_data":21352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94049104,"statfs":{"total":96636764160,"available":96306282496,"internally_reserved":0,"allocated":21864448,"data_stored":21683828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70399999999999996,"15min":0.67600000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26900000000000002},"max":{"1min":1.224,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.34899999999999998},"max":{"1min":1.1659999999999999,"5min":1.2709999999999999,"15min":1.2849999999999999},"last":0.80000000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.177,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.40200000000000002},"max":{"1min":0.93700000000000006,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.75800000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82899999999999996,"15min":0.80900000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4019999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.085},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.91600000000000004,"15min":0.93000000000000005},"min":{"1min":0.55500000000000005,"5min":0.46800000000000003,"15min":0.34599999999999997},"max":{"1min":1.327,"5min":1.3580000000000001,"15min":1.599},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.94099999999999995,"15min":0.95499999999999996},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.52},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.117,"15min":1.105},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.8280000000000001,"5min":1.859,"15min":1.859},"last":1.1890000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.135,"15min":1.141},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.161,"5min":1.165,"15min":1.159},"min":{"1min":0.872,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.542,"5min":1.573,"15min":1.573},"last":1.1220000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1759999999999999,"15min":1.1739999999999999},"min":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4930000000000001,"5min":1.6359999999999999,"15min":1.7050000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1080000000000001,"15min":1.111},"min":{"1min":0.68500000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.274,"5min":1.579,"15min":2.1579999999999999},"last":1.149}]},{"osd":7,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1579999999999999,"15min":1.1599999999999999},"min":{"1min":0.72699999999999998,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.413,"5min":1.7090000000000001,"15min":2.2480000000000002},"last":1.224},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.0049999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.248}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20992000,"data_stored":20986792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28610560,"data_stored":28604912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30146560,"data_stored":30130852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16801792,"data_stored":16778076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:09:56.493 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:09:56.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.605+0000 7f2f3ac12700 1 Processor -- start 2023-10-06T03:09:56.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.605+0000 7f2f3ac12700 1 -- start start 2023-10-06T03:09:56.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.605+0000 7f2f3ac12700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2f340b9c50 0x7f2f340ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.605+0000 7f2f3ac12700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f340bb2c0 0x7f2f340a3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.605+0000 7f2f3ac12700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f3406c910 0x7f2f3409f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.605+0000 7f2f3ac12700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f340a0f20 con 0x7f2f340b9c50 2023-10-06T03:09:56.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.605+0000 7f2f3ac12700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3409ef80 con 0x7f2f3406c910 2023-10-06T03:09:56.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.605+0000 7f2f3ac12700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340a2c50 con 0x7f2f340bb2c0 2023-10-06T03:09:56.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f39c10700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2f340b9c50 0x7f2f340ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3a411700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f3406c910 0x7f2f3409f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f39c10700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2f340b9c50 0x7f2f340ba020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50794/0 (socket says 172.21.15.27:50794) 2023-10-06T03:09:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3940f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f340bb2c0 0x7f2f340a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f39c10700 1 -- 172.21.15.27:0/941832194 learned_addr learned my addr 172.21.15.27:0/941832194 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3a411700 1 -- 172.21.15.27:0/941832194 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f340bb2c0 msgr2=0x7f2f340a3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:09:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3a411700 1 --2- 172.21.15.27:0/941832194 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f340bb2c0 0x7f2f340a3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3a411700 1 -- 172.21.15.27:0/941832194 >> v2:172.21.15.27:3300/0 conn(0x7f2f340b9c50 msgr2=0x7f2f340ba020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:09:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3a411700 1 --2- 172.21.15.27:0/941832194 >> v2:172.21.15.27:3300/0 conn(0x7f2f340b9c50 0x7f2f340ba020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3a411700 1 -- 172.21.15.27:0/941832194 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340a2f30 con 0x7f2f3406c910 2023-10-06T03:09:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f39c10700 1 --2- 172.21.15.27:0/941832194 >> v2:172.21.15.27:3300/0 conn(0x7f2f340b9c50 0x7f2f340ba020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:09:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3a411700 1 --2- 172.21.15.27:0/941832194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f3406c910 0x7f2f3409f410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2f34068300 tx=0x7f2f2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fceaa7bfafaf9311 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f38c0e700 1 -- 172.21.15.27:0/941832194 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c011630 con 0x7f2f3406c910 2023-10-06T03:09:56.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f38c0e700 1 -- 172.21.15.27:0/941832194 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c0117b0 con 0x7f2f3406c910 2023-10-06T03:09:56.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f38c0e700 1 -- 172.21.15.27:0/941832194 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c011b70 con 0x7f2f3406c910 2023-10-06T03:09:56.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3ac12700 1 -- 172.21.15.27:0/941832194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f3406c910 msgr2=0x7f2f3409f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3ac12700 1 --2- 172.21.15.27:0/941832194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f3406c910 0x7f2f3409f410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2f34068300 tx=0x7f2f2c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3ac12700 1 -- 172.21.15.27:0/941832194 shutdown_connections 2023-10-06T03:09:56.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3ac12700 1 --2- 172.21.15.27:0/941832194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f3406c910 0x7f2f3409f410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3ac12700 1 --2- 172.21.15.27:0/941832194 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f340bb2c0 0x7f2f340a3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3ac12700 1 --2- 172.21.15.27:0/941832194 >> v2:172.21.15.27:3300/0 conn(0x7f2f340b9c50 0x7f2f340ba020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3ac12700 1 -- 172.21.15.27:0/941832194 >> 172.21.15.27:0/941832194 conn(0x7f2f3406eb10 msgr2=0x7f2f340ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:56.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3ac12700 1 -- 172.21.15.27:0/941832194 shutdown_connections 2023-10-06T03:09:56.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.609+0000 7f2f3ac12700 1 -- 172.21.15.27:0/941832194 wait complete. 2023-10-06T03:09:56.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3ac12700 1 Processor -- start 2023-10-06T03:09:56.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3ac12700 1 -- start start 2023-10-06T03:09:56.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3ac12700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f3406c910 0x7f2f3415ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3ac12700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f340b9c50 0x7f2f340b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3ac12700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f340bb2c0 0x7f2f340b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3ac12700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340b51b0 con 0x7f2f340bb2c0 2023-10-06T03:09:56.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3ac12700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340b4230 con 0x7f2f3406c910 2023-10-06T03:09:56.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3ac12700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340b3c20 con 0x7f2f340b9c50 2023-10-06T03:09:56.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f39c10700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f3406c910 0x7f2f3415ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3a411700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f340bb2c0 0x7f2f340b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f39c10700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f3406c910 0x7f2f3415ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:59144/0 (socket says 172.21.15.27:59144) 2023-10-06T03:09:56.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f39c10700 1 -- 172.21.15.27:0/3533511951 learned_addr learned my addr 172.21.15.27:0/3533511951 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:56.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3940f700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f340b9c50 0x7f2f340b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3a411700 1 -- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f340b9c50 msgr2=0x7f2f340b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3a411700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f340b9c50 0x7f2f340b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3a411700 1 -- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f3406c910 msgr2=0x7f2f3415ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3a411700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f3406c910 0x7f2f3415ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3a411700 1 -- 172.21.15.27:0/3533511951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f240094f0 con 0x7f2f340bb2c0 2023-10-06T03:09:56.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f39c10700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f3406c910 0x7f2f3415ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:09:56.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3a411700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f340bb2c0 0x7f2f340b2dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2f34068350 tx=0x7f2f2c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:56.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f29ffb700 1 -- 172.21.15.27:0/3533511951 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c01f070 con 0x7f2f340bb2c0 2023-10-06T03:09:56.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f29ffb700 1 -- 172.21.15.27:0/3533511951 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c011630 con 0x7f2f340bb2c0 2023-10-06T03:09:56.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3ac12700 1 -- 172.21.15.27:0/3533511951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c009420 con 0x7f2f340bb2c0 2023-10-06T03:09:56.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f29ffb700 1 -- 172.21.15.27:0/3533511951 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c011b70 con 0x7f2f340bb2c0 2023-10-06T03:09:56.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.613+0000 7f2f3ac12700 1 -- 172.21.15.27:0/3533511951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3406ad90 con 0x7f2f340bb2c0 2023-10-06T03:09:56.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.617+0000 7f2f3ac12700 1 -- 172.21.15.27:0/3533511951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f340b4c00 con 0x7f2f340bb2c0 2023-10-06T03:09:56.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.617+0000 7f2f29ffb700 1 -- 172.21.15.27:0/3533511951 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2f2c023070 con 0x7f2f340bb2c0 2023-10-06T03:09:56.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.617+0000 7f2f29ffb700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2f18060580 0x7f2f18062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.617+0000 7f2f29ffb700 1 -- 172.21.15.27:0/3533511951 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f2f2c07dd10 con 0x7f2f340bb2c0 2023-10-06T03:09:56.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.617+0000 7f2f39c10700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2f18060580 0x7f2f18062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.617+0000 7f2f39c10700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2f18060580 0x7f2f18062a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f3406a990 tx=0x7f2f24009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:56.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.625+0000 7f2f29ffb700 1 -- 172.21.15.27:0/3533511951 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2f2c04e160 con 0x7f2f340bb2c0 2023-10-06T03:09:56.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.781+0000 7f2f3ac12700 1 -- 172.21.15.27:0/3533511951 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f340b4370 con 0x7f2f18060580 2023-10-06T03:09:56.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.801+0000 7f2f29ffb700 1 -- 172.21.15.27:0/3533511951 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310316 (secure 0 0 0) 0x7f2f340b4370 con 0x7f2f18060580 2023-10-06T03:09:56.805 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:09:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.805+0000 7f2f3ac12700 1 -- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2f18060580 msgr2=0x7f2f18062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.805+0000 7f2f3ac12700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2f18060580 0x7f2f18062a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f3406a990 tx=0x7f2f24009250 comp rx=0 tx=0).stop 2023-10-06T03:09:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.805+0000 7f2f3ac12700 1 -- 172.21.15.27:0/3533511951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f340bb2c0 msgr2=0x7f2f340b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.805+0000 7f2f3ac12700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f340bb2c0 0x7f2f340b2dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2f34068350 tx=0x7f2f2c017000 comp rx=0 tx=0).stop 2023-10-06T03:09:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.805+0000 7f2f3ac12700 1 -- 172.21.15.27:0/3533511951 shutdown_connections 2023-10-06T03:09:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.805+0000 7f2f3ac12700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2f18060580 0x7f2f18062a30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.805+0000 7f2f3ac12700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f340bb2c0 0x7f2f340b2dd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.805+0000 7f2f3ac12700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f340b9c50 0x7f2f340b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.805+0000 7f2f3ac12700 1 --2- 172.21.15.27:0/3533511951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f3406c910 0x7f2f3415ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.805+0000 7f2f3ac12700 1 -- 172.21.15.27:0/3533511951 >> 172.21.15.27:0/3533511951 conn(0x7f2f3406eb10 msgr2=0x7f2f3409f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.805+0000 7f2f3ac12700 1 -- 172.21.15.27:0/3533511951 shutdown_connections 2023-10-06T03:09:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.805+0000 7f2f3ac12700 1 -- 172.21.15.27:0/3533511951 wait complete. 2023-10-06T03:09:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-10-06T03:09:56.821 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2023-10-06T03:09:55.183383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76103972,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":599,"num_read_kb":1179,"num_write":11705,"num_write_kb":82701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20586,"ondisk_log_size":20586,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2570144,"kb_used_data":150880,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752404576,"statfs":{"total":773094113280,"available":770462285824,"internally_reserved":0,"allocated":154501120,"data_stored":153061288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":69,"apply_latency_ms":69,"commit_latency_ns":69000000,"apply_latency_ns":69000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1161,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004546"},"pg_stats":[{"pgid":"4.3f","version":"26'91","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205300+0000","last_change":"2023-10-06T02:59:53.681789+0000","last_active":"2023-10-06T03:09:49.205300+0000","last_peered":"2023-10-06T03:09:49.205300+0000","last_clean":"2023-10-06T03:09:49.205300+0000","last_became_active":"2023-10-06T02:59:53.681495+0000","last_became_peered":"2023-10-06T02:59:53.681495+0000","last_unstale":"2023-10-06T03:09:49.205300+0000","last_undegraded":"2023-10-06T03:09:49.205300+0000","last_fullsized":"2023-10-06T03:09:49.205300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:19.626429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194862+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T03:09:49.194862+0000","last_peered":"2023-10-06T03:09:49.194862+0000","last_clean":"2023-10-06T03:09:49.194862+0000","last_became_active":"2023-10-06T02:59:53.681849+0000","last_became_peered":"2023-10-06T02:59:53.681849+0000","last_unstale":"2023-10-06T03:09:49.194862+0000","last_undegraded":"2023-10-06T03:09:49.194862+0000","last_fullsized":"2023-10-06T03:09:49.194862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"26'65","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195589+0000","last_change":"2023-10-06T02:59:53.679536+0000","last_active":"2023-10-06T03:09:49.195589+0000","last_peered":"2023-10-06T03:09:49.195589+0000","last_clean":"2023-10-06T03:09:49.195589+0000","last_became_active":"2023-10-06T02:59:53.678264+0000","last_became_peered":"2023-10-06T02:59:53.678264+0000","last_unstale":"2023-10-06T03:09:49.195589+0000","last_undegraded":"2023-10-06T03:09:49.195589+0000","last_fullsized":"2023-10-06T03:09:49.195589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:18.566933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"26'76","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.178090+0000","last_change":"2023-10-06T02:59:53.671821+0000","last_active":"2023-10-06T03:09:49.178090+0000","last_peered":"2023-10-06T03:09:49.178090+0000","last_clean":"2023-10-06T03:09:49.178090+0000","last_became_active":"2023-10-06T02:59:53.671555+0000","last_became_peered":"2023-10-06T02:59:53.671555+0000","last_unstale":"2023-10-06T03:09:49.178090+0000","last_undegraded":"2023-10-06T03:09:49.178090+0000","last_fullsized":"2023-10-06T03:09:49.178090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:36:28.006545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"26'85","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205702+0000","last_change":"2023-10-06T02:59:53.682691+0000","last_active":"2023-10-06T03:09:49.205702+0000","last_peered":"2023-10-06T03:09:49.205702+0000","last_clean":"2023-10-06T03:09:49.205702+0000","last_became_active":"2023-10-06T02:59:53.682399+0000","last_became_peered":"2023-10-06T02:59:53.682399+0000","last_unstale":"2023-10-06T03:09:49.205702+0000","last_undegraded":"2023-10-06T03:09:49.205702+0000","last_fullsized":"2023-10-06T03:09:49.205702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195685+0000","last_change":"2023-10-06T02:59:53.678208+0000","last_active":"2023-10-06T03:09:49.195685+0000","last_peered":"2023-10-06T03:09:49.195685+0000","last_clean":"2023-10-06T03:09:49.195685+0000","last_became_active":"2023-10-06T02:59:53.676481+0000","last_became_peered":"2023-10-06T02:59:53.676481+0000","last_unstale":"2023-10-06T03:09:49.195685+0000","last_undegraded":"2023-10-06T03:09:49.195685+0000","last_fullsized":"2023-10-06T03:09:49.195685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:42.767531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"26'93","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194495+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T03:09:49.194495+0000","last_peered":"2023-10-06T03:09:49.194495+0000","last_clean":"2023-10-06T03:09:49.194495+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:09:49.194495+0000","last_undegraded":"2023-10-06T03:09:49.194495+0000","last_fullsized":"2023-10-06T03:09:49.194495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"26'77","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196046+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T03:09:49.196046+0000","last_peered":"2023-10-06T03:09:49.196046+0000","last_clean":"2023-10-06T03:09:49.196046+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:09:49.196046+0000","last_undegraded":"2023-10-06T03:09:49.196046+0000","last_fullsized":"2023-10-06T03:09:49.196046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"26'89","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205683+0000","last_change":"2023-10-06T02:59:53.680395+0000","last_active":"2023-10-06T03:09:49.205683+0000","last_peered":"2023-10-06T03:09:49.205683+0000","last_clean":"2023-10-06T03:09:49.205683+0000","last_became_active":"2023-10-06T02:59:53.680086+0000","last_became_peered":"2023-10-06T02:59:53.680086+0000","last_unstale":"2023-10-06T03:09:49.205683+0000","last_undegraded":"2023-10-06T03:09:49.205683+0000","last_fullsized":"2023-10-06T03:09:49.205683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"26'73","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.189574+0000","last_change":"2023-10-06T02:59:53.675582+0000","last_active":"2023-10-06T03:09:49.189574+0000","last_peered":"2023-10-06T03:09:49.189574+0000","last_clean":"2023-10-06T03:09:49.189574+0000","last_became_active":"2023-10-06T02:59:53.675243+0000","last_became_peered":"2023-10-06T02:59:53.675243+0000","last_unstale":"2023-10-06T03:09:49.189574+0000","last_undegraded":"2023-10-06T03:09:49.189574+0000","last_fullsized":"2023-10-06T03:09:49.189574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194979+0000","last_change":"2023-10-06T02:59:53.679489+0000","last_active":"2023-10-06T03:09:49.194979+0000","last_peered":"2023-10-06T03:09:49.194979+0000","last_clean":"2023-10-06T03:09:49.194979+0000","last_became_active":"2023-10-06T02:59:53.678985+0000","last_became_peered":"2023-10-06T02:59:53.678985+0000","last_unstale":"2023-10-06T03:09:49.194979+0000","last_undegraded":"2023-10-06T03:09:49.194979+0000","last_fullsized":"2023-10-06T03:09:49.194979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:12.576010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.199369+0000","last_change":"2023-10-06T02:59:53.682799+0000","last_active":"2023-10-06T03:09:49.199369+0000","last_peered":"2023-10-06T03:09:49.199369+0000","last_clean":"2023-10-06T03:09:49.199369+0000","last_became_active":"2023-10-06T02:59:53.682464+0000","last_became_peered":"2023-10-06T02:59:53.682464+0000","last_unstale":"2023-10-06T03:09:49.199369+0000","last_undegraded":"2023-10-06T03:09:49.199369+0000","last_fullsized":"2023-10-06T03:09:49.199369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:06.403449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"26'84","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192420+0000","last_change":"2023-10-06T03:00:34.741799+0000","last_active":"2023-10-06T03:09:49.192420+0000","last_peered":"2023-10-06T03:09:49.192420+0000","last_clean":"2023-10-06T03:09:49.192420+0000","last_became_active":"2023-10-06T03:00:34.741173+0000","last_became_peered":"2023-10-06T03:00:34.741173+0000","last_unstale":"2023-10-06T03:09:49.192420+0000","last_undegraded":"2023-10-06T03:09:49.192420+0000","last_fullsized":"2023-10-06T03:09:49.192420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:30.493018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"26'74","reported_seq":85,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191870+0000","last_change":"2023-10-06T02:59:53.673321+0000","last_active":"2023-10-06T03:09:49.191870+0000","last_peered":"2023-10-06T03:09:49.191870+0000","last_clean":"2023-10-06T03:09:49.191870+0000","last_became_active":"2023-10-06T02:59:53.672957+0000","last_became_peered":"2023-10-06T02:59:53.672957+0000","last_unstale":"2023-10-06T03:09:49.191870+0000","last_undegraded":"2023-10-06T03:09:49.191870+0000","last_fullsized":"2023-10-06T03:09:49.191870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"26'78","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195086+0000","last_change":"2023-10-06T02:59:53.686669+0000","last_active":"2023-10-06T03:09:49.195086+0000","last_peered":"2023-10-06T03:09:49.195086+0000","last_clean":"2023-10-06T03:09:49.195086+0000","last_became_active":"2023-10-06T02:59:53.686352+0000","last_became_peered":"2023-10-06T02:59:53.686352+0000","last_unstale":"2023-10-06T03:09:49.195086+0000","last_undegraded":"2023-10-06T03:09:49.195086+0000","last_fullsized":"2023-10-06T03:09:49.195086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"26'88","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.197410+0000","last_change":"2023-10-06T02:59:53.680975+0000","last_active":"2023-10-06T03:09:49.197410+0000","last_peered":"2023-10-06T03:09:49.197410+0000","last_clean":"2023-10-06T03:09:49.197410+0000","last_became_active":"2023-10-06T02:59:53.678449+0000","last_became_peered":"2023-10-06T02:59:53.678449+0000","last_unstale":"2023-10-06T03:09:49.197410+0000","last_undegraded":"2023-10-06T03:09:49.197410+0000","last_fullsized":"2023-10-06T03:09:49.197410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:18.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205375+0000","last_change":"2023-10-06T02:59:53.680344+0000","last_active":"2023-10-06T03:09:49.205375+0000","last_peered":"2023-10-06T03:09:49.205375+0000","last_clean":"2023-10-06T03:09:49.205375+0000","last_became_active":"2023-10-06T02:59:53.680028+0000","last_became_peered":"2023-10-06T02:59:53.680028+0000","last_unstale":"2023-10-06T03:09:49.205375+0000","last_undegraded":"2023-10-06T03:09:49.205375+0000","last_fullsized":"2023-10-06T03:09:49.205375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"26'76","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191223+0000","last_change":"2023-10-06T02:59:53.678143+0000","last_active":"2023-10-06T03:09:49.191223+0000","last_peered":"2023-10-06T03:09:49.191223+0000","last_clean":"2023-10-06T03:09:49.191223+0000","last_became_active":"2023-10-06T02:59:53.676602+0000","last_became_peered":"2023-10-06T02:59:53.676602+0000","last_unstale":"2023-10-06T03:09:49.191223+0000","last_undegraded":"2023-10-06T03:09:49.191223+0000","last_fullsized":"2023-10-06T03:09:49.191223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:29.621147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196673+0000","last_change":"2023-10-06T02:59:53.675935+0000","last_active":"2023-10-06T03:09:49.196673+0000","last_peered":"2023-10-06T03:09:49.196673+0000","last_clean":"2023-10-06T03:09:49.196673+0000","last_became_active":"2023-10-06T02:59:53.675657+0000","last_became_peered":"2023-10-06T02:59:53.675657+0000","last_unstale":"2023-10-06T03:09:49.196673+0000","last_undegraded":"2023-10-06T03:09:49.196673+0000","last_fullsized":"2023-10-06T03:09:49.196673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:56.862647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191684+0000","last_change":"2023-10-06T02:59:53.673043+0000","last_active":"2023-10-06T03:09:49.191684+0000","last_peered":"2023-10-06T03:09:49.191684+0000","last_clean":"2023-10-06T03:09:49.191684+0000","last_became_active":"2023-10-06T02:59:53.672690+0000","last_became_peered":"2023-10-06T02:59:53.672690+0000","last_unstale":"2023-10-06T03:09:49.191684+0000","last_undegraded":"2023-10-06T03:09:49.191684+0000","last_fullsized":"2023-10-06T03:09:49.191684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"26'83","reported_seq":94,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194716+0000","last_change":"2023-10-06T02:59:53.684492+0000","last_active":"2023-10-06T03:09:49.194716+0000","last_peered":"2023-10-06T03:09:49.194716+0000","last_clean":"2023-10-06T03:09:49.194716+0000","last_became_active":"2023-10-06T02:59:53.684145+0000","last_became_peered":"2023-10-06T02:59:53.684145+0000","last_unstale":"2023-10-06T03:09:49.194716+0000","last_undegraded":"2023-10-06T03:09:49.194716+0000","last_fullsized":"2023-10-06T03:09:49.194716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"26'88","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200847+0000","last_change":"2023-10-06T02:59:53.683256+0000","last_active":"2023-10-06T03:09:49.200847+0000","last_peered":"2023-10-06T03:09:49.200847+0000","last_clean":"2023-10-06T03:09:49.200847+0000","last_became_active":"2023-10-06T02:59:53.682948+0000","last_became_peered":"2023-10-06T02:59:53.682948+0000","last_unstale":"2023-10-06T03:09:49.200847+0000","last_undegraded":"2023-10-06T03:09:49.200847+0000","last_fullsized":"2023-10-06T03:09:49.200847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"26'69","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206413+0000","last_change":"2023-10-06T02:59:53.675936+0000","last_active":"2023-10-06T03:09:49.206413+0000","last_peered":"2023-10-06T03:09:49.206413+0000","last_clean":"2023-10-06T03:09:49.206413+0000","last_became_active":"2023-10-06T02:59:53.675319+0000","last_became_peered":"2023-10-06T02:59:53.675319+0000","last_unstale":"2023-10-06T03:09:49.206413+0000","last_undegraded":"2023-10-06T03:09:49.206413+0000","last_fullsized":"2023-10-06T03:09:49.206413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195262+0000","last_change":"2023-10-06T02:59:53.686758+0000","last_active":"2023-10-06T03:09:49.195262+0000","last_peered":"2023-10-06T03:09:49.195262+0000","last_clean":"2023-10-06T03:09:49.195262+0000","last_became_active":"2023-10-06T02:59:53.686007+0000","last_became_peered":"2023-10-06T02:59:53.686007+0000","last_unstale":"2023-10-06T03:09:49.195262+0000","last_undegraded":"2023-10-06T03:09:49.195262+0000","last_fullsized":"2023-10-06T03:09:49.195262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"26'91","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200675+0000","last_change":"2023-10-06T02:59:53.682853+0000","last_active":"2023-10-06T03:09:49.200675+0000","last_peered":"2023-10-06T03:09:49.200675+0000","last_clean":"2023-10-06T03:09:49.200675+0000","last_became_active":"2023-10-06T02:59:53.682511+0000","last_became_peered":"2023-10-06T02:59:53.682511+0000","last_unstale":"2023-10-06T03:09:49.200675+0000","last_undegraded":"2023-10-06T03:09:49.200675+0000","last_fullsized":"2023-10-06T03:09:49.200675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"26'98","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196456+0000","last_change":"2023-10-06T02:59:53.682001+0000","last_active":"2023-10-06T03:09:49.196456+0000","last_peered":"2023-10-06T03:09:49.196456+0000","last_clean":"2023-10-06T03:09:49.196456+0000","last_became_active":"2023-10-06T02:59:53.681732+0000","last_became_peered":"2023-10-06T02:59:53.681732+0000","last_unstale":"2023-10-06T03:09:49.196456+0000","last_undegraded":"2023-10-06T03:09:49.196456+0000","last_fullsized":"2023-10-06T03:09:49.196456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.173694+0000","last_change":"2023-10-06T02:59:53.676598+0000","last_active":"2023-10-06T03:09:49.173694+0000","last_peered":"2023-10-06T03:09:49.173694+0000","last_clean":"2023-10-06T03:09:49.173694+0000","last_became_active":"2023-10-06T02:59:53.676284+0000","last_became_peered":"2023-10-06T02:59:53.676284+0000","last_unstale":"2023-10-06T03:09:49.173694+0000","last_undegraded":"2023-10-06T03:09:49.173694+0000","last_fullsized":"2023-10-06T03:09:49.173694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"26'61","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195455+0000","last_change":"2023-10-06T02:59:53.687275+0000","last_active":"2023-10-06T03:09:49.195455+0000","last_peered":"2023-10-06T03:09:49.195455+0000","last_clean":"2023-10-06T03:09:49.195455+0000","last_became_active":"2023-10-06T02:59:53.686912+0000","last_became_peered":"2023-10-06T02:59:53.686912+0000","last_unstale":"2023-10-06T03:09:49.195455+0000","last_undegraded":"2023-10-06T03:09:49.195455+0000","last_fullsized":"2023-10-06T03:09:49.195455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203610+0000","last_change":"2023-10-06T02:59:53.685421+0000","last_active":"2023-10-06T03:09:49.203610+0000","last_peered":"2023-10-06T03:09:49.203610+0000","last_clean":"2023-10-06T03:09:49.203610+0000","last_became_active":"2023-10-06T02:59:53.684806+0000","last_became_peered":"2023-10-06T02:59:53.684806+0000","last_unstale":"2023-10-06T03:09:49.203610+0000","last_undegraded":"2023-10-06T03:09:49.203610+0000","last_fullsized":"2023-10-06T03:09:49.203610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191736+0000","last_change":"2023-10-06T02:59:53.676085+0000","last_active":"2023-10-06T03:09:49.191736+0000","last_peered":"2023-10-06T03:09:49.191736+0000","last_clean":"2023-10-06T03:09:49.191736+0000","last_became_active":"2023-10-06T02:59:53.675718+0000","last_became_peered":"2023-10-06T02:59:53.675718+0000","last_unstale":"2023-10-06T03:09:49.191736+0000","last_undegraded":"2023-10-06T03:09:49.191736+0000","last_fullsized":"2023-10-06T03:09:49.191736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:00.548441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206351+0000","last_change":"2023-10-06T02:59:53.676118+0000","last_active":"2023-10-06T03:09:49.206351+0000","last_peered":"2023-10-06T03:09:49.206351+0000","last_clean":"2023-10-06T03:09:49.206351+0000","last_became_active":"2023-10-06T02:59:53.675682+0000","last_became_peered":"2023-10-06T02:59:53.675682+0000","last_unstale":"2023-10-06T03:09:49.206351+0000","last_undegraded":"2023-10-06T03:09:49.206351+0000","last_fullsized":"2023-10-06T03:09:49.206351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192921+0000","last_change":"2023-10-06T02:59:53.673225+0000","last_active":"2023-10-06T03:09:49.192921+0000","last_peered":"2023-10-06T03:09:49.192921+0000","last_clean":"2023-10-06T03:09:49.192921+0000","last_became_active":"2023-10-06T02:59:53.672930+0000","last_became_peered":"2023-10-06T02:59:53.672930+0000","last_unstale":"2023-10-06T03:09:49.192921+0000","last_undegraded":"2023-10-06T03:09:49.192921+0000","last_fullsized":"2023-10-06T03:09:49.192921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:02.845187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195360+0000","last_change":"2023-10-06T02:59:53.678742+0000","last_active":"2023-10-06T03:09:49.195360+0000","last_peered":"2023-10-06T03:09:49.195360+0000","last_clean":"2023-10-06T03:09:49.195360+0000","last_became_active":"2023-10-06T02:59:53.678471+0000","last_became_peered":"2023-10-06T02:59:53.678471+0000","last_unstale":"2023-10-06T03:09:49.195360+0000","last_undegraded":"2023-10-06T03:09:49.195360+0000","last_fullsized":"2023-10-06T03:09:49.195360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'1517","reported_seq":1529,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.502219+0000","last_change":"2023-10-06T02:59:53.297136+0000","last_active":"2023-10-06T03:09:37.502219+0000","last_peered":"2023-10-06T03:09:37.502219+0000","last_clean":"2023-10-06T03:09:37.502219+0000","last_became_active":"2023-10-06T02:59:53.296816+0000","last_became_peered":"2023-10-06T02:59:53.296816+0000","last_unstale":"2023-10-06T03:09:37.502219+0000","last_undegraded":"2023-10-06T03:09:37.502219+0000","last_fullsized":"2023-10-06T03:09:37.502219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:58.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1406,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'65","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.175064+0000","last_change":"2023-10-06T02:59:53.684876+0000","last_active":"2023-10-06T03:09:49.175064+0000","last_peered":"2023-10-06T03:09:49.175064+0000","last_clean":"2023-10-06T03:09:49.175064+0000","last_became_active":"2023-10-06T02:59:53.684522+0000","last_became_peered":"2023-10-06T02:59:53.684522+0000","last_unstale":"2023-10-06T03:09:49.175064+0000","last_undegraded":"2023-10-06T03:09:49.175064+0000","last_fullsized":"2023-10-06T03:09:49.175064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"26'125","reported_seq":137,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.507239+0000","last_change":"2023-10-06T02:59:53.292700+0000","last_active":"2023-10-06T03:09:37.507239+0000","last_peered":"2023-10-06T03:09:37.507239+0000","last_clean":"2023-10-06T03:09:37.507239+0000","last_became_active":"2023-10-06T02:59:53.292378+0000","last_became_peered":"2023-10-06T02:59:53.292378+0000","last_unstale":"2023-10-06T03:09:37.507239+0000","last_undegraded":"2023-10-06T03:09:37.507239+0000","last_fullsized":"2023-10-06T03:09:37.507239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204649+0000","last_change":"2023-10-06T02:59:53.675542+0000","last_active":"2023-10-06T03:09:49.204649+0000","last_peered":"2023-10-06T03:09:49.204649+0000","last_clean":"2023-10-06T03:09:49.204649+0000","last_became_active":"2023-10-06T02:59:53.675219+0000","last_became_peered":"2023-10-06T02:59:53.675219+0000","last_unstale":"2023-10-06T03:09:49.204649+0000","last_undegraded":"2023-10-06T03:09:49.204649+0000","last_fullsized":"2023-10-06T03:09:49.204649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"26'124","reported_seq":136,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.177954+0000","last_change":"2023-10-06T02:59:53.302122+0000","last_active":"2023-10-06T03:08:41.177954+0000","last_peered":"2023-10-06T03:08:41.177954+0000","last_clean":"2023-10-06T03:08:41.177954+0000","last_became_active":"2023-10-06T02:59:53.301737+0000","last_became_peered":"2023-10-06T02:59:53.301737+0000","last_unstale":"2023-10-06T03:08:41.177954+0000","last_undegraded":"2023-10-06T03:08:41.177954+0000","last_fullsized":"2023-10-06T03:08:41.177954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203476+0000","last_change":"2023-10-06T02:59:53.684854+0000","last_active":"2023-10-06T03:09:49.203476+0000","last_peered":"2023-10-06T03:09:49.203476+0000","last_clean":"2023-10-06T03:09:49.203476+0000","last_became_active":"2023-10-06T02:59:53.684527+0000","last_became_peered":"2023-10-06T02:59:53.684527+0000","last_unstale":"2023-10-06T03:09:49.203476+0000","last_undegraded":"2023-10-06T03:09:49.203476+0000","last_fullsized":"2023-10-06T03:09:49.203476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"26'135","reported_seq":147,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.502731+0000","last_change":"2023-10-06T02:59:53.294103+0000","last_active":"2023-10-06T03:09:37.502731+0000","last_peered":"2023-10-06T03:09:37.502731+0000","last_clean":"2023-10-06T03:09:37.502731+0000","last_became_active":"2023-10-06T02:59:53.293707+0000","last_became_peered":"2023-10-06T02:59:53.293707+0000","last_unstale":"2023-10-06T03:09:37.502731+0000","last_undegraded":"2023-10-06T03:09:37.502731+0000","last_fullsized":"2023-10-06T03:09:37.502731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"26'118","reported_seq":130,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505440+0000","last_change":"2023-10-06T02:59:53.296507+0000","last_active":"2023-10-06T03:09:37.505440+0000","last_peered":"2023-10-06T03:09:37.505440+0000","last_clean":"2023-10-06T03:09:37.505440+0000","last_became_active":"2023-10-06T02:59:53.296230+0000","last_became_peered":"2023-10-06T02:59:53.296230+0000","last_unstale":"2023-10-06T03:09:37.505440+0000","last_undegraded":"2023-10-06T03:09:37.505440+0000","last_fullsized":"2023-10-06T03:09:37.505440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"26'90","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.176351+0000","last_change":"2023-10-06T02:59:53.684046+0000","last_active":"2023-10-06T03:09:49.176351+0000","last_peered":"2023-10-06T03:09:49.176351+0000","last_clean":"2023-10-06T03:09:49.176351+0000","last_became_active":"2023-10-06T02:59:53.683705+0000","last_became_peered":"2023-10-06T02:59:53.683705+0000","last_unstale":"2023-10-06T03:09:49.176351+0000","last_undegraded":"2023-10-06T03:09:49.176351+0000","last_fullsized":"2023-10-06T03:09:49.176351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'106","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.175579+0000","last_change":"2023-10-06T02:59:53.296465+0000","last_active":"2023-10-06T03:08:41.175579+0000","last_peered":"2023-10-06T03:08:41.175579+0000","last_clean":"2023-10-06T03:08:41.175579+0000","last_became_active":"2023-10-06T02:59:53.296225+0000","last_became_peered":"2023-10-06T02:59:53.296225+0000","last_unstale":"2023-10-06T03:08:41.175579+0000","last_undegraded":"2023-10-06T03:08:41.175579+0000","last_fullsized":"2023-10-06T03:08:41.175579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'81","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.198537+0000","last_change":"2023-10-06T02:59:53.683216+0000","last_active":"2023-10-06T03:09:49.198537+0000","last_peered":"2023-10-06T03:09:49.198537+0000","last_clean":"2023-10-06T03:09:49.198537+0000","last_became_active":"2023-10-06T02:59:53.682938+0000","last_became_peered":"2023-10-06T02:59:53.682938+0000","last_unstale":"2023-10-06T03:09:49.198537+0000","last_undegraded":"2023-10-06T03:09:49.198537+0000","last_fullsized":"2023-10-06T03:09:49.198537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"26'620","reported_seq":632,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.502276+0000","last_change":"2023-10-06T02:59:53.293929+0000","last_active":"2023-10-06T03:09:37.502276+0000","last_peered":"2023-10-06T03:09:37.502276+0000","last_clean":"2023-10-06T03:09:37.502276+0000","last_became_active":"2023-10-06T02:59:53.293602+0000","last_became_peered":"2023-10-06T02:59:53.293602+0000","last_unstale":"2023-10-06T03:09:37.502276+0000","last_undegraded":"2023-10-06T03:09:37.502276+0000","last_fullsized":"2023-10-06T03:09:37.502276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196618+0000","last_change":"2023-10-06T02:59:53.672111+0000","last_active":"2023-10-06T03:09:49.196618+0000","last_peered":"2023-10-06T03:09:49.196618+0000","last_clean":"2023-10-06T03:09:49.196618+0000","last_became_active":"2023-10-06T02:59:53.671511+0000","last_became_peered":"2023-10-06T02:59:53.671511+0000","last_unstale":"2023-10-06T03:09:49.196618+0000","last_undegraded":"2023-10-06T03:09:49.196618+0000","last_fullsized":"2023-10-06T03:09:49.196618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'134","reported_seq":146,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.170376+0000","last_change":"2023-10-06T02:59:53.300059+0000","last_active":"2023-10-06T03:08:41.170376+0000","last_peered":"2023-10-06T03:08:41.170376+0000","last_clean":"2023-10-06T03:08:41.170376+0000","last_became_active":"2023-10-06T02:59:53.299715+0000","last_became_peered":"2023-10-06T02:59:53.299715+0000","last_unstale":"2023-10-06T03:08:41.170376+0000","last_undegraded":"2023-10-06T03:08:41.170376+0000","last_fullsized":"2023-10-06T03:08:41.170376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"26'94","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200602+0000","last_change":"2023-10-06T02:59:53.683331+0000","last_active":"2023-10-06T03:09:49.200602+0000","last_peered":"2023-10-06T03:09:49.200602+0000","last_clean":"2023-10-06T03:09:49.200602+0000","last_became_active":"2023-10-06T02:59:53.682994+0000","last_became_peered":"2023-10-06T02:59:53.682994+0000","last_unstale":"2023-10-06T03:09:49.200602+0000","last_undegraded":"2023-10-06T03:09:49.200602+0000","last_fullsized":"2023-10-06T03:09:49.200602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'618","reported_seq":630,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.504933+0000","last_change":"2023-10-06T02:59:53.301126+0000","last_active":"2023-10-06T03:09:38.504933+0000","last_peered":"2023-10-06T03:09:38.504933+0000","last_clean":"2023-10-06T03:09:38.504933+0000","last_became_active":"2023-10-06T02:59:53.300850+0000","last_became_peered":"2023-10-06T02:59:53.300850+0000","last_unstale":"2023-10-06T03:09:38.504933+0000","last_undegraded":"2023-10-06T03:09:38.504933+0000","last_fullsized":"2023-10-06T03:09:38.504933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204076+0000","last_change":"2023-10-06T02:59:53.678930+0000","last_active":"2023-10-06T03:09:49.204076+0000","last_peered":"2023-10-06T03:09:49.204076+0000","last_clean":"2023-10-06T03:09:49.204076+0000","last_became_active":"2023-10-06T02:59:53.678630+0000","last_became_peered":"2023-10-06T02:59:53.678630+0000","last_unstale":"2023-10-06T03:09:49.204076+0000","last_undegraded":"2023-10-06T03:09:49.204076+0000","last_fullsized":"2023-10-06T03:09:49.204076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:14.961350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'128","reported_seq":140,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:42.163802+0000","last_change":"2023-10-06T02:59:53.291521+0000","last_active":"2023-10-06T03:08:42.163802+0000","last_peered":"2023-10-06T03:08:42.163802+0000","last_clean":"2023-10-06T03:08:42.163802+0000","last_became_active":"2023-10-06T02:59:53.290773+0000","last_became_peered":"2023-10-06T02:59:53.290773+0000","last_unstale":"2023-10-06T03:08:42.163802+0000","last_undegraded":"2023-10-06T03:08:42.163802+0000","last_fullsized":"2023-10-06T03:08:42.163802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.198768+0000","last_change":"2023-10-06T02:59:53.678188+0000","last_active":"2023-10-06T03:09:49.198768+0000","last_peered":"2023-10-06T03:09:49.198768+0000","last_clean":"2023-10-06T03:09:49.198768+0000","last_became_active":"2023-10-06T02:59:53.676507+0000","last_became_peered":"2023-10-06T02:59:53.676507+0000","last_unstale":"2023-10-06T03:09:49.198768+0000","last_undegraded":"2023-10-06T03:09:49.198768+0000","last_fullsized":"2023-10-06T03:09:49.198768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"26'126","reported_seq":138,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.500688+0000","last_change":"2023-10-06T02:59:53.289980+0000","last_active":"2023-10-06T03:09:37.500688+0000","last_peered":"2023-10-06T03:09:37.500688+0000","last_clean":"2023-10-06T03:09:37.500688+0000","last_became_active":"2023-10-06T02:59:53.288601+0000","last_became_peered":"2023-10-06T02:59:53.288601+0000","last_unstale":"2023-10-06T03:09:37.500688+0000","last_undegraded":"2023-10-06T03:09:37.500688+0000","last_fullsized":"2023-10-06T03:09:37.500688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:54.630392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191584+0000","last_change":"2023-10-06T02:59:53.675456+0000","last_active":"2023-10-06T03:09:49.191584+0000","last_peered":"2023-10-06T03:09:49.191584+0000","last_clean":"2023-10-06T03:09:49.191584+0000","last_became_active":"2023-10-06T02:59:53.673268+0000","last_became_peered":"2023-10-06T02:59:53.673268+0000","last_unstale":"2023-10-06T03:09:49.191584+0000","last_undegraded":"2023-10-06T03:09:49.191584+0000","last_fullsized":"2023-10-06T03:09:49.191584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'687","reported_seq":699,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505021+0000","last_change":"2023-10-06T02:59:53.298398+0000","last_active":"2023-10-06T03:09:37.505021+0000","last_peered":"2023-10-06T03:09:37.505021+0000","last_clean":"2023-10-06T03:09:37.505021+0000","last_became_active":"2023-10-06T02:59:53.297896+0000","last_became_peered":"2023-10-06T02:59:53.297896+0000","last_unstale":"2023-10-06T03:09:37.505021+0000","last_undegraded":"2023-10-06T03:09:37.505021+0000","last_fullsized":"2023-10-06T03:09:37.505021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205139+0000","last_change":"2023-10-06T02:59:53.679712+0000","last_active":"2023-10-06T03:09:49.205139+0000","last_peered":"2023-10-06T03:09:49.205139+0000","last_clean":"2023-10-06T03:09:49.205139+0000","last_became_active":"2023-10-06T02:59:53.679390+0000","last_became_peered":"2023-10-06T02:59:53.679390+0000","last_unstale":"2023-10-06T03:09:49.205139+0000","last_undegraded":"2023-10-06T03:09:49.205139+0000","last_fullsized":"2023-10-06T03:09:49.205139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:34.124779+0000","last_change":"2023-10-06T02:59:44.074625+0000","last_active":"2023-10-06T03:00:34.124779+0000","last_peered":"2023-10-06T03:00:34.124779+0000","last_clean":"2023-10-06T03:00:34.124779+0000","last_became_active":"2023-10-06T02:59:44.072854+0000","last_became_peered":"2023-10-06T02:59:44.072854+0000","last_unstale":"2023-10-06T03:00:34.124779+0000","last_undegraded":"2023-10-06T03:00:34.124779+0000","last_fullsized":"2023-10-06T03:00:34.124779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_clean_scrub_stamp":"2023-10-06T02:59:43.039151+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:04.936706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.738241+0000","last_change":"2023-10-06T02:59:49.107090+0000","last_active":"2023-10-06T03:00:33.738241+0000","last_peered":"2023-10-06T03:00:33.738241+0000","last_clean":"2023-10-06T03:00:33.738241+0000","last_became_active":"2023-10-06T02:59:49.106619+0000","last_became_peered":"2023-10-06T02:59:49.106619+0000","last_unstale":"2023-10-06T03:00:33.738241+0000","last_undegraded":"2023-10-06T03:00:33.738241+0000","last_fullsized":"2023-10-06T03:00:33.738241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"26'1461","reported_seq":1473,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506597+0000","last_change":"2023-10-06T02:59:53.298769+0000","last_active":"2023-10-06T03:09:37.506597+0000","last_peered":"2023-10-06T03:09:37.506597+0000","last_clean":"2023-10-06T03:09:37.506597+0000","last_became_active":"2023-10-06T02:59:53.298012+0000","last_became_peered":"2023-10-06T02:59:53.298012+0000","last_unstale":"2023-10-06T03:09:37.506597+0000","last_undegraded":"2023-10-06T03:09:37.506597+0000","last_fullsized":"2023-10-06T03:09:37.506597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1461,"log_dups_size":0,"ondisk_log_size":1461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1329,"num_write_kb":8969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.181004+0000","last_change":"2023-10-06T02:59:53.679625+0000","last_active":"2023-10-06T03:09:49.181004+0000","last_peered":"2023-10-06T03:09:49.181004+0000","last_clean":"2023-10-06T03:09:49.181004+0000","last_became_active":"2023-10-06T02:59:53.679200+0000","last_became_peered":"2023-10-06T02:59:53.679200+0000","last_unstale":"2023-10-06T03:09:49.181004+0000","last_undegraded":"2023-10-06T03:09:49.181004+0000","last_fullsized":"2023-10-06T03:09:49.181004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:59.309901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:34.124485+0000","last_change":"2023-10-06T02:59:49.107231+0000","last_active":"2023-10-06T03:00:34.124485+0000","last_peered":"2023-10-06T03:00:34.124485+0000","last_clean":"2023-10-06T03:00:34.124485+0000","last_became_active":"2023-10-06T02:59:49.106878+0000","last_became_peered":"2023-10-06T02:59:49.106878+0000","last_unstale":"2023-10-06T03:00:34.124485+0000","last_undegraded":"2023-10-06T03:00:34.124485+0000","last_fullsized":"2023-10-06T03:00:34.124485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"26'603","reported_seq":1098,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:39.495232+0000","last_change":"2023-10-06T02:59:53.296937+0000","last_active":"2023-10-06T03:09:39.495232+0000","last_peered":"2023-10-06T03:09:39.495232+0000","last_clean":"2023-10-06T03:09:39.495232+0000","last_became_active":"2023-10-06T02:59:53.296171+0000","last_became_peered":"2023-10-06T02:59:53.296171+0000","last_unstale":"2023-10-06T03:09:39.495232+0000","last_undegraded":"2023-10-06T03:09:39.495232+0000","last_fullsized":"2023-10-06T03:09:39.495232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770024,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":483,"num_write_kb":1079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"26'88","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200671+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T03:09:49.200671+0000","last_peered":"2023-10-06T03:09:49.200671+0000","last_clean":"2023-10-06T03:09:49.200671+0000","last_became_active":"2023-10-06T02:59:53.681786+0000","last_became_peered":"2023-10-06T02:59:53.681786+0000","last_unstale":"2023-10-06T03:09:49.200671+0000","last_undegraded":"2023-10-06T03:09:49.200671+0000","last_fullsized":"2023-10-06T03:09:49.200671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.733289+0000","last_change":"2023-10-06T02:59:49.115200+0000","last_active":"2023-10-06T03:00:33.733289+0000","last_peered":"2023-10-06T03:00:33.733289+0000","last_clean":"2023-10-06T03:00:33.733289+0000","last_became_active":"2023-10-06T02:59:49.114769+0000","last_became_peered":"2023-10-06T02:59:49.114769+0000","last_unstale":"2023-10-06T03:00:33.733289+0000","last_undegraded":"2023-10-06T03:00:33.733289+0000","last_fullsized":"2023-10-06T03:00:33.733289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:37.773233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'1468","reported_seq":1480,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:07.312340+0000","last_change":"2023-10-06T02:59:53.298658+0000","last_active":"2023-10-06T03:09:07.312340+0000","last_peered":"2023-10-06T03:09:07.312340+0000","last_clean":"2023-10-06T03:09:07.312340+0000","last_became_active":"2023-10-06T02:59:53.298054+0000","last_became_peered":"2023-10-06T02:59:53.298054+0000","last_unstale":"2023-10-06T03:09:07.312340+0000","last_undegraded":"2023-10-06T03:09:07.312340+0000","last_fullsized":"2023-10-06T03:09:07.312340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1468,"log_dups_size":0,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1335,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.199508+0000","last_change":"2023-10-06T02:59:53.673950+0000","last_active":"2023-10-06T03:09:49.199508+0000","last_peered":"2023-10-06T03:09:49.199508+0000","last_clean":"2023-10-06T03:09:49.199508+0000","last_became_active":"2023-10-06T02:59:53.673677+0000","last_became_peered":"2023-10-06T02:59:53.673677+0000","last_unstale":"2023-10-06T03:09:49.199508+0000","last_undegraded":"2023-10-06T03:09:49.199508+0000","last_fullsized":"2023-10-06T03:09:49.199508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.738308+0000","last_change":"2023-10-06T02:59:49.107944+0000","last_active":"2023-10-06T03:00:33.738308+0000","last_peered":"2023-10-06T03:00:33.738308+0000","last_clean":"2023-10-06T03:00:33.738308+0000","last_became_active":"2023-10-06T02:59:49.107560+0000","last_became_peered":"2023-10-06T02:59:49.107560+0000","last_unstale":"2023-10-06T03:00:33.738308+0000","last_undegraded":"2023-10-06T03:00:33.738308+0000","last_fullsized":"2023-10-06T03:00:33.738308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'122","reported_seq":134,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506182+0000","last_change":"2023-10-06T02:59:53.300945+0000","last_active":"2023-10-06T03:09:37.506182+0000","last_peered":"2023-10-06T03:09:37.506182+0000","last_clean":"2023-10-06T03:09:37.506182+0000","last_became_active":"2023-10-06T02:59:53.300609+0000","last_became_peered":"2023-10-06T02:59:53.300609+0000","last_unstale":"2023-10-06T03:09:37.506182+0000","last_undegraded":"2023-10-06T03:09:37.506182+0000","last_fullsized":"2023-10-06T03:09:37.506182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"26'78","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192720+0000","last_change":"2023-10-06T03:00:34.740673+0000","last_active":"2023-10-06T03:09:49.192720+0000","last_peered":"2023-10-06T03:09:49.192720+0000","last_clean":"2023-10-06T03:09:49.192720+0000","last_became_active":"2023-10-06T03:00:34.740140+0000","last_became_peered":"2023-10-06T03:00:34.740140+0000","last_unstale":"2023-10-06T03:09:49.192720+0000","last_undegraded":"2023-10-06T03:09:49.192720+0000","last_fullsized":"2023-10-06T03:09:49.192720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.929423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'105","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.499293+0000","last_change":"2023-10-06T02:59:53.301191+0000","last_active":"2023-10-06T03:09:37.499293+0000","last_peered":"2023-10-06T03:09:37.499293+0000","last_clean":"2023-10-06T03:09:37.499293+0000","last_became_active":"2023-10-06T02:59:53.300919+0000","last_became_peered":"2023-10-06T02:59:53.300919+0000","last_unstale":"2023-10-06T03:09:37.499293+0000","last_undegraded":"2023-10-06T03:09:37.499293+0000","last_fullsized":"2023-10-06T03:09:37.499293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.741892+0000","last_change":"2023-10-06T02:59:49.108499+0000","last_active":"2023-10-06T03:00:33.741892+0000","last_peered":"2023-10-06T03:00:33.741892+0000","last_clean":"2023-10-06T03:00:33.741892+0000","last_became_active":"2023-10-06T02:59:49.107967+0000","last_became_peered":"2023-10-06T02:59:49.107967+0000","last_unstale":"2023-10-06T03:00:33.741892+0000","last_undegraded":"2023-10-06T03:00:33.741892+0000","last_fullsized":"2023-10-06T03:00:33.741892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195724+0000","last_change":"2023-10-06T02:59:53.676753+0000","last_active":"2023-10-06T03:09:49.195724+0000","last_peered":"2023-10-06T03:09:49.195724+0000","last_clean":"2023-10-06T03:09:49.195724+0000","last_became_active":"2023-10-06T02:59:53.676385+0000","last_became_peered":"2023-10-06T02:59:53.676385+0000","last_unstale":"2023-10-06T03:09:49.195724+0000","last_undegraded":"2023-10-06T03:09:49.195724+0000","last_fullsized":"2023-10-06T03:09:49.195724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"26'115","reported_seq":127,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.178338+0000","last_change":"2023-10-06T02:59:53.303221+0000","last_active":"2023-10-06T03:08:41.178338+0000","last_peered":"2023-10-06T03:08:41.178338+0000","last_clean":"2023-10-06T03:08:41.178338+0000","last_became_active":"2023-10-06T02:59:53.302890+0000","last_became_peered":"2023-10-06T02:59:53.302890+0000","last_unstale":"2023-10-06T03:08:41.178338+0000","last_undegraded":"2023-10-06T03:08:41.178338+0000","last_fullsized":"2023-10-06T03:08:41.178338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:34.125363+0000","last_change":"2023-10-06T02:59:49.102005+0000","last_active":"2023-10-06T03:00:34.125363+0000","last_peered":"2023-10-06T03:00:34.125363+0000","last_clean":"2023-10-06T03:00:34.125363+0000","last_became_active":"2023-10-06T02:59:49.101530+0000","last_became_peered":"2023-10-06T02:59:49.101530+0000","last_unstale":"2023-10-06T03:00:34.125363+0000","last_undegraded":"2023-10-06T03:00:34.125363+0000","last_fullsized":"2023-10-06T03:00:34.125363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.186999+0000","last_change":"2023-10-06T02:59:53.672581+0000","last_active":"2023-10-06T03:09:49.186999+0000","last_peered":"2023-10-06T03:09:49.186999+0000","last_clean":"2023-10-06T03:09:49.186999+0000","last_became_active":"2023-10-06T02:59:53.672299+0000","last_became_peered":"2023-10-06T02:59:53.672299+0000","last_unstale":"2023-10-06T03:09:49.186999+0000","last_undegraded":"2023-10-06T03:09:49.186999+0000","last_fullsized":"2023-10-06T03:09:49.186999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"26'120","reported_seq":132,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.177130+0000","last_change":"2023-10-06T02:59:53.300135+0000","last_active":"2023-10-06T03:08:41.177130+0000","last_peered":"2023-10-06T03:08:41.177130+0000","last_clean":"2023-10-06T03:08:41.177130+0000","last_became_active":"2023-10-06T02:59:53.299271+0000","last_became_peered":"2023-10-06T02:59:53.299271+0000","last_unstale":"2023-10-06T03:08:41.177130+0000","last_undegraded":"2023-10-06T03:08:41.177130+0000","last_fullsized":"2023-10-06T03:08:41.177130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.742127+0000","last_change":"2023-10-06T02:59:49.100171+0000","last_active":"2023-10-06T03:00:33.742127+0000","last_peered":"2023-10-06T03:00:33.742127+0000","last_clean":"2023-10-06T03:00:33.742127+0000","last_became_active":"2023-10-06T02:59:49.099689+0000","last_became_peered":"2023-10-06T02:59:49.099689+0000","last_unstale":"2023-10-06T03:00:33.742127+0000","last_undegraded":"2023-10-06T03:00:33.742127+0000","last_fullsized":"2023-10-06T03:00:33.742127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'94","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203550+0000","last_change":"2023-10-06T02:59:53.685270+0000","last_active":"2023-10-06T03:09:49.203550+0000","last_peered":"2023-10-06T03:09:49.203550+0000","last_clean":"2023-10-06T03:09:49.203550+0000","last_became_active":"2023-10-06T02:59:53.684983+0000","last_became_peered":"2023-10-06T02:59:53.684983+0000","last_unstale":"2023-10-06T03:09:49.203550+0000","last_undegraded":"2023-10-06T03:09:49.203550+0000","last_fullsized":"2023-10-06T03:09:49.203550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:49.904101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'244","reported_seq":256,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.504458+0000","last_change":"2023-10-06T02:59:53.301048+0000","last_active":"2023-10-06T03:09:38.504458+0000","last_peered":"2023-10-06T03:09:38.504458+0000","last_clean":"2023-10-06T03:09:38.504458+0000","last_became_active":"2023-10-06T02:59:53.300086+0000","last_became_peered":"2023-10-06T02:59:53.300086+0000","last_unstale":"2023-10-06T03:09:38.504458+0000","last_undegraded":"2023-10-06T03:09:38.504458+0000","last_fullsized":"2023-10-06T03:09:38.504458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.732387+0000","last_change":"2023-10-06T02:59:49.102935+0000","last_active":"2023-10-06T03:00:33.732387+0000","last_peered":"2023-10-06T03:00:33.732387+0000","last_clean":"2023-10-06T03:00:33.732387+0000","last_became_active":"2023-10-06T02:59:49.102397+0000","last_became_peered":"2023-10-06T02:59:49.102397+0000","last_unstale":"2023-10-06T03:00:33.732387+0000","last_undegraded":"2023-10-06T03:00:33.732387+0000","last_fullsized":"2023-10-06T03:00:33.732387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'77","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192435+0000","last_change":"2023-10-06T02:59:53.676229+0000","last_active":"2023-10-06T03:09:49.192435+0000","last_peered":"2023-10-06T03:09:49.192435+0000","last_clean":"2023-10-06T03:09:49.192435+0000","last_became_active":"2023-10-06T02:59:53.675895+0000","last_became_peered":"2023-10-06T02:59:53.675895+0000","last_unstale":"2023-10-06T03:09:49.192435+0000","last_undegraded":"2023-10-06T03:09:49.192435+0000","last_fullsized":"2023-10-06T03:09:49.192435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:03.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"26'85","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.188557+0000","last_change":"2023-10-06T02:59:53.676843+0000","last_active":"2023-10-06T03:09:49.188557+0000","last_peered":"2023-10-06T03:09:49.188557+0000","last_clean":"2023-10-06T03:09:49.188557+0000","last_became_active":"2023-10-06T02:59:53.676528+0000","last_became_peered":"2023-10-06T02:59:53.676528+0000","last_unstale":"2023-10-06T03:09:49.188557+0000","last_undegraded":"2023-10-06T03:09:49.188557+0000","last_fullsized":"2023-10-06T03:09:49.188557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'529","reported_seq":541,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505437+0000","last_change":"2023-10-06T02:59:53.294557+0000","last_active":"2023-10-06T03:09:37.505437+0000","last_peered":"2023-10-06T03:09:37.505437+0000","last_clean":"2023-10-06T03:09:37.505437+0000","last_became_active":"2023-10-06T02:59:53.291434+0000","last_became_peered":"2023-10-06T02:59:53.291434+0000","last_unstale":"2023-10-06T03:09:37.505437+0000","last_undegraded":"2023-10-06T03:09:37.505437+0000","last_fullsized":"2023-10-06T03:09:37.505437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196820+0000","last_change":"2023-10-06T02:59:53.678204+0000","last_active":"2023-10-06T03:09:49.196820+0000","last_peered":"2023-10-06T03:09:49.196820+0000","last_clean":"2023-10-06T03:09:49.196820+0000","last_became_active":"2023-10-06T02:59:53.677924+0000","last_became_peered":"2023-10-06T02:59:53.677924+0000","last_unstale":"2023-10-06T03:09:49.196820+0000","last_undegraded":"2023-10-06T03:09:49.196820+0000","last_fullsized":"2023-10-06T03:09:49.196820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"26'336","reported_seq":348,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.507759+0000","last_change":"2023-10-06T02:59:53.301253+0000","last_active":"2023-10-06T03:09:38.507759+0000","last_peered":"2023-10-06T03:09:38.507759+0000","last_clean":"2023-10-06T03:09:38.507759+0000","last_became_active":"2023-10-06T02:59:53.300926+0000","last_became_peered":"2023-10-06T02:59:53.300926+0000","last_unstale":"2023-10-06T03:09:38.507759+0000","last_undegraded":"2023-10-06T03:09:38.507759+0000","last_fullsized":"2023-10-06T03:09:38.507759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:21.432516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'135","reported_seq":147,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.500451+0000","last_change":"2023-10-06T02:59:53.292844+0000","last_active":"2023-10-06T03:09:37.500451+0000","last_peered":"2023-10-06T03:09:37.500451+0000","last_clean":"2023-10-06T03:09:37.500451+0000","last_became_active":"2023-10-06T02:59:53.292493+0000","last_became_peered":"2023-10-06T02:59:53.292493+0000","last_unstale":"2023-10-06T03:09:37.500451+0000","last_undegraded":"2023-10-06T03:09:37.500451+0000","last_fullsized":"2023-10-06T03:09:37.500451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"26'94","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206446+0000","last_change":"2023-10-06T02:59:53.676684+0000","last_active":"2023-10-06T03:09:49.206446+0000","last_peered":"2023-10-06T03:09:49.206446+0000","last_clean":"2023-10-06T03:09:49.206446+0000","last_became_active":"2023-10-06T02:59:53.676410+0000","last_became_peered":"2023-10-06T02:59:53.676410+0000","last_unstale":"2023-10-06T03:09:49.206446+0000","last_undegraded":"2023-10-06T03:09:49.206446+0000","last_fullsized":"2023-10-06T03:09:49.206446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"26'122","reported_seq":134,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.501788+0000","last_change":"2023-10-06T02:59:53.293924+0000","last_active":"2023-10-06T03:09:37.501788+0000","last_peered":"2023-10-06T03:09:37.501788+0000","last_clean":"2023-10-06T03:09:37.501788+0000","last_became_active":"2023-10-06T02:59:53.293596+0000","last_became_peered":"2023-10-06T02:59:53.293596+0000","last_unstale":"2023-10-06T03:09:37.501788+0000","last_undegraded":"2023-10-06T03:09:37.501788+0000","last_fullsized":"2023-10-06T03:09:37.501788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"26'91","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203618+0000","last_change":"2023-10-06T02:59:53.673847+0000","last_active":"2023-10-06T03:09:49.203618+0000","last_peered":"2023-10-06T03:09:49.203618+0000","last_clean":"2023-10-06T03:09:49.203618+0000","last_became_active":"2023-10-06T02:59:53.673559+0000","last_became_peered":"2023-10-06T02:59:53.673559+0000","last_unstale":"2023-10-06T03:09:49.203618+0000","last_undegraded":"2023-10-06T03:09:49.203618+0000","last_fullsized":"2023-10-06T03:09:49.203618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"26'76","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.174477+0000","last_change":"2023-10-06T02:59:53.674388+0000","last_active":"2023-10-06T03:09:49.174477+0000","last_peered":"2023-10-06T03:09:49.174477+0000","last_clean":"2023-10-06T03:09:49.174477+0000","last_became_active":"2023-10-06T02:59:53.674086+0000","last_became_peered":"2023-10-06T02:59:53.674086+0000","last_unstale":"2023-10-06T03:09:49.174477+0000","last_undegraded":"2023-10-06T03:09:49.174477+0000","last_fullsized":"2023-10-06T03:09:49.174477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'1576","reported_seq":1588,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.145397+0000","last_change":"2023-10-06T02:59:53.296871+0000","last_active":"2023-10-06T03:09:49.145397+0000","last_peered":"2023-10-06T03:09:49.145397+0000","last_clean":"2023-10-06T03:09:49.145397+0000","last_became_active":"2023-10-06T02:59:53.296550+0000","last_became_peered":"2023-10-06T02:59:53.296550+0000","last_unstale":"2023-10-06T03:09:49.145397+0000","last_undegraded":"2023-10-06T03:09:49.145397+0000","last_fullsized":"2023-10-06T03:09:49.145397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1576,"log_dups_size":0,"ondisk_log_size":1576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7633302,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1449,"num_write_kb":8304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.178500+0000","last_change":"2023-10-06T02:59:53.683771+0000","last_active":"2023-10-06T03:09:49.178500+0000","last_peered":"2023-10-06T03:09:49.178500+0000","last_clean":"2023-10-06T03:09:49.178500+0000","last_became_active":"2023-10-06T02:59:53.683458+0000","last_became_peered":"2023-10-06T02:59:53.683458+0000","last_unstale":"2023-10-06T03:09:49.178500+0000","last_undegraded":"2023-10-06T03:09:49.178500+0000","last_fullsized":"2023-10-06T03:09:49.178500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'118","reported_seq":130,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.168177+0000","last_change":"2023-10-06T02:59:53.301158+0000","last_active":"2023-10-06T03:08:41.168177+0000","last_peered":"2023-10-06T03:08:41.168177+0000","last_clean":"2023-10-06T03:08:41.168177+0000","last_became_active":"2023-10-06T02:59:53.300797+0000","last_became_peered":"2023-10-06T02:59:53.300797+0000","last_unstale":"2023-10-06T03:08:41.168177+0000","last_undegraded":"2023-10-06T03:08:41.168177+0000","last_fullsized":"2023-10-06T03:08:41.168177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"26'77","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203877+0000","last_change":"2023-10-06T02:59:53.683576+0000","last_active":"2023-10-06T03:09:49.203877+0000","last_peered":"2023-10-06T03:09:49.203877+0000","last_clean":"2023-10-06T03:09:49.203877+0000","last_became_active":"2023-10-06T02:59:53.683301+0000","last_became_peered":"2023-10-06T02:59:53.683301+0000","last_unstale":"2023-10-06T03:09:49.203877+0000","last_undegraded":"2023-10-06T03:09:49.203877+0000","last_fullsized":"2023-10-06T03:09:49.203877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'489","reported_seq":501,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.504119+0000","last_change":"2023-10-06T02:59:53.297975+0000","last_active":"2023-10-06T03:09:37.504119+0000","last_peered":"2023-10-06T03:09:37.504119+0000","last_clean":"2023-10-06T03:09:37.504119+0000","last_became_active":"2023-10-06T02:59:53.297724+0000","last_became_peered":"2023-10-06T02:59:53.297724+0000","last_unstale":"2023-10-06T03:09:37.504119+0000","last_undegraded":"2023-10-06T03:09:37.504119+0000","last_fullsized":"2023-10-06T03:09:37.504119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":4283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'74","reported_seq":85,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.201472+0000","last_change":"2023-10-06T02:59:53.684667+0000","last_active":"2023-10-06T03:09:49.201472+0000","last_peered":"2023-10-06T03:09:49.201472+0000","last_clean":"2023-10-06T03:09:49.201472+0000","last_became_active":"2023-10-06T02:59:53.684378+0000","last_became_peered":"2023-10-06T02:59:53.684378+0000","last_unstale":"2023-10-06T03:09:49.201472+0000","last_undegraded":"2023-10-06T03:09:49.201472+0000","last_fullsized":"2023-10-06T03:09:49.201472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:40.914600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"26'935","reported_seq":947,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.503096+0000","last_change":"2023-10-06T02:59:53.298276+0000","last_active":"2023-10-06T03:09:37.503096+0000","last_peered":"2023-10-06T03:09:37.503096+0000","last_clean":"2023-10-06T03:09:37.503096+0000","last_became_active":"2023-10-06T02:59:53.297471+0000","last_became_peered":"2023-10-06T02:59:53.297471+0000","last_unstale":"2023-10-06T03:09:37.503096+0000","last_undegraded":"2023-10-06T03:09:37.503096+0000","last_fullsized":"2023-10-06T03:09:37.503096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":4592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'78","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204791+0000","last_change":"2023-10-06T02:59:53.679138+0000","last_active":"2023-10-06T03:09:49.204791+0000","last_peered":"2023-10-06T03:09:49.204791+0000","last_clean":"2023-10-06T03:09:49.204791+0000","last_became_active":"2023-10-06T02:59:53.678831+0000","last_became_peered":"2023-10-06T02:59:53.678831+0000","last_unstale":"2023-10-06T03:09:49.204791+0000","last_undegraded":"2023-10-06T03:09:49.204791+0000","last_fullsized":"2023-10-06T03:09:49.204791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:25.273960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"26'113","reported_seq":125,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505705+0000","last_change":"2023-10-06T02:59:53.295949+0000","last_active":"2023-10-06T03:09:37.505705+0000","last_peered":"2023-10-06T03:09:37.505705+0000","last_clean":"2023-10-06T03:09:37.505705+0000","last_became_active":"2023-10-06T02:59:53.295697+0000","last_became_peered":"2023-10-06T02:59:53.295697+0000","last_unstale":"2023-10-06T03:09:37.505705+0000","last_undegraded":"2023-10-06T03:09:37.505705+0000","last_fullsized":"2023-10-06T03:09:37.505705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'99","reported_seq":110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203834+0000","last_change":"2023-10-06T02:59:53.673079+0000","last_active":"2023-10-06T03:09:49.203834+0000","last_peered":"2023-10-06T03:09:49.203834+0000","last_clean":"2023-10-06T03:09:49.203834+0000","last_became_active":"2023-10-06T02:59:53.672629+0000","last_became_peered":"2023-10-06T02:59:53.672629+0000","last_unstale":"2023-10-06T03:09:49.203834+0000","last_undegraded":"2023-10-06T03:09:49.203834+0000","last_fullsized":"2023-10-06T03:09:49.203834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'1071","reported_seq":1083,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506322+0000","last_change":"2023-10-06T02:59:53.297170+0000","last_active":"2023-10-06T03:09:37.506322+0000","last_peered":"2023-10-06T03:09:37.506322+0000","last_clean":"2023-10-06T03:09:37.506322+0000","last_became_active":"2023-10-06T02:59:53.296843+0000","last_became_peered":"2023-10-06T02:59:53.296843+0000","last_unstale":"2023-10-06T03:09:37.506322+0000","last_undegraded":"2023-10-06T03:09:37.506322+0000","last_fullsized":"2023-10-06T03:09:37.506322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":8534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"26'89","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206154+0000","last_change":"2023-10-06T02:59:53.675030+0000","last_active":"2023-10-06T03:09:49.206154+0000","last_peered":"2023-10-06T03:09:49.206154+0000","last_clean":"2023-10-06T03:09:49.206154+0000","last_became_active":"2023-10-06T02:59:53.673662+0000","last_became_peered":"2023-10-06T02:59:53.673662+0000","last_unstale":"2023-10-06T03:09:49.206154+0000","last_undegraded":"2023-10-06T03:09:49.206154+0000","last_fullsized":"2023-10-06T03:09:49.206154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"26'537","reported_seq":549,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.501976+0000","last_change":"2023-10-06T02:59:53.299596+0000","last_active":"2023-10-06T03:09:37.501976+0000","last_peered":"2023-10-06T03:09:37.501976+0000","last_clean":"2023-10-06T03:09:37.501976+0000","last_became_active":"2023-10-06T02:59:53.298881+0000","last_became_peered":"2023-10-06T02:59:53.298881+0000","last_unstale":"2023-10-06T03:09:37.501976+0000","last_undegraded":"2023-10-06T03:09:37.501976+0000","last_fullsized":"2023-10-06T03:09:37.501976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.190231+0000","last_change":"2023-10-06T02:59:53.675391+0000","last_active":"2023-10-06T03:09:49.190231+0000","last_peered":"2023-10-06T03:09:49.190231+0000","last_clean":"2023-10-06T03:09:49.190231+0000","last_became_active":"2023-10-06T02:59:53.675092+0000","last_became_peered":"2023-10-06T02:59:53.675092+0000","last_unstale":"2023-10-06T03:09:49.190231+0000","last_undegraded":"2023-10-06T03:09:49.190231+0000","last_fullsized":"2023-10-06T03:09:49.190231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"26'552","reported_seq":564,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.173190+0000","last_change":"2023-10-06T02:59:53.294074+0000","last_active":"2023-10-06T03:08:41.173190+0000","last_peered":"2023-10-06T03:08:41.173190+0000","last_clean":"2023-10-06T03:08:41.173190+0000","last_became_active":"2023-10-06T02:59:53.293752+0000","last_became_peered":"2023-10-06T02:59:53.293752+0000","last_unstale":"2023-10-06T03:08:41.173190+0000","last_undegraded":"2023-10-06T03:08:41.173190+0000","last_fullsized":"2023-10-06T03:08:41.173190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":438,"num_write_kb":4309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":75513604,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":11546,"num_write_kb":80285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151085056,"data_stored":151027208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15189,"ondisk_log_size":15189,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574974,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314548,"kb_used_data":17260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057292,"statfs":{"total":96636764160,"available":96314667008,"internally_reserved":0,"allocated":17674240,"data_stored":17475112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.93400000000000005,"15min":0.85599999999999998},"min":{"1min":0.54000000000000004,"5min":0.497,"15min":0.41099999999999998},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.012,"15min":0.98999999999999999},"min":{"1min":0.72899999999999998,"5min":0.54500000000000004,"15min":0.48099999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.1259999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.58799999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.349,"5min":1.349,"15min":1.389},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.622,"5min":0.52600000000000002,"15min":0.38500000000000001},"max":{"1min":1.008,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.93999999999999995,"15min":0.96699999999999997},"min":{"1min":0.67900000000000005,"5min":0.59799999999999998,"15min":0.55800000000000005},"max":{"1min":1.165,"5min":1.333,"15min":1.4199999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.083,"15min":1.143},"min":{"1min":0.73499999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2450000000000001,"5min":1.3779999999999999,"15min":1.6359999999999999},"last":0.97999999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.89800000000000002,"15min":0.94799999999999995},"min":{"1min":0.64500000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0529999999999999,"5min":1.405,"15min":1.405},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.042,"15min":1.0920000000000001},"min":{"1min":0.81999999999999995,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4319999999999999,"5min":1.4590000000000001,"15min":1.7210000000000001},"last":1.1879999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.875,"15min":0.91100000000000003},"min":{"1min":0.624,"5min":0.624,"15min":0.50600000000000001},"max":{"1min":1.181,"5min":1.1859999999999999,"15min":1.3999999999999999},"last":1.012},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.0469999999999999},"min":{"1min":0.69199999999999995,"5min":0.64400000000000002,"15min":0.57499999999999996},"max":{"1min":1.1850000000000001,"5min":1.395,"15min":1.4590000000000001},"last":1.1599999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.0389999999999999,"15min":1.1539999999999999},"min":{"1min":0.66500000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.51,"5min":1.51,"15min":1.833},"last":1.236},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.018,"15min":1.0549999999999999},"min":{"1min":0.85799999999999998,"5min":0.65600000000000003,"15min":0.59199999999999997},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4990000000000001},"last":1.099}]},{"osd":6,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0669999999999999,"15min":1.119},"min":{"1min":0.80600000000000005,"5min":0.73799999999999999,"15min":0.71399999999999997},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.577},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.149,"15min":1.1899999999999999},"min":{"1min":0.94199999999999995,"5min":0.78100000000000003,"15min":0.76100000000000001},"max":{"1min":1.2949999999999999,"5min":1.5669999999999999,"15min":1.5860000000000001},"last":1.262}]}]},{"osd":6,"up_from":13,"seq":55834574973,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309848,"kb_used_data":4368,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94061992,"statfs":{"total":96636764160,"available":96319479808,"internally_reserved":0,"allocated":4472832,"data_stored":4300972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94199999999999995,"15min":1.026},"min":{"1min":0.54300000000000004,"5min":0.505,"15min":0.49099999999999999},"max":{"1min":1.1950000000000001,"5min":1.343,"15min":6.6989999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98199999999999998,"15min":1.087},"min":{"1min":0.628,"5min":0.54900000000000004,"15min":0.53200000000000003},"max":{"1min":1.302,"5min":1.302,"15min":6.9199999999999999},"last":1.194}]},{"osd":1,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.60999999999999999,"5min":0.56100000000000005,"15min":0.434},"max":{"1min":1.202,"5min":1.282,"15min":1.464},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.88800000000000001,"15min":0.89100000000000001},"min":{"1min":0.57099999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0980000000000001,"5min":1.2849999999999999,"15min":1.2949999999999999},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.89400000000000002,"15min":0.88300000000000001},"min":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.51700000000000002},"max":{"1min":1.0840000000000001,"5min":1.3009999999999999,"15min":1.498},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.91500000000000004,"15min":0.94099999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.171,"5min":1.248,"15min":1.294},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95199999999999996,"15min":0.94099999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.755},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.99299999999999999,"15min":1.012},"min":{"1min":0.69099999999999995,"5min":0.64800000000000002,"15min":0.52500000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.611},"last":1.0620000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90000000000000002,"15min":1.3149999999999999},"min":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.56000000000000005},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":17.757000000000001},"last":1.024},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.099,"15min":1.498},"min":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.536,"5min":1.536,"15min":17.382999999999999},"last":1.3080000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1,"15min":1.133},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.61599999999999999},"max":{"1min":1.3919999999999999,"5min":1.411,"15min":4.3090000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.2490000000000001},"min":{"1min":0.91700000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":4.5709999999999997},"last":1.1080000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.1419999999999999},"min":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.625,"5min":1.625,"15min":1.6990000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.1180000000000001,"15min":1.175},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4590000000000001,"5min":1.5169999999999999,"15min":1.6639999999999999},"last":1.1379999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574974,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326240,"kb_used_data":24856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94045600,"statfs":{"total":96636764160,"available":96302694400,"internally_reserved":0,"allocated":25452544,"data_stored":25273116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.878,"15min":0.88600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.40799999999999997},"max":{"1min":1.0580000000000001,"5min":1.2050000000000001,"15min":1.2849999999999999},"last":1.111},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.98899999999999999,"15min":1.01},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.54800000000000004},"max":{"1min":1.2250000000000001,"5min":1.2629999999999999,"15min":1.3089999999999999},"last":1.012}]},{"osd":1,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.874,"15min":0.89000000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.363},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.91000000000000003,"15min":0.90700000000000003},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.58999999999999997},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2689999999999999},"last":1.194}]},{"osd":2,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.876,"15min":0.90200000000000002},"min":{"1min":0.68000000000000005,"5min":0.621,"15min":0.53400000000000003},"max":{"1min":1.135,"5min":1.27,"15min":1.405},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.69299999999999995,"5min":0.59399999999999997,"15min":0.44500000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.6220000000000001},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.95999999999999996,"15min":0.95399999999999996},"min":{"1min":0.76100000000000001,"5min":0.69599999999999995,"15min":0.59599999999999997},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0580000000000001,"15min":1.048},"min":{"1min":0.84899999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.341,"5min":1.3720000000000001,"15min":1.53},"last":1.044}]},{"osd":4,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.92000000000000004,"15min":0.92300000000000004},"min":{"1min":0.66000000000000003,"5min":0.61399999999999999,"15min":0.46999999999999997},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.135,"5min":1.0800000000000001,"15min":1.069},"min":{"1min":0.88200000000000001,"5min":0.68400000000000005,"15min":0.60599999999999998},"max":{"1min":1.337,"5min":1.4930000000000001,"15min":1.657},"last":1.0840000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0720000000000001,"15min":1.0429999999999999},"min":{"1min":0.76700000000000002,"5min":0.65800000000000003,"15min":0.58399999999999996},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.167},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.093,"15min":1.077},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.441},"max":{"1min":1.536,"5min":1.538,"15min":1.538},"last":1.2569999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.153,"15min":1.1639999999999999},"min":{"1min":0.93400000000000005,"5min":0.748,"15min":0.748},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.542},"last":1.145},{"interface":"front","average":{"1min":1.244,"5min":1.222,"15min":1.2190000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.637,"5min":1.637,"15min":2.048},"last":1.2889999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335192,"kb_used_data":29712,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94036648,"statfs":{"total":96636764160,"available":96293527552,"internally_reserved":0,"allocated":30425088,"data_stored":30237520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.85399999999999998,"15min":0.83299999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0960000000000001,"5min":1.3080000000000001,"15min":1.4830000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.88600000000000001,"15min":0.92100000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.296,"5min":1.341,"15min":1.5289999999999999},"last":0.91200000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.85799999999999998,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.238,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.873,"15min":0.89300000000000002},"min":{"1min":0.58299999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.321,"5min":1.387,"15min":1.387},"last":1.036}]},{"osd":2,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96299999999999997,"15min":0.96699999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2589999999999999,"5min":1.3129999999999999,"15min":1.4159999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0249999999999999,"15min":1.016},"min":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.53700000000000003},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.0960000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94699999999999995,"15min":0.97199999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3859999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96999999999999997,"15min":1.0029999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.56200000000000006},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.97399999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93400000000000005,"15min":0.95799999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.2529999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.02,"15min":1.077},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0129999999999999,"15min":1.0609999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.61299999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0509999999999999,"15min":1.0860000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3759999999999999,"5min":1.454,"15min":1.454},"last":0.94699999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1080000000000001,"15min":1.1739999999999999},"min":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4570000000000001,"5min":1.5629999999999999,"15min":1.7629999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.171,"5min":1.151,"15min":1.21},"min":{"1min":0.753,"5min":0.753,"15min":0.56299999999999994},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.2569999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333692,"kb_used_data":28212,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94038148,"statfs":{"total":96636764160,"available":96295063552,"internally_reserved":0,"allocated":28889088,"data_stored":28711580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.244,"5min":1.2729999999999999,"15min":1.464},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76100000000000001,"15min":0.72399999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.212,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.745,"15min":0.999},"min":{"1min":0.47799999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.222,"5min":1.3049999999999999,"15min":10.970000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.85299999999999998,"15min":0.83899999999999997},"min":{"1min":0.51200000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.387,"5min":1.694,"15min":1.694},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":0.872},"min":{"1min":0.49299999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.107,"5min":1.224,"15min":1.6419999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.90800000000000003,"15min":0.93700000000000006},"min":{"1min":0.60599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.333},"last":0.79400000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98599999999999999,"15min":1.02},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3540000000000001,"5min":1.855,"15min":1.855},"last":0.75},{"interface":"front","average":{"1min":1.101,"5min":1.1000000000000001,"15min":1.1499999999999999},"min":{"1min":0.80000000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.397,"5min":1.792,"15min":2.3570000000000002},"last":1.1040000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0549999999999999,"15min":1.121},"min":{"1min":0.73499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5069999999999999,"5min":1.7410000000000001,"15min":2.218},"last":1.04},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1279999999999999,"15min":1.29},"min":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4550000000000001,"5min":1.5649999999999999,"15min":5.585},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1040000000000001,"15min":1.23},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.77000000000000002},"max":{"1min":1.431,"5min":1.9490000000000001,"15min":5.0860000000000003},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1819999999999999,"15min":1.23},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.591,"5min":1.6679999999999999,"15min":2.3069999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2250000000000001,"15min":1.3600000000000001},"min":{"1min":0.84599999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":5.6239999999999997},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1930000000000001,"15min":1.2909999999999999},"min":{"1min":0.73699999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.482,"5min":2.0950000000000002,"15min":5.1310000000000002},"last":0.91600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313944,"kb_used_data":8464,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94057896,"statfs":{"total":96636764160,"available":96315285504,"internally_reserved":0,"allocated":8667136,"data_stored":8495276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.70899999999999996},"min":{"1min":0.52200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89700000000000002,"5min":1.038,"15min":1.4019999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.746,"15min":0.76300000000000001},"min":{"1min":0.41399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.073,"5min":1.323,"15min":1.8799999999999999},"last":0.81299999999999994}]},{"osd":1,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72199999999999998,"15min":0.73099999999999998},"min":{"1min":0.49299999999999999,"5min":0.375,"15min":0.33300000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83199999999999996,"15min":0.83799999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1719999999999999,"5min":1.252,"15min":1.341},"last":1.1180000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84899999999999998,"15min":0.873},"min":{"1min":0.622,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.875},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.90800000000000003,"15min":0.97899999999999998},"min":{"1min":0.624,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.296,"5min":1.329,"15min":1.587},"last":1.0249999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.96799999999999997,"15min":1.03},"min":{"1min":0.68300000000000005,"5min":0.63900000000000001,"15min":0.56999999999999995},"max":{"1min":1.238,"5min":1.3520000000000001,"15min":1.6779999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.048,"15min":1.109},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4470000000000001,"5min":1.6419999999999999,"15min":1.9350000000000001},"last":0.98299999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0960000000000001,"15min":1.143},"min":{"1min":0.81899999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.1200000000000001},"min":{"1min":0.68300000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3919999999999999,"5min":1.458,"15min":2.048},"last":0.95599999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.149,"15min":1.204},"min":{"1min":0.70499999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.593,"5min":1.6379999999999999,"15min":2.7040000000000002},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.1990000000000001,"15min":1.2490000000000001},"min":{"1min":0.95699999999999996,"5min":0.82499999999999996,"15min":0.68200000000000005},"max":{"1min":1.619,"5min":1.619,"15min":2.2000000000000002},"last":1.282}]},{"osd":7,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1639999999999999,"15min":1.2330000000000001},"min":{"1min":0.73899999999999999,"5min":0.71499999999999997,"15min":0.70999999999999996},"max":{"1min":1.54,"5min":1.633,"15min":2.286},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.2290000000000001,"15min":1.302},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.669,"5min":1.669,"15min":2.3940000000000001},"last":1.1870000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574973,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313944,"kb_used_data":16656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057896,"statfs":{"total":96636764160,"available":96315285504,"internally_reserved":0,"allocated":17055744,"data_stored":16883884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.70099999999999996,"15min":0.68600000000000005},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.23599999999999999},"max":{"1min":1.016,"5min":1.179,"15min":1.179},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.82099999999999995,"15min":0.79800000000000004},"min":{"1min":0.52900000000000003,"5min":0.42299999999999999,"15min":0.39300000000000002},"max":{"1min":1.077,"5min":1.218,"15min":1.3089999999999999},"last":0.99399999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84199999999999997,"15min":0.85999999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36599999999999999},"max":{"1min":1.246,"5min":1.3109999999999999,"15min":1.3169999999999999},"last":1.0329999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.875},"min":{"1min":0.5,"5min":0.5,"15min":0.42299999999999999},"max":{"1min":1.1399999999999999,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83199999999999996,"15min":0.85099999999999998},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.133,"5min":1.2270000000000001,"15min":1.337},"last":0.877}]},{"osd":4,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.95899999999999996,"15min":0.97999999999999998},"min":{"1min":0.66900000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.212,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.115,"15min":1.0980000000000001},"min":{"1min":0.67200000000000004,"5min":0.63800000000000001,"15min":0.437},"max":{"1min":1.556,"5min":1.556,"15min":1.6060000000000001},"last":1.3300000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.075,"15min":1.075},"min":{"1min":0.70399999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4410000000000001,"5min":1.587,"15min":1.587},"last":1.28},{"interface":"front","average":{"1min":1.034,"5min":1.0760000000000001,"15min":1.073},"min":{"1min":0.80500000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.569,"5min":1.911,"15min":1.911},"last":1.244}]},{"osd":6,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1479999999999999,"15min":1.1499999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.70499999999999996},"max":{"1min":1.5049999999999999,"5min":2.081,"15min":2.081},"last":1.532},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1479999999999999,"15min":1.1639999999999999},"min":{"1min":0.72799999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4710000000000001,"5min":1.996,"15min":1.996},"last":1.367}]},{"osd":7,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2050000000000001,"15min":1.1970000000000001},"min":{"1min":0.81000000000000005,"5min":0.71499999999999997,"15min":0.498},"max":{"1min":1.5009999999999999,"5min":1.6879999999999999,"15min":1.8999999999999999},"last":1.466},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.218,"15min":1.2250000000000001},"min":{"1min":0.78900000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.536,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.4350000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322736,"kb_used_data":21352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94049104,"statfs":{"total":96636764160,"available":96306282496,"internally_reserved":0,"allocated":21864448,"data_stored":21683828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70399999999999996,"15min":0.67600000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26900000000000002},"max":{"1min":1.224,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.34899999999999998},"max":{"1min":1.1659999999999999,"5min":1.2709999999999999,"15min":1.2849999999999999},"last":0.80000000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.177,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.40200000000000002},"max":{"1min":0.93700000000000006,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.75800000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82899999999999996,"15min":0.80900000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4019999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.085},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.91600000000000004,"15min":0.93000000000000005},"min":{"1min":0.55500000000000005,"5min":0.46800000000000003,"15min":0.34599999999999997},"max":{"1min":1.327,"5min":1.3580000000000001,"15min":1.599},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.94099999999999995,"15min":0.95499999999999996},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.52},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.117,"15min":1.105},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.8280000000000001,"5min":1.859,"15min":1.859},"last":1.1890000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.135,"15min":1.141},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.161,"5min":1.165,"15min":1.159},"min":{"1min":0.872,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.542,"5min":1.573,"15min":1.573},"last":1.1220000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1759999999999999,"15min":1.1739999999999999},"min":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4930000000000001,"5min":1.6359999999999999,"15min":1.7050000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1080000000000001,"15min":1.111},"min":{"1min":0.68500000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.274,"5min":1.579,"15min":2.1579999999999999},"last":1.149}]},{"osd":7,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1579999999999999,"15min":1.1599999999999999},"min":{"1min":0.72699999999999998,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.413,"5min":1.7090000000000001,"15min":2.2480000000000002},"last":1.224},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.0049999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.248}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20992000,"data_stored":20986792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28610560,"data_stored":28604912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30146560,"data_stored":30130852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16801792,"data_stored":16778076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:09:56.828 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:09:56.828 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:09:56.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 Processor -- start 2023-10-06T03:09:56.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 -- start start 2023-10-06T03:09:56.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2e940a0310 0x7f2e9406cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2e9414c450 0x7f2e9414b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9414bfc0 con 0x7f2e9406c910 2023-10-06T03:09:56.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9414b970 con 0x7f2e9414c450 2023-10-06T03:09:56.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9414bc50 con 0x7f2e940a0310 2023-10-06T03:09:56.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e93fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2e9406c910 0x7f2e9414a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46214/0 (socket says 172.21.15.27:46214) 2023-10-06T03:09:56.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e93fff700 1 -- 172.21.15.27:0/2779341638 learned_addr learned my addr 172.21.15.27:0/2779341638 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:09:56.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e98c04700 1 --2- 172.21.15.27:0/2779341638 >> v2:172.21.15.123:3300/0 conn(0x7f2e9414c450 0x7f2e9414b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e937fe700 1 --2- 172.21.15.27:0/2779341638 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2e940a0310 0x7f2e9406cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e92ffd700 1 -- 172.21.15.27:0/2779341638 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060341860 0 0) 0x7f2e9414bfc0 con 0x7f2e9406c910 2023-10-06T03:09:56.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e92ffd700 1 -- 172.21.15.27:0/2779341638 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e7c003570 con 0x7f2e9406c910 2023-10-06T03:09:56.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e92ffd700 1 -- 172.21.15.27:0/2779341638 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1967583098 0 0) 0x7f2e7c003570 con 0x7f2e9406c910 2023-10-06T03:09:56.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e98c04700 1 -- 172.21.15.27:0/2779341638 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2e940a0310 msgr2=0x7f2e9406cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:09:56.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e98c04700 1 --2- 172.21.15.27:0/2779341638 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2e940a0310 0x7f2e9406cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e98c04700 1 -- 172.21.15.27:0/2779341638 >> v1:172.21.15.27:6789/0 conn(0x7f2e9406c910 legacy=0x7f2e9414a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e98c04700 1 -- 172.21.15.27:0/2779341638 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9414b600 con 0x7f2e9414c450 2023-10-06T03:09:56.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e98c04700 1 --2- 172.21.15.27:0/2779341638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e9414c450 0x7f2e9414b0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009e60 tx=0x7f2e8c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f88645488c47f184 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:56.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e92ffd700 1 -- 172.21.15.27:0/2779341638 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00e070 con 0x7f2e9414c450 2023-10-06T03:09:56.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e92ffd700 1 -- 172.21.15.27:0/2779341638 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c00b7a0 con 0x7f2e9414c450 2023-10-06T03:09:56.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e92ffd700 1 -- 172.21.15.27:0/2779341638 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84001470 con 0x7f2e9414c450 2023-10-06T03:09:56.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 -- 172.21.15.27:0/2779341638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e9414c450 msgr2=0x7f2e9414b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 --2- 172.21.15.27:0/2779341638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e9414c450 0x7f2e9414b0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009e60 tx=0x7f2e8c009780 comp rx=0 tx=0).stop 2023-10-06T03:09:56.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 -- 172.21.15.27:0/2779341638 shutdown_connections 2023-10-06T03:09:56.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 --2- 172.21.15.27:0/2779341638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e9414c450 0x7f2e9414b0c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 --2- 172.21.15.27:0/2779341638 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2e940a0310 0x7f2e9406cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 -- 172.21.15.27:0/2779341638 >> 172.21.15.27:0/2779341638 conn(0x7f2e9406eb10 msgr2=0x7f2e940ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:56.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 -- 172.21.15.27:0/2779341638 shutdown_connections 2023-10-06T03:09:56.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.941+0000 7f2e99405700 1 -- 172.21.15.27:0/2779341638 wait complete. 2023-10-06T03:09:56.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e99405700 1 Processor -- start 2023-10-06T03:09:56.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e99405700 1 -- start start 2023-10-06T03:09:56.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e99405700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2e9406c910 0x7f2e9406a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e99405700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e940a0310 0x7f2e940b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e99405700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e9414c450 0x7f2e940b9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e99405700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9415ef40 con 0x7f2e940a0310 2023-10-06T03:09:56.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e99405700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9406acd0 con 0x7f2e9414c450 2023-10-06T03:09:56.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e99405700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9409a480 con 0x7f2e9406c910 2023-10-06T03:09:56.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e937fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e940a0310 0x7f2e940b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e937fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e940a0310 0x7f2e940b8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50808/0 (socket says 172.21.15.27:50808) 2023-10-06T03:09:56.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e937fe700 1 -- 172.21.15.27:0/1297607204 learned_addr learned my addr 172.21.15.27:0/1297607204 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:56.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e93fff700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2e9406c910 0x7f2e9406a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e98c04700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e9414c450 0x7f2e940b9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e937fe700 1 -- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2e9406c910 msgr2=0x7f2e9406a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e937fe700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2e9406c910 0x7f2e9406a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e937fe700 1 -- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e9414c450 msgr2=0x7f2e940b9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:56.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e937fe700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e9414c450 0x7f2e940b9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:56.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e937fe700 1 -- 172.21.15.27:0/1297607204 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c009a20 con 0x7f2e940a0310 2023-10-06T03:09:56.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e98c04700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e9414c450 0x7f2e940b9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:09:56.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e937fe700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e940a0310 0x7f2e940b8b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800ec80 tx=0x7f2e880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:56.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e7bfff700 1 -- 172.21.15.27:0/1297607204 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800c850 con 0x7f2e940a0310 2023-10-06T03:09:56.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e7bfff700 1 -- 172.21.15.27:0/1297607204 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8800c9b0 con 0x7f2e940a0310 2023-10-06T03:09:56.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e7bfff700 1 -- 172.21.15.27:0/1297607204 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800cd50 con 0x7f2e940a0310 2023-10-06T03:09:56.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e99405700 1 -- 172.21.15.27:0/1297607204 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9409a760 con 0x7f2e940a0310 2023-10-06T03:09:56.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.945+0000 7f2e99405700 1 -- 172.21.15.27:0/1297607204 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9406b080 con 0x7f2e940a0310 2023-10-06T03:09:56.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.949+0000 7f2e99405700 1 -- 172.21.15.27:0/1297607204 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9409a8f0 con 0x7f2e940a0310 2023-10-06T03:09:56.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.949+0000 7f2e7bfff700 1 -- 172.21.15.27:0/1297607204 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2e88013680 con 0x7f2e940a0310 2023-10-06T03:09:56.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.949+0000 7f2e7bfff700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2e80060580 0x7f2e80062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:56.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.949+0000 7f2e7bfff700 1 -- 172.21.15.27:0/1297607204 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f2e8807cc70 con 0x7f2e940a0310 2023-10-06T03:09:56.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.949+0000 7f2e93fff700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2e80060580 0x7f2e80062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:56.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.953+0000 7f2e93fff700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2e80060580 0x7f2e80062a30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2e9414fbb0 tx=0x7f2e84001a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:56.957+0000 7f2e7bfff700 1 -- 172.21.15.27:0/1297607204 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2e8804d020 con 0x7f2e940a0310 2023-10-06T03:09:57.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.121+0000 7f2e99405700 1 -- 172.21.15.27:0/1297607204 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e9404b600 con 0x7f2e80060580 2023-10-06T03:09:57.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.141+0000 7f2e7bfff700 1 -- 172.21.15.27:0/1297607204 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310316 (secure 0 0 0) 0x7f2e9404b600 con 0x7f2e80060580 2023-10-06T03:09:57.145 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:09:57.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.145+0000 7f2e99405700 1 -- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2e80060580 msgr2=0x7f2e80062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:57.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.145+0000 7f2e99405700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2e80060580 0x7f2e80062a30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2e9414fbb0 tx=0x7f2e84001a10 comp rx=0 tx=0).stop 2023-10-06T03:09:57.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.145+0000 7f2e99405700 1 -- 172.21.15.27:0/1297607204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e940a0310 msgr2=0x7f2e940b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:57.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.145+0000 7f2e99405700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e940a0310 0x7f2e940b8b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800ec80 tx=0x7f2e880091a0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.145+0000 7f2e99405700 1 -- 172.21.15.27:0/1297607204 shutdown_connections 2023-10-06T03:09:57.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.145+0000 7f2e99405700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f2e80060580 0x7f2e80062a30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.145+0000 7f2e99405700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e9414c450 0x7f2e940b9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.145+0000 7f2e99405700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e940a0310 0x7f2e940b8b40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.145+0000 7f2e99405700 1 --2- 172.21.15.27:0/1297607204 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2e9406c910 0x7f2e9406a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.145+0000 7f2e99405700 1 -- 172.21.15.27:0/1297607204 >> 172.21.15.27:0/1297607204 conn(0x7f2e9406eb10 msgr2=0x7f2e940a3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:57.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.145+0000 7f2e99405700 1 -- 172.21.15.27:0/1297607204 shutdown_connections 2023-10-06T03:09:57.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.145+0000 7f2e99405700 1 -- 172.21.15.27:0/1297607204 wait complete. 2023-10-06T03:09:57.150 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-10-06T03:09:57.163 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2023-10-06T03:09:55.183383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76103972,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":599,"num_read_kb":1179,"num_write":11705,"num_write_kb":82701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20586,"ondisk_log_size":20586,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2570144,"kb_used_data":150880,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752404576,"statfs":{"total":773094113280,"available":770462285824,"internally_reserved":0,"allocated":154501120,"data_stored":153061288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":69,"apply_latency_ms":69,"commit_latency_ns":69000000,"apply_latency_ns":69000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1161,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004546"},"pg_stats":[{"pgid":"4.3f","version":"26'91","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205300+0000","last_change":"2023-10-06T02:59:53.681789+0000","last_active":"2023-10-06T03:09:49.205300+0000","last_peered":"2023-10-06T03:09:49.205300+0000","last_clean":"2023-10-06T03:09:49.205300+0000","last_became_active":"2023-10-06T02:59:53.681495+0000","last_became_peered":"2023-10-06T02:59:53.681495+0000","last_unstale":"2023-10-06T03:09:49.205300+0000","last_undegraded":"2023-10-06T03:09:49.205300+0000","last_fullsized":"2023-10-06T03:09:49.205300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:19.626429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194862+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T03:09:49.194862+0000","last_peered":"2023-10-06T03:09:49.194862+0000","last_clean":"2023-10-06T03:09:49.194862+0000","last_became_active":"2023-10-06T02:59:53.681849+0000","last_became_peered":"2023-10-06T02:59:53.681849+0000","last_unstale":"2023-10-06T03:09:49.194862+0000","last_undegraded":"2023-10-06T03:09:49.194862+0000","last_fullsized":"2023-10-06T03:09:49.194862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"26'65","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195589+0000","last_change":"2023-10-06T02:59:53.679536+0000","last_active":"2023-10-06T03:09:49.195589+0000","last_peered":"2023-10-06T03:09:49.195589+0000","last_clean":"2023-10-06T03:09:49.195589+0000","last_became_active":"2023-10-06T02:59:53.678264+0000","last_became_peered":"2023-10-06T02:59:53.678264+0000","last_unstale":"2023-10-06T03:09:49.195589+0000","last_undegraded":"2023-10-06T03:09:49.195589+0000","last_fullsized":"2023-10-06T03:09:49.195589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:18.566933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"26'76","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.178090+0000","last_change":"2023-10-06T02:59:53.671821+0000","last_active":"2023-10-06T03:09:49.178090+0000","last_peered":"2023-10-06T03:09:49.178090+0000","last_clean":"2023-10-06T03:09:49.178090+0000","last_became_active":"2023-10-06T02:59:53.671555+0000","last_became_peered":"2023-10-06T02:59:53.671555+0000","last_unstale":"2023-10-06T03:09:49.178090+0000","last_undegraded":"2023-10-06T03:09:49.178090+0000","last_fullsized":"2023-10-06T03:09:49.178090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:36:28.006545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"26'85","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205702+0000","last_change":"2023-10-06T02:59:53.682691+0000","last_active":"2023-10-06T03:09:49.205702+0000","last_peered":"2023-10-06T03:09:49.205702+0000","last_clean":"2023-10-06T03:09:49.205702+0000","last_became_active":"2023-10-06T02:59:53.682399+0000","last_became_peered":"2023-10-06T02:59:53.682399+0000","last_unstale":"2023-10-06T03:09:49.205702+0000","last_undegraded":"2023-10-06T03:09:49.205702+0000","last_fullsized":"2023-10-06T03:09:49.205702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195685+0000","last_change":"2023-10-06T02:59:53.678208+0000","last_active":"2023-10-06T03:09:49.195685+0000","last_peered":"2023-10-06T03:09:49.195685+0000","last_clean":"2023-10-06T03:09:49.195685+0000","last_became_active":"2023-10-06T02:59:53.676481+0000","last_became_peered":"2023-10-06T02:59:53.676481+0000","last_unstale":"2023-10-06T03:09:49.195685+0000","last_undegraded":"2023-10-06T03:09:49.195685+0000","last_fullsized":"2023-10-06T03:09:49.195685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:42.767531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"26'93","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194495+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T03:09:49.194495+0000","last_peered":"2023-10-06T03:09:49.194495+0000","last_clean":"2023-10-06T03:09:49.194495+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:09:49.194495+0000","last_undegraded":"2023-10-06T03:09:49.194495+0000","last_fullsized":"2023-10-06T03:09:49.194495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"26'77","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196046+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T03:09:49.196046+0000","last_peered":"2023-10-06T03:09:49.196046+0000","last_clean":"2023-10-06T03:09:49.196046+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:09:49.196046+0000","last_undegraded":"2023-10-06T03:09:49.196046+0000","last_fullsized":"2023-10-06T03:09:49.196046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"26'89","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205683+0000","last_change":"2023-10-06T02:59:53.680395+0000","last_active":"2023-10-06T03:09:49.205683+0000","last_peered":"2023-10-06T03:09:49.205683+0000","last_clean":"2023-10-06T03:09:49.205683+0000","last_became_active":"2023-10-06T02:59:53.680086+0000","last_became_peered":"2023-10-06T02:59:53.680086+0000","last_unstale":"2023-10-06T03:09:49.205683+0000","last_undegraded":"2023-10-06T03:09:49.205683+0000","last_fullsized":"2023-10-06T03:09:49.205683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"26'73","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.189574+0000","last_change":"2023-10-06T02:59:53.675582+0000","last_active":"2023-10-06T03:09:49.189574+0000","last_peered":"2023-10-06T03:09:49.189574+0000","last_clean":"2023-10-06T03:09:49.189574+0000","last_became_active":"2023-10-06T02:59:53.675243+0000","last_became_peered":"2023-10-06T02:59:53.675243+0000","last_unstale":"2023-10-06T03:09:49.189574+0000","last_undegraded":"2023-10-06T03:09:49.189574+0000","last_fullsized":"2023-10-06T03:09:49.189574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194979+0000","last_change":"2023-10-06T02:59:53.679489+0000","last_active":"2023-10-06T03:09:49.194979+0000","last_peered":"2023-10-06T03:09:49.194979+0000","last_clean":"2023-10-06T03:09:49.194979+0000","last_became_active":"2023-10-06T02:59:53.678985+0000","last_became_peered":"2023-10-06T02:59:53.678985+0000","last_unstale":"2023-10-06T03:09:49.194979+0000","last_undegraded":"2023-10-06T03:09:49.194979+0000","last_fullsized":"2023-10-06T03:09:49.194979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:12.576010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.199369+0000","last_change":"2023-10-06T02:59:53.682799+0000","last_active":"2023-10-06T03:09:49.199369+0000","last_peered":"2023-10-06T03:09:49.199369+0000","last_clean":"2023-10-06T03:09:49.199369+0000","last_became_active":"2023-10-06T02:59:53.682464+0000","last_became_peered":"2023-10-06T02:59:53.682464+0000","last_unstale":"2023-10-06T03:09:49.199369+0000","last_undegraded":"2023-10-06T03:09:49.199369+0000","last_fullsized":"2023-10-06T03:09:49.199369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:06.403449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"26'84","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192420+0000","last_change":"2023-10-06T03:00:34.741799+0000","last_active":"2023-10-06T03:09:49.192420+0000","last_peered":"2023-10-06T03:09:49.192420+0000","last_clean":"2023-10-06T03:09:49.192420+0000","last_became_active":"2023-10-06T03:00:34.741173+0000","last_became_peered":"2023-10-06T03:00:34.741173+0000","last_unstale":"2023-10-06T03:09:49.192420+0000","last_undegraded":"2023-10-06T03:09:49.192420+0000","last_fullsized":"2023-10-06T03:09:49.192420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:30.493018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"26'74","reported_seq":85,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191870+0000","last_change":"2023-10-06T02:59:53.673321+0000","last_active":"2023-10-06T03:09:49.191870+0000","last_peered":"2023-10-06T03:09:49.191870+0000","last_clean":"2023-10-06T03:09:49.191870+0000","last_became_active":"2023-10-06T02:59:53.672957+0000","last_became_peered":"2023-10-06T02:59:53.672957+0000","last_unstale":"2023-10-06T03:09:49.191870+0000","last_undegraded":"2023-10-06T03:09:49.191870+0000","last_fullsized":"2023-10-06T03:09:49.191870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"26'78","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195086+0000","last_change":"2023-10-06T02:59:53.686669+0000","last_active":"2023-10-06T03:09:49.195086+0000","last_peered":"2023-10-06T03:09:49.195086+0000","last_clean":"2023-10-06T03:09:49.195086+0000","last_became_active":"2023-10-06T02:59:53.686352+0000","last_became_peered":"2023-10-06T02:59:53.686352+0000","last_unstale":"2023-10-06T03:09:49.195086+0000","last_undegraded":"2023-10-06T03:09:49.195086+0000","last_fullsized":"2023-10-06T03:09:49.195086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"26'88","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.197410+0000","last_change":"2023-10-06T02:59:53.680975+0000","last_active":"2023-10-06T03:09:49.197410+0000","last_peered":"2023-10-06T03:09:49.197410+0000","last_clean":"2023-10-06T03:09:49.197410+0000","last_became_active":"2023-10-06T02:59:53.678449+0000","last_became_peered":"2023-10-06T02:59:53.678449+0000","last_unstale":"2023-10-06T03:09:49.197410+0000","last_undegraded":"2023-10-06T03:09:49.197410+0000","last_fullsized":"2023-10-06T03:09:49.197410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:18.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205375+0000","last_change":"2023-10-06T02:59:53.680344+0000","last_active":"2023-10-06T03:09:49.205375+0000","last_peered":"2023-10-06T03:09:49.205375+0000","last_clean":"2023-10-06T03:09:49.205375+0000","last_became_active":"2023-10-06T02:59:53.680028+0000","last_became_peered":"2023-10-06T02:59:53.680028+0000","last_unstale":"2023-10-06T03:09:49.205375+0000","last_undegraded":"2023-10-06T03:09:49.205375+0000","last_fullsized":"2023-10-06T03:09:49.205375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"26'76","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191223+0000","last_change":"2023-10-06T02:59:53.678143+0000","last_active":"2023-10-06T03:09:49.191223+0000","last_peered":"2023-10-06T03:09:49.191223+0000","last_clean":"2023-10-06T03:09:49.191223+0000","last_became_active":"2023-10-06T02:59:53.676602+0000","last_became_peered":"2023-10-06T02:59:53.676602+0000","last_unstale":"2023-10-06T03:09:49.191223+0000","last_undegraded":"2023-10-06T03:09:49.191223+0000","last_fullsized":"2023-10-06T03:09:49.191223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:29.621147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196673+0000","last_change":"2023-10-06T02:59:53.675935+0000","last_active":"2023-10-06T03:09:49.196673+0000","last_peered":"2023-10-06T03:09:49.196673+0000","last_clean":"2023-10-06T03:09:49.196673+0000","last_became_active":"2023-10-06T02:59:53.675657+0000","last_became_peered":"2023-10-06T02:59:53.675657+0000","last_unstale":"2023-10-06T03:09:49.196673+0000","last_undegraded":"2023-10-06T03:09:49.196673+0000","last_fullsized":"2023-10-06T03:09:49.196673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:56.862647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191684+0000","last_change":"2023-10-06T02:59:53.673043+0000","last_active":"2023-10-06T03:09:49.191684+0000","last_peered":"2023-10-06T03:09:49.191684+0000","last_clean":"2023-10-06T03:09:49.191684+0000","last_became_active":"2023-10-06T02:59:53.672690+0000","last_became_peered":"2023-10-06T02:59:53.672690+0000","last_unstale":"2023-10-06T03:09:49.191684+0000","last_undegraded":"2023-10-06T03:09:49.191684+0000","last_fullsized":"2023-10-06T03:09:49.191684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"26'83","reported_seq":94,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194716+0000","last_change":"2023-10-06T02:59:53.684492+0000","last_active":"2023-10-06T03:09:49.194716+0000","last_peered":"2023-10-06T03:09:49.194716+0000","last_clean":"2023-10-06T03:09:49.194716+0000","last_became_active":"2023-10-06T02:59:53.684145+0000","last_became_peered":"2023-10-06T02:59:53.684145+0000","last_unstale":"2023-10-06T03:09:49.194716+0000","last_undegraded":"2023-10-06T03:09:49.194716+0000","last_fullsized":"2023-10-06T03:09:49.194716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"26'88","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200847+0000","last_change":"2023-10-06T02:59:53.683256+0000","last_active":"2023-10-06T03:09:49.200847+0000","last_peered":"2023-10-06T03:09:49.200847+0000","last_clean":"2023-10-06T03:09:49.200847+0000","last_became_active":"2023-10-06T02:59:53.682948+0000","last_became_peered":"2023-10-06T02:59:53.682948+0000","last_unstale":"2023-10-06T03:09:49.200847+0000","last_undegraded":"2023-10-06T03:09:49.200847+0000","last_fullsized":"2023-10-06T03:09:49.200847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"26'69","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206413+0000","last_change":"2023-10-06T02:59:53.675936+0000","last_active":"2023-10-06T03:09:49.206413+0000","last_peered":"2023-10-06T03:09:49.206413+0000","last_clean":"2023-10-06T03:09:49.206413+0000","last_became_active":"2023-10-06T02:59:53.675319+0000","last_became_peered":"2023-10-06T02:59:53.675319+0000","last_unstale":"2023-10-06T03:09:49.206413+0000","last_undegraded":"2023-10-06T03:09:49.206413+0000","last_fullsized":"2023-10-06T03:09:49.206413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195262+0000","last_change":"2023-10-06T02:59:53.686758+0000","last_active":"2023-10-06T03:09:49.195262+0000","last_peered":"2023-10-06T03:09:49.195262+0000","last_clean":"2023-10-06T03:09:49.195262+0000","last_became_active":"2023-10-06T02:59:53.686007+0000","last_became_peered":"2023-10-06T02:59:53.686007+0000","last_unstale":"2023-10-06T03:09:49.195262+0000","last_undegraded":"2023-10-06T03:09:49.195262+0000","last_fullsized":"2023-10-06T03:09:49.195262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"26'91","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200675+0000","last_change":"2023-10-06T02:59:53.682853+0000","last_active":"2023-10-06T03:09:49.200675+0000","last_peered":"2023-10-06T03:09:49.200675+0000","last_clean":"2023-10-06T03:09:49.200675+0000","last_became_active":"2023-10-06T02:59:53.682511+0000","last_became_peered":"2023-10-06T02:59:53.682511+0000","last_unstale":"2023-10-06T03:09:49.200675+0000","last_undegraded":"2023-10-06T03:09:49.200675+0000","last_fullsized":"2023-10-06T03:09:49.200675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"26'98","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196456+0000","last_change":"2023-10-06T02:59:53.682001+0000","last_active":"2023-10-06T03:09:49.196456+0000","last_peered":"2023-10-06T03:09:49.196456+0000","last_clean":"2023-10-06T03:09:49.196456+0000","last_became_active":"2023-10-06T02:59:53.681732+0000","last_became_peered":"2023-10-06T02:59:53.681732+0000","last_unstale":"2023-10-06T03:09:49.196456+0000","last_undegraded":"2023-10-06T03:09:49.196456+0000","last_fullsized":"2023-10-06T03:09:49.196456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.173694+0000","last_change":"2023-10-06T02:59:53.676598+0000","last_active":"2023-10-06T03:09:49.173694+0000","last_peered":"2023-10-06T03:09:49.173694+0000","last_clean":"2023-10-06T03:09:49.173694+0000","last_became_active":"2023-10-06T02:59:53.676284+0000","last_became_peered":"2023-10-06T02:59:53.676284+0000","last_unstale":"2023-10-06T03:09:49.173694+0000","last_undegraded":"2023-10-06T03:09:49.173694+0000","last_fullsized":"2023-10-06T03:09:49.173694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"26'61","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195455+0000","last_change":"2023-10-06T02:59:53.687275+0000","last_active":"2023-10-06T03:09:49.195455+0000","last_peered":"2023-10-06T03:09:49.195455+0000","last_clean":"2023-10-06T03:09:49.195455+0000","last_became_active":"2023-10-06T02:59:53.686912+0000","last_became_peered":"2023-10-06T02:59:53.686912+0000","last_unstale":"2023-10-06T03:09:49.195455+0000","last_undegraded":"2023-10-06T03:09:49.195455+0000","last_fullsized":"2023-10-06T03:09:49.195455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203610+0000","last_change":"2023-10-06T02:59:53.685421+0000","last_active":"2023-10-06T03:09:49.203610+0000","last_peered":"2023-10-06T03:09:49.203610+0000","last_clean":"2023-10-06T03:09:49.203610+0000","last_became_active":"2023-10-06T02:59:53.684806+0000","last_became_peered":"2023-10-06T02:59:53.684806+0000","last_unstale":"2023-10-06T03:09:49.203610+0000","last_undegraded":"2023-10-06T03:09:49.203610+0000","last_fullsized":"2023-10-06T03:09:49.203610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191736+0000","last_change":"2023-10-06T02:59:53.676085+0000","last_active":"2023-10-06T03:09:49.191736+0000","last_peered":"2023-10-06T03:09:49.191736+0000","last_clean":"2023-10-06T03:09:49.191736+0000","last_became_active":"2023-10-06T02:59:53.675718+0000","last_became_peered":"2023-10-06T02:59:53.675718+0000","last_unstale":"2023-10-06T03:09:49.191736+0000","last_undegraded":"2023-10-06T03:09:49.191736+0000","last_fullsized":"2023-10-06T03:09:49.191736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:00.548441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206351+0000","last_change":"2023-10-06T02:59:53.676118+0000","last_active":"2023-10-06T03:09:49.206351+0000","last_peered":"2023-10-06T03:09:49.206351+0000","last_clean":"2023-10-06T03:09:49.206351+0000","last_became_active":"2023-10-06T02:59:53.675682+0000","last_became_peered":"2023-10-06T02:59:53.675682+0000","last_unstale":"2023-10-06T03:09:49.206351+0000","last_undegraded":"2023-10-06T03:09:49.206351+0000","last_fullsized":"2023-10-06T03:09:49.206351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192921+0000","last_change":"2023-10-06T02:59:53.673225+0000","last_active":"2023-10-06T03:09:49.192921+0000","last_peered":"2023-10-06T03:09:49.192921+0000","last_clean":"2023-10-06T03:09:49.192921+0000","last_became_active":"2023-10-06T02:59:53.672930+0000","last_became_peered":"2023-10-06T02:59:53.672930+0000","last_unstale":"2023-10-06T03:09:49.192921+0000","last_undegraded":"2023-10-06T03:09:49.192921+0000","last_fullsized":"2023-10-06T03:09:49.192921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:02.845187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195360+0000","last_change":"2023-10-06T02:59:53.678742+0000","last_active":"2023-10-06T03:09:49.195360+0000","last_peered":"2023-10-06T03:09:49.195360+0000","last_clean":"2023-10-06T03:09:49.195360+0000","last_became_active":"2023-10-06T02:59:53.678471+0000","last_became_peered":"2023-10-06T02:59:53.678471+0000","last_unstale":"2023-10-06T03:09:49.195360+0000","last_undegraded":"2023-10-06T03:09:49.195360+0000","last_fullsized":"2023-10-06T03:09:49.195360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'1517","reported_seq":1529,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.502219+0000","last_change":"2023-10-06T02:59:53.297136+0000","last_active":"2023-10-06T03:09:37.502219+0000","last_peered":"2023-10-06T03:09:37.502219+0000","last_clean":"2023-10-06T03:09:37.502219+0000","last_became_active":"2023-10-06T02:59:53.296816+0000","last_became_peered":"2023-10-06T02:59:53.296816+0000","last_unstale":"2023-10-06T03:09:37.502219+0000","last_undegraded":"2023-10-06T03:09:37.502219+0000","last_fullsized":"2023-10-06T03:09:37.502219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:58.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1406,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'65","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.175064+0000","last_change":"2023-10-06T02:59:53.684876+0000","last_active":"2023-10-06T03:09:49.175064+0000","last_peered":"2023-10-06T03:09:49.175064+0000","last_clean":"2023-10-06T03:09:49.175064+0000","last_became_active":"2023-10-06T02:59:53.684522+0000","last_became_peered":"2023-10-06T02:59:53.684522+0000","last_unstale":"2023-10-06T03:09:49.175064+0000","last_undegraded":"2023-10-06T03:09:49.175064+0000","last_fullsized":"2023-10-06T03:09:49.175064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"26'125","reported_seq":137,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.507239+0000","last_change":"2023-10-06T02:59:53.292700+0000","last_active":"2023-10-06T03:09:37.507239+0000","last_peered":"2023-10-06T03:09:37.507239+0000","last_clean":"2023-10-06T03:09:37.507239+0000","last_became_active":"2023-10-06T02:59:53.292378+0000","last_became_peered":"2023-10-06T02:59:53.292378+0000","last_unstale":"2023-10-06T03:09:37.507239+0000","last_undegraded":"2023-10-06T03:09:37.507239+0000","last_fullsized":"2023-10-06T03:09:37.507239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204649+0000","last_change":"2023-10-06T02:59:53.675542+0000","last_active":"2023-10-06T03:09:49.204649+0000","last_peered":"2023-10-06T03:09:49.204649+0000","last_clean":"2023-10-06T03:09:49.204649+0000","last_became_active":"2023-10-06T02:59:53.675219+0000","last_became_peered":"2023-10-06T02:59:53.675219+0000","last_unstale":"2023-10-06T03:09:49.204649+0000","last_undegraded":"2023-10-06T03:09:49.204649+0000","last_fullsized":"2023-10-06T03:09:49.204649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"26'124","reported_seq":136,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.177954+0000","last_change":"2023-10-06T02:59:53.302122+0000","last_active":"2023-10-06T03:08:41.177954+0000","last_peered":"2023-10-06T03:08:41.177954+0000","last_clean":"2023-10-06T03:08:41.177954+0000","last_became_active":"2023-10-06T02:59:53.301737+0000","last_became_peered":"2023-10-06T02:59:53.301737+0000","last_unstale":"2023-10-06T03:08:41.177954+0000","last_undegraded":"2023-10-06T03:08:41.177954+0000","last_fullsized":"2023-10-06T03:08:41.177954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203476+0000","last_change":"2023-10-06T02:59:53.684854+0000","last_active":"2023-10-06T03:09:49.203476+0000","last_peered":"2023-10-06T03:09:49.203476+0000","last_clean":"2023-10-06T03:09:49.203476+0000","last_became_active":"2023-10-06T02:59:53.684527+0000","last_became_peered":"2023-10-06T02:59:53.684527+0000","last_unstale":"2023-10-06T03:09:49.203476+0000","last_undegraded":"2023-10-06T03:09:49.203476+0000","last_fullsized":"2023-10-06T03:09:49.203476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"26'135","reported_seq":147,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.502731+0000","last_change":"2023-10-06T02:59:53.294103+0000","last_active":"2023-10-06T03:09:37.502731+0000","last_peered":"2023-10-06T03:09:37.502731+0000","last_clean":"2023-10-06T03:09:37.502731+0000","last_became_active":"2023-10-06T02:59:53.293707+0000","last_became_peered":"2023-10-06T02:59:53.293707+0000","last_unstale":"2023-10-06T03:09:37.502731+0000","last_undegraded":"2023-10-06T03:09:37.502731+0000","last_fullsized":"2023-10-06T03:09:37.502731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"26'118","reported_seq":130,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505440+0000","last_change":"2023-10-06T02:59:53.296507+0000","last_active":"2023-10-06T03:09:37.505440+0000","last_peered":"2023-10-06T03:09:37.505440+0000","last_clean":"2023-10-06T03:09:37.505440+0000","last_became_active":"2023-10-06T02:59:53.296230+0000","last_became_peered":"2023-10-06T02:59:53.296230+0000","last_unstale":"2023-10-06T03:09:37.505440+0000","last_undegraded":"2023-10-06T03:09:37.505440+0000","last_fullsized":"2023-10-06T03:09:37.505440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"26'90","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.176351+0000","last_change":"2023-10-06T02:59:53.684046+0000","last_active":"2023-10-06T03:09:49.176351+0000","last_peered":"2023-10-06T03:09:49.176351+0000","last_clean":"2023-10-06T03:09:49.176351+0000","last_became_active":"2023-10-06T02:59:53.683705+0000","last_became_peered":"2023-10-06T02:59:53.683705+0000","last_unstale":"2023-10-06T03:09:49.176351+0000","last_undegraded":"2023-10-06T03:09:49.176351+0000","last_fullsized":"2023-10-06T03:09:49.176351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'106","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.175579+0000","last_change":"2023-10-06T02:59:53.296465+0000","last_active":"2023-10-06T03:08:41.175579+0000","last_peered":"2023-10-06T03:08:41.175579+0000","last_clean":"2023-10-06T03:08:41.175579+0000","last_became_active":"2023-10-06T02:59:53.296225+0000","last_became_peered":"2023-10-06T02:59:53.296225+0000","last_unstale":"2023-10-06T03:08:41.175579+0000","last_undegraded":"2023-10-06T03:08:41.175579+0000","last_fullsized":"2023-10-06T03:08:41.175579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'81","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.198537+0000","last_change":"2023-10-06T02:59:53.683216+0000","last_active":"2023-10-06T03:09:49.198537+0000","last_peered":"2023-10-06T03:09:49.198537+0000","last_clean":"2023-10-06T03:09:49.198537+0000","last_became_active":"2023-10-06T02:59:53.682938+0000","last_became_peered":"2023-10-06T02:59:53.682938+0000","last_unstale":"2023-10-06T03:09:49.198537+0000","last_undegraded":"2023-10-06T03:09:49.198537+0000","last_fullsized":"2023-10-06T03:09:49.198537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"26'620","reported_seq":632,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.502276+0000","last_change":"2023-10-06T02:59:53.293929+0000","last_active":"2023-10-06T03:09:37.502276+0000","last_peered":"2023-10-06T03:09:37.502276+0000","last_clean":"2023-10-06T03:09:37.502276+0000","last_became_active":"2023-10-06T02:59:53.293602+0000","last_became_peered":"2023-10-06T02:59:53.293602+0000","last_unstale":"2023-10-06T03:09:37.502276+0000","last_undegraded":"2023-10-06T03:09:37.502276+0000","last_fullsized":"2023-10-06T03:09:37.502276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196618+0000","last_change":"2023-10-06T02:59:53.672111+0000","last_active":"2023-10-06T03:09:49.196618+0000","last_peered":"2023-10-06T03:09:49.196618+0000","last_clean":"2023-10-06T03:09:49.196618+0000","last_became_active":"2023-10-06T02:59:53.671511+0000","last_became_peered":"2023-10-06T02:59:53.671511+0000","last_unstale":"2023-10-06T03:09:49.196618+0000","last_undegraded":"2023-10-06T03:09:49.196618+0000","last_fullsized":"2023-10-06T03:09:49.196618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'134","reported_seq":146,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.170376+0000","last_change":"2023-10-06T02:59:53.300059+0000","last_active":"2023-10-06T03:08:41.170376+0000","last_peered":"2023-10-06T03:08:41.170376+0000","last_clean":"2023-10-06T03:08:41.170376+0000","last_became_active":"2023-10-06T02:59:53.299715+0000","last_became_peered":"2023-10-06T02:59:53.299715+0000","last_unstale":"2023-10-06T03:08:41.170376+0000","last_undegraded":"2023-10-06T03:08:41.170376+0000","last_fullsized":"2023-10-06T03:08:41.170376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"26'94","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200602+0000","last_change":"2023-10-06T02:59:53.683331+0000","last_active":"2023-10-06T03:09:49.200602+0000","last_peered":"2023-10-06T03:09:49.200602+0000","last_clean":"2023-10-06T03:09:49.200602+0000","last_became_active":"2023-10-06T02:59:53.682994+0000","last_became_peered":"2023-10-06T02:59:53.682994+0000","last_unstale":"2023-10-06T03:09:49.200602+0000","last_undegraded":"2023-10-06T03:09:49.200602+0000","last_fullsized":"2023-10-06T03:09:49.200602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'618","reported_seq":630,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.504933+0000","last_change":"2023-10-06T02:59:53.301126+0000","last_active":"2023-10-06T03:09:38.504933+0000","last_peered":"2023-10-06T03:09:38.504933+0000","last_clean":"2023-10-06T03:09:38.504933+0000","last_became_active":"2023-10-06T02:59:53.300850+0000","last_became_peered":"2023-10-06T02:59:53.300850+0000","last_unstale":"2023-10-06T03:09:38.504933+0000","last_undegraded":"2023-10-06T03:09:38.504933+0000","last_fullsized":"2023-10-06T03:09:38.504933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204076+0000","last_change":"2023-10-06T02:59:53.678930+0000","last_active":"2023-10-06T03:09:49.204076+0000","last_peered":"2023-10-06T03:09:49.204076+0000","last_clean":"2023-10-06T03:09:49.204076+0000","last_became_active":"2023-10-06T02:59:53.678630+0000","last_became_peered":"2023-10-06T02:59:53.678630+0000","last_unstale":"2023-10-06T03:09:49.204076+0000","last_undegraded":"2023-10-06T03:09:49.204076+0000","last_fullsized":"2023-10-06T03:09:49.204076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:14.961350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'128","reported_seq":140,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:42.163802+0000","last_change":"2023-10-06T02:59:53.291521+0000","last_active":"2023-10-06T03:08:42.163802+0000","last_peered":"2023-10-06T03:08:42.163802+0000","last_clean":"2023-10-06T03:08:42.163802+0000","last_became_active":"2023-10-06T02:59:53.290773+0000","last_became_peered":"2023-10-06T02:59:53.290773+0000","last_unstale":"2023-10-06T03:08:42.163802+0000","last_undegraded":"2023-10-06T03:08:42.163802+0000","last_fullsized":"2023-10-06T03:08:42.163802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.198768+0000","last_change":"2023-10-06T02:59:53.678188+0000","last_active":"2023-10-06T03:09:49.198768+0000","last_peered":"2023-10-06T03:09:49.198768+0000","last_clean":"2023-10-06T03:09:49.198768+0000","last_became_active":"2023-10-06T02:59:53.676507+0000","last_became_peered":"2023-10-06T02:59:53.676507+0000","last_unstale":"2023-10-06T03:09:49.198768+0000","last_undegraded":"2023-10-06T03:09:49.198768+0000","last_fullsized":"2023-10-06T03:09:49.198768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"26'126","reported_seq":138,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.500688+0000","last_change":"2023-10-06T02:59:53.289980+0000","last_active":"2023-10-06T03:09:37.500688+0000","last_peered":"2023-10-06T03:09:37.500688+0000","last_clean":"2023-10-06T03:09:37.500688+0000","last_became_active":"2023-10-06T02:59:53.288601+0000","last_became_peered":"2023-10-06T02:59:53.288601+0000","last_unstale":"2023-10-06T03:09:37.500688+0000","last_undegraded":"2023-10-06T03:09:37.500688+0000","last_fullsized":"2023-10-06T03:09:37.500688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:54.630392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191584+0000","last_change":"2023-10-06T02:59:53.675456+0000","last_active":"2023-10-06T03:09:49.191584+0000","last_peered":"2023-10-06T03:09:49.191584+0000","last_clean":"2023-10-06T03:09:49.191584+0000","last_became_active":"2023-10-06T02:59:53.673268+0000","last_became_peered":"2023-10-06T02:59:53.673268+0000","last_unstale":"2023-10-06T03:09:49.191584+0000","last_undegraded":"2023-10-06T03:09:49.191584+0000","last_fullsized":"2023-10-06T03:09:49.191584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'687","reported_seq":699,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505021+0000","last_change":"2023-10-06T02:59:53.298398+0000","last_active":"2023-10-06T03:09:37.505021+0000","last_peered":"2023-10-06T03:09:37.505021+0000","last_clean":"2023-10-06T03:09:37.505021+0000","last_became_active":"2023-10-06T02:59:53.297896+0000","last_became_peered":"2023-10-06T02:59:53.297896+0000","last_unstale":"2023-10-06T03:09:37.505021+0000","last_undegraded":"2023-10-06T03:09:37.505021+0000","last_fullsized":"2023-10-06T03:09:37.505021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205139+0000","last_change":"2023-10-06T02:59:53.679712+0000","last_active":"2023-10-06T03:09:49.205139+0000","last_peered":"2023-10-06T03:09:49.205139+0000","last_clean":"2023-10-06T03:09:49.205139+0000","last_became_active":"2023-10-06T02:59:53.679390+0000","last_became_peered":"2023-10-06T02:59:53.679390+0000","last_unstale":"2023-10-06T03:09:49.205139+0000","last_undegraded":"2023-10-06T03:09:49.205139+0000","last_fullsized":"2023-10-06T03:09:49.205139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:34.124779+0000","last_change":"2023-10-06T02:59:44.074625+0000","last_active":"2023-10-06T03:00:34.124779+0000","last_peered":"2023-10-06T03:00:34.124779+0000","last_clean":"2023-10-06T03:00:34.124779+0000","last_became_active":"2023-10-06T02:59:44.072854+0000","last_became_peered":"2023-10-06T02:59:44.072854+0000","last_unstale":"2023-10-06T03:00:34.124779+0000","last_undegraded":"2023-10-06T03:00:34.124779+0000","last_fullsized":"2023-10-06T03:00:34.124779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_clean_scrub_stamp":"2023-10-06T02:59:43.039151+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:04.936706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.738241+0000","last_change":"2023-10-06T02:59:49.107090+0000","last_active":"2023-10-06T03:00:33.738241+0000","last_peered":"2023-10-06T03:00:33.738241+0000","last_clean":"2023-10-06T03:00:33.738241+0000","last_became_active":"2023-10-06T02:59:49.106619+0000","last_became_peered":"2023-10-06T02:59:49.106619+0000","last_unstale":"2023-10-06T03:00:33.738241+0000","last_undegraded":"2023-10-06T03:00:33.738241+0000","last_fullsized":"2023-10-06T03:00:33.738241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"26'1461","reported_seq":1473,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506597+0000","last_change":"2023-10-06T02:59:53.298769+0000","last_active":"2023-10-06T03:09:37.506597+0000","last_peered":"2023-10-06T03:09:37.506597+0000","last_clean":"2023-10-06T03:09:37.506597+0000","last_became_active":"2023-10-06T02:59:53.298012+0000","last_became_peered":"2023-10-06T02:59:53.298012+0000","last_unstale":"2023-10-06T03:09:37.506597+0000","last_undegraded":"2023-10-06T03:09:37.506597+0000","last_fullsized":"2023-10-06T03:09:37.506597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1461,"log_dups_size":0,"ondisk_log_size":1461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1329,"num_write_kb":8969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.181004+0000","last_change":"2023-10-06T02:59:53.679625+0000","last_active":"2023-10-06T03:09:49.181004+0000","last_peered":"2023-10-06T03:09:49.181004+0000","last_clean":"2023-10-06T03:09:49.181004+0000","last_became_active":"2023-10-06T02:59:53.679200+0000","last_became_peered":"2023-10-06T02:59:53.679200+0000","last_unstale":"2023-10-06T03:09:49.181004+0000","last_undegraded":"2023-10-06T03:09:49.181004+0000","last_fullsized":"2023-10-06T03:09:49.181004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:59.309901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:34.124485+0000","last_change":"2023-10-06T02:59:49.107231+0000","last_active":"2023-10-06T03:00:34.124485+0000","last_peered":"2023-10-06T03:00:34.124485+0000","last_clean":"2023-10-06T03:00:34.124485+0000","last_became_active":"2023-10-06T02:59:49.106878+0000","last_became_peered":"2023-10-06T02:59:49.106878+0000","last_unstale":"2023-10-06T03:00:34.124485+0000","last_undegraded":"2023-10-06T03:00:34.124485+0000","last_fullsized":"2023-10-06T03:00:34.124485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"26'603","reported_seq":1098,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:39.495232+0000","last_change":"2023-10-06T02:59:53.296937+0000","last_active":"2023-10-06T03:09:39.495232+0000","last_peered":"2023-10-06T03:09:39.495232+0000","last_clean":"2023-10-06T03:09:39.495232+0000","last_became_active":"2023-10-06T02:59:53.296171+0000","last_became_peered":"2023-10-06T02:59:53.296171+0000","last_unstale":"2023-10-06T03:09:39.495232+0000","last_undegraded":"2023-10-06T03:09:39.495232+0000","last_fullsized":"2023-10-06T03:09:39.495232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770024,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":483,"num_write_kb":1079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"26'88","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200671+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T03:09:49.200671+0000","last_peered":"2023-10-06T03:09:49.200671+0000","last_clean":"2023-10-06T03:09:49.200671+0000","last_became_active":"2023-10-06T02:59:53.681786+0000","last_became_peered":"2023-10-06T02:59:53.681786+0000","last_unstale":"2023-10-06T03:09:49.200671+0000","last_undegraded":"2023-10-06T03:09:49.200671+0000","last_fullsized":"2023-10-06T03:09:49.200671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.733289+0000","last_change":"2023-10-06T02:59:49.115200+0000","last_active":"2023-10-06T03:00:33.733289+0000","last_peered":"2023-10-06T03:00:33.733289+0000","last_clean":"2023-10-06T03:00:33.733289+0000","last_became_active":"2023-10-06T02:59:49.114769+0000","last_became_peered":"2023-10-06T02:59:49.114769+0000","last_unstale":"2023-10-06T03:00:33.733289+0000","last_undegraded":"2023-10-06T03:00:33.733289+0000","last_fullsized":"2023-10-06T03:00:33.733289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:37.773233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'1468","reported_seq":1480,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:07.312340+0000","last_change":"2023-10-06T02:59:53.298658+0000","last_active":"2023-10-06T03:09:07.312340+0000","last_peered":"2023-10-06T03:09:07.312340+0000","last_clean":"2023-10-06T03:09:07.312340+0000","last_became_active":"2023-10-06T02:59:53.298054+0000","last_became_peered":"2023-10-06T02:59:53.298054+0000","last_unstale":"2023-10-06T03:09:07.312340+0000","last_undegraded":"2023-10-06T03:09:07.312340+0000","last_fullsized":"2023-10-06T03:09:07.312340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1468,"log_dups_size":0,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1335,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.199508+0000","last_change":"2023-10-06T02:59:53.673950+0000","last_active":"2023-10-06T03:09:49.199508+0000","last_peered":"2023-10-06T03:09:49.199508+0000","last_clean":"2023-10-06T03:09:49.199508+0000","last_became_active":"2023-10-06T02:59:53.673677+0000","last_became_peered":"2023-10-06T02:59:53.673677+0000","last_unstale":"2023-10-06T03:09:49.199508+0000","last_undegraded":"2023-10-06T03:09:49.199508+0000","last_fullsized":"2023-10-06T03:09:49.199508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.738308+0000","last_change":"2023-10-06T02:59:49.107944+0000","last_active":"2023-10-06T03:00:33.738308+0000","last_peered":"2023-10-06T03:00:33.738308+0000","last_clean":"2023-10-06T03:00:33.738308+0000","last_became_active":"2023-10-06T02:59:49.107560+0000","last_became_peered":"2023-10-06T02:59:49.107560+0000","last_unstale":"2023-10-06T03:00:33.738308+0000","last_undegraded":"2023-10-06T03:00:33.738308+0000","last_fullsized":"2023-10-06T03:00:33.738308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'122","reported_seq":134,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506182+0000","last_change":"2023-10-06T02:59:53.300945+0000","last_active":"2023-10-06T03:09:37.506182+0000","last_peered":"2023-10-06T03:09:37.506182+0000","last_clean":"2023-10-06T03:09:37.506182+0000","last_became_active":"2023-10-06T02:59:53.300609+0000","last_became_peered":"2023-10-06T02:59:53.300609+0000","last_unstale":"2023-10-06T03:09:37.506182+0000","last_undegraded":"2023-10-06T03:09:37.506182+0000","last_fullsized":"2023-10-06T03:09:37.506182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"26'78","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192720+0000","last_change":"2023-10-06T03:00:34.740673+0000","last_active":"2023-10-06T03:09:49.192720+0000","last_peered":"2023-10-06T03:09:49.192720+0000","last_clean":"2023-10-06T03:09:49.192720+0000","last_became_active":"2023-10-06T03:00:34.740140+0000","last_became_peered":"2023-10-06T03:00:34.740140+0000","last_unstale":"2023-10-06T03:09:49.192720+0000","last_undegraded":"2023-10-06T03:09:49.192720+0000","last_fullsized":"2023-10-06T03:09:49.192720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.929423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'105","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.499293+0000","last_change":"2023-10-06T02:59:53.301191+0000","last_active":"2023-10-06T03:09:37.499293+0000","last_peered":"2023-10-06T03:09:37.499293+0000","last_clean":"2023-10-06T03:09:37.499293+0000","last_became_active":"2023-10-06T02:59:53.300919+0000","last_became_peered":"2023-10-06T02:59:53.300919+0000","last_unstale":"2023-10-06T03:09:37.499293+0000","last_undegraded":"2023-10-06T03:09:37.499293+0000","last_fullsized":"2023-10-06T03:09:37.499293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.741892+0000","last_change":"2023-10-06T02:59:49.108499+0000","last_active":"2023-10-06T03:00:33.741892+0000","last_peered":"2023-10-06T03:00:33.741892+0000","last_clean":"2023-10-06T03:00:33.741892+0000","last_became_active":"2023-10-06T02:59:49.107967+0000","last_became_peered":"2023-10-06T02:59:49.107967+0000","last_unstale":"2023-10-06T03:00:33.741892+0000","last_undegraded":"2023-10-06T03:00:33.741892+0000","last_fullsized":"2023-10-06T03:00:33.741892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195724+0000","last_change":"2023-10-06T02:59:53.676753+0000","last_active":"2023-10-06T03:09:49.195724+0000","last_peered":"2023-10-06T03:09:49.195724+0000","last_clean":"2023-10-06T03:09:49.195724+0000","last_became_active":"2023-10-06T02:59:53.676385+0000","last_became_peered":"2023-10-06T02:59:53.676385+0000","last_unstale":"2023-10-06T03:09:49.195724+0000","last_undegraded":"2023-10-06T03:09:49.195724+0000","last_fullsized":"2023-10-06T03:09:49.195724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"26'115","reported_seq":127,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.178338+0000","last_change":"2023-10-06T02:59:53.303221+0000","last_active":"2023-10-06T03:08:41.178338+0000","last_peered":"2023-10-06T03:08:41.178338+0000","last_clean":"2023-10-06T03:08:41.178338+0000","last_became_active":"2023-10-06T02:59:53.302890+0000","last_became_peered":"2023-10-06T02:59:53.302890+0000","last_unstale":"2023-10-06T03:08:41.178338+0000","last_undegraded":"2023-10-06T03:08:41.178338+0000","last_fullsized":"2023-10-06T03:08:41.178338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:34.125363+0000","last_change":"2023-10-06T02:59:49.102005+0000","last_active":"2023-10-06T03:00:34.125363+0000","last_peered":"2023-10-06T03:00:34.125363+0000","last_clean":"2023-10-06T03:00:34.125363+0000","last_became_active":"2023-10-06T02:59:49.101530+0000","last_became_peered":"2023-10-06T02:59:49.101530+0000","last_unstale":"2023-10-06T03:00:34.125363+0000","last_undegraded":"2023-10-06T03:00:34.125363+0000","last_fullsized":"2023-10-06T03:00:34.125363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.186999+0000","last_change":"2023-10-06T02:59:53.672581+0000","last_active":"2023-10-06T03:09:49.186999+0000","last_peered":"2023-10-06T03:09:49.186999+0000","last_clean":"2023-10-06T03:09:49.186999+0000","last_became_active":"2023-10-06T02:59:53.672299+0000","last_became_peered":"2023-10-06T02:59:53.672299+0000","last_unstale":"2023-10-06T03:09:49.186999+0000","last_undegraded":"2023-10-06T03:09:49.186999+0000","last_fullsized":"2023-10-06T03:09:49.186999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"26'120","reported_seq":132,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.177130+0000","last_change":"2023-10-06T02:59:53.300135+0000","last_active":"2023-10-06T03:08:41.177130+0000","last_peered":"2023-10-06T03:08:41.177130+0000","last_clean":"2023-10-06T03:08:41.177130+0000","last_became_active":"2023-10-06T02:59:53.299271+0000","last_became_peered":"2023-10-06T02:59:53.299271+0000","last_unstale":"2023-10-06T03:08:41.177130+0000","last_undegraded":"2023-10-06T03:08:41.177130+0000","last_fullsized":"2023-10-06T03:08:41.177130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.742127+0000","last_change":"2023-10-06T02:59:49.100171+0000","last_active":"2023-10-06T03:00:33.742127+0000","last_peered":"2023-10-06T03:00:33.742127+0000","last_clean":"2023-10-06T03:00:33.742127+0000","last_became_active":"2023-10-06T02:59:49.099689+0000","last_became_peered":"2023-10-06T02:59:49.099689+0000","last_unstale":"2023-10-06T03:00:33.742127+0000","last_undegraded":"2023-10-06T03:00:33.742127+0000","last_fullsized":"2023-10-06T03:00:33.742127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'94","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203550+0000","last_change":"2023-10-06T02:59:53.685270+0000","last_active":"2023-10-06T03:09:49.203550+0000","last_peered":"2023-10-06T03:09:49.203550+0000","last_clean":"2023-10-06T03:09:49.203550+0000","last_became_active":"2023-10-06T02:59:53.684983+0000","last_became_peered":"2023-10-06T02:59:53.684983+0000","last_unstale":"2023-10-06T03:09:49.203550+0000","last_undegraded":"2023-10-06T03:09:49.203550+0000","last_fullsized":"2023-10-06T03:09:49.203550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:49.904101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'244","reported_seq":256,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.504458+0000","last_change":"2023-10-06T02:59:53.301048+0000","last_active":"2023-10-06T03:09:38.504458+0000","last_peered":"2023-10-06T03:09:38.504458+0000","last_clean":"2023-10-06T03:09:38.504458+0000","last_became_active":"2023-10-06T02:59:53.300086+0000","last_became_peered":"2023-10-06T02:59:53.300086+0000","last_unstale":"2023-10-06T03:09:38.504458+0000","last_undegraded":"2023-10-06T03:09:38.504458+0000","last_fullsized":"2023-10-06T03:09:38.504458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.732387+0000","last_change":"2023-10-06T02:59:49.102935+0000","last_active":"2023-10-06T03:00:33.732387+0000","last_peered":"2023-10-06T03:00:33.732387+0000","last_clean":"2023-10-06T03:00:33.732387+0000","last_became_active":"2023-10-06T02:59:49.102397+0000","last_became_peered":"2023-10-06T02:59:49.102397+0000","last_unstale":"2023-10-06T03:00:33.732387+0000","last_undegraded":"2023-10-06T03:00:33.732387+0000","last_fullsized":"2023-10-06T03:00:33.732387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'77","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192435+0000","last_change":"2023-10-06T02:59:53.676229+0000","last_active":"2023-10-06T03:09:49.192435+0000","last_peered":"2023-10-06T03:09:49.192435+0000","last_clean":"2023-10-06T03:09:49.192435+0000","last_became_active":"2023-10-06T02:59:53.675895+0000","last_became_peered":"2023-10-06T02:59:53.675895+0000","last_unstale":"2023-10-06T03:09:49.192435+0000","last_undegraded":"2023-10-06T03:09:49.192435+0000","last_fullsized":"2023-10-06T03:09:49.192435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:03.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"26'85","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.188557+0000","last_change":"2023-10-06T02:59:53.676843+0000","last_active":"2023-10-06T03:09:49.188557+0000","last_peered":"2023-10-06T03:09:49.188557+0000","last_clean":"2023-10-06T03:09:49.188557+0000","last_became_active":"2023-10-06T02:59:53.676528+0000","last_became_peered":"2023-10-06T02:59:53.676528+0000","last_unstale":"2023-10-06T03:09:49.188557+0000","last_undegraded":"2023-10-06T03:09:49.188557+0000","last_fullsized":"2023-10-06T03:09:49.188557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'529","reported_seq":541,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505437+0000","last_change":"2023-10-06T02:59:53.294557+0000","last_active":"2023-10-06T03:09:37.505437+0000","last_peered":"2023-10-06T03:09:37.505437+0000","last_clean":"2023-10-06T03:09:37.505437+0000","last_became_active":"2023-10-06T02:59:53.291434+0000","last_became_peered":"2023-10-06T02:59:53.291434+0000","last_unstale":"2023-10-06T03:09:37.505437+0000","last_undegraded":"2023-10-06T03:09:37.505437+0000","last_fullsized":"2023-10-06T03:09:37.505437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196820+0000","last_change":"2023-10-06T02:59:53.678204+0000","last_active":"2023-10-06T03:09:49.196820+0000","last_peered":"2023-10-06T03:09:49.196820+0000","last_clean":"2023-10-06T03:09:49.196820+0000","last_became_active":"2023-10-06T02:59:53.677924+0000","last_became_peered":"2023-10-06T02:59:53.677924+0000","last_unstale":"2023-10-06T03:09:49.196820+0000","last_undegraded":"2023-10-06T03:09:49.196820+0000","last_fullsized":"2023-10-06T03:09:49.196820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"26'336","reported_seq":348,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.507759+0000","last_change":"2023-10-06T02:59:53.301253+0000","last_active":"2023-10-06T03:09:38.507759+0000","last_peered":"2023-10-06T03:09:38.507759+0000","last_clean":"2023-10-06T03:09:38.507759+0000","last_became_active":"2023-10-06T02:59:53.300926+0000","last_became_peered":"2023-10-06T02:59:53.300926+0000","last_unstale":"2023-10-06T03:09:38.507759+0000","last_undegraded":"2023-10-06T03:09:38.507759+0000","last_fullsized":"2023-10-06T03:09:38.507759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:21.432516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'135","reported_seq":147,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.500451+0000","last_change":"2023-10-06T02:59:53.292844+0000","last_active":"2023-10-06T03:09:37.500451+0000","last_peered":"2023-10-06T03:09:37.500451+0000","last_clean":"2023-10-06T03:09:37.500451+0000","last_became_active":"2023-10-06T02:59:53.292493+0000","last_became_peered":"2023-10-06T02:59:53.292493+0000","last_unstale":"2023-10-06T03:09:37.500451+0000","last_undegraded":"2023-10-06T03:09:37.500451+0000","last_fullsized":"2023-10-06T03:09:37.500451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"26'94","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206446+0000","last_change":"2023-10-06T02:59:53.676684+0000","last_active":"2023-10-06T03:09:49.206446+0000","last_peered":"2023-10-06T03:09:49.206446+0000","last_clean":"2023-10-06T03:09:49.206446+0000","last_became_active":"2023-10-06T02:59:53.676410+0000","last_became_peered":"2023-10-06T02:59:53.676410+0000","last_unstale":"2023-10-06T03:09:49.206446+0000","last_undegraded":"2023-10-06T03:09:49.206446+0000","last_fullsized":"2023-10-06T03:09:49.206446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"26'122","reported_seq":134,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.501788+0000","last_change":"2023-10-06T02:59:53.293924+0000","last_active":"2023-10-06T03:09:37.501788+0000","last_peered":"2023-10-06T03:09:37.501788+0000","last_clean":"2023-10-06T03:09:37.501788+0000","last_became_active":"2023-10-06T02:59:53.293596+0000","last_became_peered":"2023-10-06T02:59:53.293596+0000","last_unstale":"2023-10-06T03:09:37.501788+0000","last_undegraded":"2023-10-06T03:09:37.501788+0000","last_fullsized":"2023-10-06T03:09:37.501788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"26'91","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203618+0000","last_change":"2023-10-06T02:59:53.673847+0000","last_active":"2023-10-06T03:09:49.203618+0000","last_peered":"2023-10-06T03:09:49.203618+0000","last_clean":"2023-10-06T03:09:49.203618+0000","last_became_active":"2023-10-06T02:59:53.673559+0000","last_became_peered":"2023-10-06T02:59:53.673559+0000","last_unstale":"2023-10-06T03:09:49.203618+0000","last_undegraded":"2023-10-06T03:09:49.203618+0000","last_fullsized":"2023-10-06T03:09:49.203618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"26'76","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.174477+0000","last_change":"2023-10-06T02:59:53.674388+0000","last_active":"2023-10-06T03:09:49.174477+0000","last_peered":"2023-10-06T03:09:49.174477+0000","last_clean":"2023-10-06T03:09:49.174477+0000","last_became_active":"2023-10-06T02:59:53.674086+0000","last_became_peered":"2023-10-06T02:59:53.674086+0000","last_unstale":"2023-10-06T03:09:49.174477+0000","last_undegraded":"2023-10-06T03:09:49.174477+0000","last_fullsized":"2023-10-06T03:09:49.174477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'1576","reported_seq":1588,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.145397+0000","last_change":"2023-10-06T02:59:53.296871+0000","last_active":"2023-10-06T03:09:49.145397+0000","last_peered":"2023-10-06T03:09:49.145397+0000","last_clean":"2023-10-06T03:09:49.145397+0000","last_became_active":"2023-10-06T02:59:53.296550+0000","last_became_peered":"2023-10-06T02:59:53.296550+0000","last_unstale":"2023-10-06T03:09:49.145397+0000","last_undegraded":"2023-10-06T03:09:49.145397+0000","last_fullsized":"2023-10-06T03:09:49.145397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1576,"log_dups_size":0,"ondisk_log_size":1576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7633302,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1449,"num_write_kb":8304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.178500+0000","last_change":"2023-10-06T02:59:53.683771+0000","last_active":"2023-10-06T03:09:49.178500+0000","last_peered":"2023-10-06T03:09:49.178500+0000","last_clean":"2023-10-06T03:09:49.178500+0000","last_became_active":"2023-10-06T02:59:53.683458+0000","last_became_peered":"2023-10-06T02:59:53.683458+0000","last_unstale":"2023-10-06T03:09:49.178500+0000","last_undegraded":"2023-10-06T03:09:49.178500+0000","last_fullsized":"2023-10-06T03:09:49.178500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'118","reported_seq":130,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.168177+0000","last_change":"2023-10-06T02:59:53.301158+0000","last_active":"2023-10-06T03:08:41.168177+0000","last_peered":"2023-10-06T03:08:41.168177+0000","last_clean":"2023-10-06T03:08:41.168177+0000","last_became_active":"2023-10-06T02:59:53.300797+0000","last_became_peered":"2023-10-06T02:59:53.300797+0000","last_unstale":"2023-10-06T03:08:41.168177+0000","last_undegraded":"2023-10-06T03:08:41.168177+0000","last_fullsized":"2023-10-06T03:08:41.168177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"26'77","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203877+0000","last_change":"2023-10-06T02:59:53.683576+0000","last_active":"2023-10-06T03:09:49.203877+0000","last_peered":"2023-10-06T03:09:49.203877+0000","last_clean":"2023-10-06T03:09:49.203877+0000","last_became_active":"2023-10-06T02:59:53.683301+0000","last_became_peered":"2023-10-06T02:59:53.683301+0000","last_unstale":"2023-10-06T03:09:49.203877+0000","last_undegraded":"2023-10-06T03:09:49.203877+0000","last_fullsized":"2023-10-06T03:09:49.203877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'489","reported_seq":501,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.504119+0000","last_change":"2023-10-06T02:59:53.297975+0000","last_active":"2023-10-06T03:09:37.504119+0000","last_peered":"2023-10-06T03:09:37.504119+0000","last_clean":"2023-10-06T03:09:37.504119+0000","last_became_active":"2023-10-06T02:59:53.297724+0000","last_became_peered":"2023-10-06T02:59:53.297724+0000","last_unstale":"2023-10-06T03:09:37.504119+0000","last_undegraded":"2023-10-06T03:09:37.504119+0000","last_fullsized":"2023-10-06T03:09:37.504119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":4283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'74","reported_seq":85,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.201472+0000","last_change":"2023-10-06T02:59:53.684667+0000","last_active":"2023-10-06T03:09:49.201472+0000","last_peered":"2023-10-06T03:09:49.201472+0000","last_clean":"2023-10-06T03:09:49.201472+0000","last_became_active":"2023-10-06T02:59:53.684378+0000","last_became_peered":"2023-10-06T02:59:53.684378+0000","last_unstale":"2023-10-06T03:09:49.201472+0000","last_undegraded":"2023-10-06T03:09:49.201472+0000","last_fullsized":"2023-10-06T03:09:49.201472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:40.914600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"26'935","reported_seq":947,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.503096+0000","last_change":"2023-10-06T02:59:53.298276+0000","last_active":"2023-10-06T03:09:37.503096+0000","last_peered":"2023-10-06T03:09:37.503096+0000","last_clean":"2023-10-06T03:09:37.503096+0000","last_became_active":"2023-10-06T02:59:53.297471+0000","last_became_peered":"2023-10-06T02:59:53.297471+0000","last_unstale":"2023-10-06T03:09:37.503096+0000","last_undegraded":"2023-10-06T03:09:37.503096+0000","last_fullsized":"2023-10-06T03:09:37.503096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":4592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'78","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204791+0000","last_change":"2023-10-06T02:59:53.679138+0000","last_active":"2023-10-06T03:09:49.204791+0000","last_peered":"2023-10-06T03:09:49.204791+0000","last_clean":"2023-10-06T03:09:49.204791+0000","last_became_active":"2023-10-06T02:59:53.678831+0000","last_became_peered":"2023-10-06T02:59:53.678831+0000","last_unstale":"2023-10-06T03:09:49.204791+0000","last_undegraded":"2023-10-06T03:09:49.204791+0000","last_fullsized":"2023-10-06T03:09:49.204791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:25.273960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"26'113","reported_seq":125,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505705+0000","last_change":"2023-10-06T02:59:53.295949+0000","last_active":"2023-10-06T03:09:37.505705+0000","last_peered":"2023-10-06T03:09:37.505705+0000","last_clean":"2023-10-06T03:09:37.505705+0000","last_became_active":"2023-10-06T02:59:53.295697+0000","last_became_peered":"2023-10-06T02:59:53.295697+0000","last_unstale":"2023-10-06T03:09:37.505705+0000","last_undegraded":"2023-10-06T03:09:37.505705+0000","last_fullsized":"2023-10-06T03:09:37.505705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'99","reported_seq":110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203834+0000","last_change":"2023-10-06T02:59:53.673079+0000","last_active":"2023-10-06T03:09:49.203834+0000","last_peered":"2023-10-06T03:09:49.203834+0000","last_clean":"2023-10-06T03:09:49.203834+0000","last_became_active":"2023-10-06T02:59:53.672629+0000","last_became_peered":"2023-10-06T02:59:53.672629+0000","last_unstale":"2023-10-06T03:09:49.203834+0000","last_undegraded":"2023-10-06T03:09:49.203834+0000","last_fullsized":"2023-10-06T03:09:49.203834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'1071","reported_seq":1083,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506322+0000","last_change":"2023-10-06T02:59:53.297170+0000","last_active":"2023-10-06T03:09:37.506322+0000","last_peered":"2023-10-06T03:09:37.506322+0000","last_clean":"2023-10-06T03:09:37.506322+0000","last_became_active":"2023-10-06T02:59:53.296843+0000","last_became_peered":"2023-10-06T02:59:53.296843+0000","last_unstale":"2023-10-06T03:09:37.506322+0000","last_undegraded":"2023-10-06T03:09:37.506322+0000","last_fullsized":"2023-10-06T03:09:37.506322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":8534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"26'89","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206154+0000","last_change":"2023-10-06T02:59:53.675030+0000","last_active":"2023-10-06T03:09:49.206154+0000","last_peered":"2023-10-06T03:09:49.206154+0000","last_clean":"2023-10-06T03:09:49.206154+0000","last_became_active":"2023-10-06T02:59:53.673662+0000","last_became_peered":"2023-10-06T02:59:53.673662+0000","last_unstale":"2023-10-06T03:09:49.206154+0000","last_undegraded":"2023-10-06T03:09:49.206154+0000","last_fullsized":"2023-10-06T03:09:49.206154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"26'537","reported_seq":549,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.501976+0000","last_change":"2023-10-06T02:59:53.299596+0000","last_active":"2023-10-06T03:09:37.501976+0000","last_peered":"2023-10-06T03:09:37.501976+0000","last_clean":"2023-10-06T03:09:37.501976+0000","last_became_active":"2023-10-06T02:59:53.298881+0000","last_became_peered":"2023-10-06T02:59:53.298881+0000","last_unstale":"2023-10-06T03:09:37.501976+0000","last_undegraded":"2023-10-06T03:09:37.501976+0000","last_fullsized":"2023-10-06T03:09:37.501976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.190231+0000","last_change":"2023-10-06T02:59:53.675391+0000","last_active":"2023-10-06T03:09:49.190231+0000","last_peered":"2023-10-06T03:09:49.190231+0000","last_clean":"2023-10-06T03:09:49.190231+0000","last_became_active":"2023-10-06T02:59:53.675092+0000","last_became_peered":"2023-10-06T02:59:53.675092+0000","last_unstale":"2023-10-06T03:09:49.190231+0000","last_undegraded":"2023-10-06T03:09:49.190231+0000","last_fullsized":"2023-10-06T03:09:49.190231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"26'552","reported_seq":564,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.173190+0000","last_change":"2023-10-06T02:59:53.294074+0000","last_active":"2023-10-06T03:08:41.173190+0000","last_peered":"2023-10-06T03:08:41.173190+0000","last_clean":"2023-10-06T03:08:41.173190+0000","last_became_active":"2023-10-06T02:59:53.293752+0000","last_became_peered":"2023-10-06T02:59:53.293752+0000","last_unstale":"2023-10-06T03:08:41.173190+0000","last_undegraded":"2023-10-06T03:08:41.173190+0000","last_fullsized":"2023-10-06T03:08:41.173190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":438,"num_write_kb":4309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":75513604,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":11546,"num_write_kb":80285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151085056,"data_stored":151027208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15189,"ondisk_log_size":15189,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574974,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314548,"kb_used_data":17260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057292,"statfs":{"total":96636764160,"available":96314667008,"internally_reserved":0,"allocated":17674240,"data_stored":17475112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.93400000000000005,"15min":0.85599999999999998},"min":{"1min":0.54000000000000004,"5min":0.497,"15min":0.41099999999999998},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.012,"15min":0.98999999999999999},"min":{"1min":0.72899999999999998,"5min":0.54500000000000004,"15min":0.48099999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.1259999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.58799999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.349,"5min":1.349,"15min":1.389},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.622,"5min":0.52600000000000002,"15min":0.38500000000000001},"max":{"1min":1.008,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.93999999999999995,"15min":0.96699999999999997},"min":{"1min":0.67900000000000005,"5min":0.59799999999999998,"15min":0.55800000000000005},"max":{"1min":1.165,"5min":1.333,"15min":1.4199999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.083,"15min":1.143},"min":{"1min":0.73499999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2450000000000001,"5min":1.3779999999999999,"15min":1.6359999999999999},"last":0.97999999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.89800000000000002,"15min":0.94799999999999995},"min":{"1min":0.64500000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0529999999999999,"5min":1.405,"15min":1.405},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.042,"15min":1.0920000000000001},"min":{"1min":0.81999999999999995,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4319999999999999,"5min":1.4590000000000001,"15min":1.7210000000000001},"last":1.1879999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.875,"15min":0.91100000000000003},"min":{"1min":0.624,"5min":0.624,"15min":0.50600000000000001},"max":{"1min":1.181,"5min":1.1859999999999999,"15min":1.3999999999999999},"last":1.012},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.0469999999999999},"min":{"1min":0.69199999999999995,"5min":0.64400000000000002,"15min":0.57499999999999996},"max":{"1min":1.1850000000000001,"5min":1.395,"15min":1.4590000000000001},"last":1.1599999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.0389999999999999,"15min":1.1539999999999999},"min":{"1min":0.66500000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.51,"5min":1.51,"15min":1.833},"last":1.236},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.018,"15min":1.0549999999999999},"min":{"1min":0.85799999999999998,"5min":0.65600000000000003,"15min":0.59199999999999997},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4990000000000001},"last":1.099}]},{"osd":6,"last update":"Fri Oct 6 03:08:49 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0669999999999999,"15min":1.119},"min":{"1min":0.80600000000000005,"5min":0.73799999999999999,"15min":0.71399999999999997},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.577},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.149,"15min":1.1899999999999999},"min":{"1min":0.94199999999999995,"5min":0.78100000000000003,"15min":0.76100000000000001},"max":{"1min":1.2949999999999999,"5min":1.5669999999999999,"15min":1.5860000000000001},"last":1.262}]}]},{"osd":6,"up_from":13,"seq":55834574973,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309848,"kb_used_data":4368,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94061992,"statfs":{"total":96636764160,"available":96319479808,"internally_reserved":0,"allocated":4472832,"data_stored":4300972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94199999999999995,"15min":1.026},"min":{"1min":0.54300000000000004,"5min":0.505,"15min":0.49099999999999999},"max":{"1min":1.1950000000000001,"5min":1.343,"15min":6.6989999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98199999999999998,"15min":1.087},"min":{"1min":0.628,"5min":0.54900000000000004,"15min":0.53200000000000003},"max":{"1min":1.302,"5min":1.302,"15min":6.9199999999999999},"last":1.194}]},{"osd":1,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.60999999999999999,"5min":0.56100000000000005,"15min":0.434},"max":{"1min":1.202,"5min":1.282,"15min":1.464},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.88800000000000001,"15min":0.89100000000000001},"min":{"1min":0.57099999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0980000000000001,"5min":1.2849999999999999,"15min":1.2949999999999999},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.89400000000000002,"15min":0.88300000000000001},"min":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.51700000000000002},"max":{"1min":1.0840000000000001,"5min":1.3009999999999999,"15min":1.498},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.91500000000000004,"15min":0.94099999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.171,"5min":1.248,"15min":1.294},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95199999999999996,"15min":0.94099999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.755},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.99299999999999999,"15min":1.012},"min":{"1min":0.69099999999999995,"5min":0.64800000000000002,"15min":0.52500000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.611},"last":1.0620000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90000000000000002,"15min":1.3149999999999999},"min":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.56000000000000005},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":17.757000000000001},"last":1.024},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.099,"15min":1.498},"min":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.536,"5min":1.536,"15min":17.382999999999999},"last":1.3080000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1,"15min":1.133},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.61599999999999999},"max":{"1min":1.3919999999999999,"5min":1.411,"15min":4.3090000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.2490000000000001},"min":{"1min":0.91700000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":4.5709999999999997},"last":1.1080000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.1419999999999999},"min":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.625,"5min":1.625,"15min":1.6990000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.1180000000000001,"15min":1.175},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4590000000000001,"5min":1.5169999999999999,"15min":1.6639999999999999},"last":1.1379999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574974,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326240,"kb_used_data":24856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94045600,"statfs":{"total":96636764160,"available":96302694400,"internally_reserved":0,"allocated":25452544,"data_stored":25273116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.878,"15min":0.88600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.40799999999999997},"max":{"1min":1.0580000000000001,"5min":1.2050000000000001,"15min":1.2849999999999999},"last":1.111},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.98899999999999999,"15min":1.01},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.54800000000000004},"max":{"1min":1.2250000000000001,"5min":1.2629999999999999,"15min":1.3089999999999999},"last":1.012}]},{"osd":1,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.874,"15min":0.89000000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.363},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.91000000000000003,"15min":0.90700000000000003},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.58999999999999997},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2689999999999999},"last":1.194}]},{"osd":2,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.876,"15min":0.90200000000000002},"min":{"1min":0.68000000000000005,"5min":0.621,"15min":0.53400000000000003},"max":{"1min":1.135,"5min":1.27,"15min":1.405},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.69299999999999995,"5min":0.59399999999999997,"15min":0.44500000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.6220000000000001},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.95999999999999996,"15min":0.95399999999999996},"min":{"1min":0.76100000000000001,"5min":0.69599999999999995,"15min":0.59599999999999997},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0580000000000001,"15min":1.048},"min":{"1min":0.84899999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.341,"5min":1.3720000000000001,"15min":1.53},"last":1.044}]},{"osd":4,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.92000000000000004,"15min":0.92300000000000004},"min":{"1min":0.66000000000000003,"5min":0.61399999999999999,"15min":0.46999999999999997},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.135,"5min":1.0800000000000001,"15min":1.069},"min":{"1min":0.88200000000000001,"5min":0.68400000000000005,"15min":0.60599999999999998},"max":{"1min":1.337,"5min":1.4930000000000001,"15min":1.657},"last":1.0840000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0720000000000001,"15min":1.0429999999999999},"min":{"1min":0.76700000000000002,"5min":0.65800000000000003,"15min":0.58399999999999996},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.167},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.093,"15min":1.077},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.441},"max":{"1min":1.536,"5min":1.538,"15min":1.538},"last":1.2569999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:08:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.153,"15min":1.1639999999999999},"min":{"1min":0.93400000000000005,"5min":0.748,"15min":0.748},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.542},"last":1.145},{"interface":"front","average":{"1min":1.244,"5min":1.222,"15min":1.2190000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.637,"5min":1.637,"15min":2.048},"last":1.2889999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335192,"kb_used_data":29712,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94036648,"statfs":{"total":96636764160,"available":96293527552,"internally_reserved":0,"allocated":30425088,"data_stored":30237520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.85399999999999998,"15min":0.83299999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0960000000000001,"5min":1.3080000000000001,"15min":1.4830000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.88600000000000001,"15min":0.92100000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.296,"5min":1.341,"15min":1.5289999999999999},"last":0.91200000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.85799999999999998,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.238,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.873,"15min":0.89300000000000002},"min":{"1min":0.58299999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.321,"5min":1.387,"15min":1.387},"last":1.036}]},{"osd":2,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96299999999999997,"15min":0.96699999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2589999999999999,"5min":1.3129999999999999,"15min":1.4159999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0249999999999999,"15min":1.016},"min":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.53700000000000003},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.0960000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94699999999999995,"15min":0.97199999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3859999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96999999999999997,"15min":1.0029999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.56200000000000006},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.97399999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93400000000000005,"15min":0.95799999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.2529999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.02,"15min":1.077},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0129999999999999,"15min":1.0609999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.61299999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0509999999999999,"15min":1.0860000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3759999999999999,"5min":1.454,"15min":1.454},"last":0.94699999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1080000000000001,"15min":1.1739999999999999},"min":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4570000000000001,"5min":1.5629999999999999,"15min":1.7629999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.171,"5min":1.151,"15min":1.21},"min":{"1min":0.753,"5min":0.753,"15min":0.56299999999999994},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.2569999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333692,"kb_used_data":28212,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94038148,"statfs":{"total":96636764160,"available":96295063552,"internally_reserved":0,"allocated":28889088,"data_stored":28711580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.244,"5min":1.2729999999999999,"15min":1.464},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76100000000000001,"15min":0.72399999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.212,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.745,"15min":0.999},"min":{"1min":0.47799999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.222,"5min":1.3049999999999999,"15min":10.970000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.85299999999999998,"15min":0.83899999999999997},"min":{"1min":0.51200000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.387,"5min":1.694,"15min":1.694},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":0.872},"min":{"1min":0.49299999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.107,"5min":1.224,"15min":1.6419999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.90800000000000003,"15min":0.93700000000000006},"min":{"1min":0.60599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.333},"last":0.79400000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98599999999999999,"15min":1.02},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3540000000000001,"5min":1.855,"15min":1.855},"last":0.75},{"interface":"front","average":{"1min":1.101,"5min":1.1000000000000001,"15min":1.1499999999999999},"min":{"1min":0.80000000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.397,"5min":1.792,"15min":2.3570000000000002},"last":1.1040000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0549999999999999,"15min":1.121},"min":{"1min":0.73499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5069999999999999,"5min":1.7410000000000001,"15min":2.218},"last":1.04},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1279999999999999,"15min":1.29},"min":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4550000000000001,"5min":1.5649999999999999,"15min":5.585},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1040000000000001,"15min":1.23},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.77000000000000002},"max":{"1min":1.431,"5min":1.9490000000000001,"15min":5.0860000000000003},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1819999999999999,"15min":1.23},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.591,"5min":1.6679999999999999,"15min":2.3069999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2250000000000001,"15min":1.3600000000000001},"min":{"1min":0.84599999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":5.6239999999999997},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1930000000000001,"15min":1.2909999999999999},"min":{"1min":0.73699999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.482,"5min":2.0950000000000002,"15min":5.1310000000000002},"last":0.91600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313944,"kb_used_data":8464,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94057896,"statfs":{"total":96636764160,"available":96315285504,"internally_reserved":0,"allocated":8667136,"data_stored":8495276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.70899999999999996},"min":{"1min":0.52200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89700000000000002,"5min":1.038,"15min":1.4019999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.746,"15min":0.76300000000000001},"min":{"1min":0.41399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.073,"5min":1.323,"15min":1.8799999999999999},"last":0.81299999999999994}]},{"osd":1,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72199999999999998,"15min":0.73099999999999998},"min":{"1min":0.49299999999999999,"5min":0.375,"15min":0.33300000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83199999999999996,"15min":0.83799999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1719999999999999,"5min":1.252,"15min":1.341},"last":1.1180000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84899999999999998,"15min":0.873},"min":{"1min":0.622,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.875},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.90800000000000003,"15min":0.97899999999999998},"min":{"1min":0.624,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.296,"5min":1.329,"15min":1.587},"last":1.0249999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.96799999999999997,"15min":1.03},"min":{"1min":0.68300000000000005,"5min":0.63900000000000001,"15min":0.56999999999999995},"max":{"1min":1.238,"5min":1.3520000000000001,"15min":1.6779999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.048,"15min":1.109},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4470000000000001,"5min":1.6419999999999999,"15min":1.9350000000000001},"last":0.98299999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0960000000000001,"15min":1.143},"min":{"1min":0.81899999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.1200000000000001},"min":{"1min":0.68300000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3919999999999999,"5min":1.458,"15min":2.048},"last":0.95599999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.149,"15min":1.204},"min":{"1min":0.70499999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.593,"5min":1.6379999999999999,"15min":2.7040000000000002},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.1990000000000001,"15min":1.2490000000000001},"min":{"1min":0.95699999999999996,"5min":0.82499999999999996,"15min":0.68200000000000005},"max":{"1min":1.619,"5min":1.619,"15min":2.2000000000000002},"last":1.282}]},{"osd":7,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1639999999999999,"15min":1.2330000000000001},"min":{"1min":0.73899999999999999,"5min":0.71499999999999997,"15min":0.70999999999999996},"max":{"1min":1.54,"5min":1.633,"15min":2.286},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.2290000000000001,"15min":1.302},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.669,"5min":1.669,"15min":2.3940000000000001},"last":1.1870000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574973,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313944,"kb_used_data":16656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057896,"statfs":{"total":96636764160,"available":96315285504,"internally_reserved":0,"allocated":17055744,"data_stored":16883884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.70099999999999996,"15min":0.68600000000000005},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.23599999999999999},"max":{"1min":1.016,"5min":1.179,"15min":1.179},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.82099999999999995,"15min":0.79800000000000004},"min":{"1min":0.52900000000000003,"5min":0.42299999999999999,"15min":0.39300000000000002},"max":{"1min":1.077,"5min":1.218,"15min":1.3089999999999999},"last":0.99399999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84199999999999997,"15min":0.85999999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36599999999999999},"max":{"1min":1.246,"5min":1.3109999999999999,"15min":1.3169999999999999},"last":1.0329999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.875},"min":{"1min":0.5,"5min":0.5,"15min":0.42299999999999999},"max":{"1min":1.1399999999999999,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83199999999999996,"15min":0.85099999999999998},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.133,"5min":1.2270000000000001,"15min":1.337},"last":0.877}]},{"osd":4,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.95899999999999996,"15min":0.97999999999999998},"min":{"1min":0.66900000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.212,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.115,"15min":1.0980000000000001},"min":{"1min":0.67200000000000004,"5min":0.63800000000000001,"15min":0.437},"max":{"1min":1.556,"5min":1.556,"15min":1.6060000000000001},"last":1.3300000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.075,"15min":1.075},"min":{"1min":0.70399999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4410000000000001,"5min":1.587,"15min":1.587},"last":1.28},{"interface":"front","average":{"1min":1.034,"5min":1.0760000000000001,"15min":1.073},"min":{"1min":0.80500000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.569,"5min":1.911,"15min":1.911},"last":1.244}]},{"osd":6,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1479999999999999,"15min":1.1499999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.70499999999999996},"max":{"1min":1.5049999999999999,"5min":2.081,"15min":2.081},"last":1.532},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1479999999999999,"15min":1.1639999999999999},"min":{"1min":0.72799999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4710000000000001,"5min":1.996,"15min":1.996},"last":1.367}]},{"osd":7,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2050000000000001,"15min":1.1970000000000001},"min":{"1min":0.81000000000000005,"5min":0.71499999999999997,"15min":0.498},"max":{"1min":1.5009999999999999,"5min":1.6879999999999999,"15min":1.8999999999999999},"last":1.466},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.218,"15min":1.2250000000000001},"min":{"1min":0.78900000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.536,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.4350000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322736,"kb_used_data":21352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94049104,"statfs":{"total":96636764160,"available":96306282496,"internally_reserved":0,"allocated":21864448,"data_stored":21683828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70399999999999996,"15min":0.67600000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26900000000000002},"max":{"1min":1.224,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.34899999999999998},"max":{"1min":1.1659999999999999,"5min":1.2709999999999999,"15min":1.2849999999999999},"last":0.80000000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.177,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.40200000000000002},"max":{"1min":0.93700000000000006,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.75800000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82899999999999996,"15min":0.80900000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4019999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.085},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.91600000000000004,"15min":0.93000000000000005},"min":{"1min":0.55500000000000005,"5min":0.46800000000000003,"15min":0.34599999999999997},"max":{"1min":1.327,"5min":1.3580000000000001,"15min":1.599},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.94099999999999995,"15min":0.95499999999999996},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.52},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.117,"15min":1.105},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.8280000000000001,"5min":1.859,"15min":1.859},"last":1.1890000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.135,"15min":1.141},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.161,"5min":1.165,"15min":1.159},"min":{"1min":0.872,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.542,"5min":1.573,"15min":1.573},"last":1.1220000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1759999999999999,"15min":1.1739999999999999},"min":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4930000000000001,"5min":1.6359999999999999,"15min":1.7050000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1080000000000001,"15min":1.111},"min":{"1min":0.68500000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.274,"5min":1.579,"15min":2.1579999999999999},"last":1.149}]},{"osd":7,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1579999999999999,"15min":1.1599999999999999},"min":{"1min":0.72699999999999998,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.413,"5min":1.7090000000000001,"15min":2.2480000000000002},"last":1.224},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.0049999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.248}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20992000,"data_stored":20986792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28610560,"data_stored":28604912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30146560,"data_stored":30130852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16801792,"data_stored":16778076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:09:57.171 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:09:57.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.273+0000 7feac21a0700 1 Processor -- start 2023-10-06T03:09:57.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.273+0000 7feac21a0700 1 -- start start 2023-10-06T03:09:57.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.273+0000 7feac21a0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feabc0be150 0x7feabc06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:57.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.273+0000 7feac21a0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feabc0b5520 0x7feabc0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:57.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.273+0000 7feac21a0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feabc0a2310 con 0x7feabc0b5ec0 2023-10-06T03:09:57.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.273+0000 7feac21a0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc06d0f0 con 0x7feabc0b5520 2023-10-06T03:09:57.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.273+0000 7feac21a0700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0a2680 con 0x7feabc0be150 2023-10-06T03:09:57.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.273+0000 7feac099d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feabc0b5520 0x7feabc0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:57.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.273+0000 7feac199f700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7feabc0b5ec0 0x7feabc06b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.27:41498/0 (socket says 172.21.15.27:41498) 2023-10-06T03:09:57.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.273+0000 7feac099d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feabc0b5520 0x7feabc0b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50810/0 (socket says 172.21.15.27:50810) 2023-10-06T03:09:57.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.273+0000 7feac199f700 1 -- 172.21.15.27:0/2990392426 learned_addr learned my addr 172.21.15.27:0/2990392426 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:09:57.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.273+0000 7feac119e700 1 --2- 172.21.15.27:0/2990392426 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feabc0be150 0x7feabc06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:57.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.273+0000 7feabbfff700 1 -- 172.21.15.27:0/2990392426 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448723752 0 0) 0x7feabc0a2310 con 0x7feabc0b5ec0 2023-10-06T03:09:57.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac099d700 1 -- 172.21.15.27:0/2990392426 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feabc0be150 msgr2=0x7feabc06cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:09:57.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac099d700 1 --2- 172.21.15.27:0/2990392426 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feabc0be150 0x7feabc06cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac099d700 1 -- 172.21.15.27:0/2990392426 >> v1:172.21.15.123:6789/0 conn(0x7feabc0b5ec0 legacy=0x7feabc06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:57.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac099d700 1 -- 172.21.15.27:0/2990392426 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc0bd1d0 con 0x7feabc0b5520 2023-10-06T03:09:57.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac119e700 1 --2- 172.21.15.27:0/2990392426 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feabc0be150 0x7feabc06cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:09:57.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac099d700 1 --2- 172.21.15.27:0/2990392426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feabc0b5520 0x7feabc0b5980 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feab00098e0 tx=0x7feab00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119a2c0cfb1bb677 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:57.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feabbfff700 1 -- 172.21.15.27:0/2990392426 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab000b640 con 0x7feabc0b5520 2023-10-06T03:09:57.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feabbfff700 1 -- 172.21.15.27:0/2990392426 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab000b7a0 con 0x7feabc0b5520 2023-10-06T03:09:57.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feabbfff700 1 -- 172.21.15.27:0/2990392426 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab000bb40 con 0x7feabc0b5520 2023-10-06T03:09:57.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac21a0700 1 -- 172.21.15.27:0/2990392426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feabc0b5520 msgr2=0x7feabc0b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:57.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac21a0700 1 --2- 172.21.15.27:0/2990392426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feabc0b5520 0x7feabc0b5980 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feab00098e0 tx=0x7feab00091a0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac21a0700 1 -- 172.21.15.27:0/2990392426 shutdown_connections 2023-10-06T03:09:57.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac21a0700 1 --2- 172.21.15.27:0/2990392426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feabc0b5520 0x7feabc0b5980 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac21a0700 1 --2- 172.21.15.27:0/2990392426 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feabc0be150 0x7feabc06cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac21a0700 1 -- 172.21.15.27:0/2990392426 >> 172.21.15.27:0/2990392426 conn(0x7feabc0bf440 msgr2=0x7feabc06df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:57.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac21a0700 1 -- 172.21.15.27:0/2990392426 shutdown_connections 2023-10-06T03:09:57.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac21a0700 1 -- 172.21.15.27:0/2990392426 wait complete. 2023-10-06T03:09:57.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac21a0700 1 Processor -- start 2023-10-06T03:09:57.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac21a0700 1 -- start start 2023-10-06T03:09:57.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.277+0000 7feac21a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feabc0b5520 0x7feabc0b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:57.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac21a0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feabc0b5ec0 0x7feabc14abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:57.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac21a0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feabc0be150 0x7feabc14b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:57.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac21a0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0ba170 con 0x7feabc0b5ec0 2023-10-06T03:09:57.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac21a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0a4cb0 con 0x7feabc0b5520 2023-10-06T03:09:57.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac21a0700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0a6a40 con 0x7feabc0be150 2023-10-06T03:09:57.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac099d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feabc0b5ec0 0x7feabc14abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:57.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac199f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feabc0be150 0x7feabc14b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:57.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac099d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feabc0b5ec0 0x7feabc14abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50814/0 (socket says 172.21.15.27:50814) 2023-10-06T03:09:57.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac119e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feabc0b5520 0x7feabc0b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:57.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac099d700 1 -- 172.21.15.27:0/2680230968 learned_addr learned my addr 172.21.15.27:0/2680230968 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:57.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac199f700 1 -- 172.21.15.27:0/2680230968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feabc0b5520 msgr2=0x7feabc0b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:57.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac199f700 1 --2- 172.21.15.27:0/2680230968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feabc0b5520 0x7feabc0b7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac199f700 1 -- 172.21.15.27:0/2680230968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feabc0b5ec0 msgr2=0x7feabc14abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:57.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac199f700 1 --2- 172.21.15.27:0/2680230968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feabc0b5ec0 0x7feabc14abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac199f700 1 -- 172.21.15.27:0/2680230968 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac009a20 con 0x7feabc0be150 2023-10-06T03:09:57.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac199f700 1 --2- 172.21.15.27:0/2680230968 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feabc0be150 0x7feabc14b0f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feab400c5b0 tx=0x7feab4007cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:57.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feab97fa700 1 -- 172.21.15.27:0/2680230968 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4005b30 con 0x7feabc0be150 2023-10-06T03:09:57.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feab97fa700 1 -- 172.21.15.27:0/2680230968 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab4005cf0 con 0x7feabc0be150 2023-10-06T03:09:57.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac21a0700 1 -- 172.21.15.27:0/2680230968 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab0009420 con 0x7feabc0be150 2023-10-06T03:09:57.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feab97fa700 1 -- 172.21.15.27:0/2680230968 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4007320 con 0x7feabc0be150 2023-10-06T03:09:57.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac21a0700 1 -- 172.21.15.27:0/2680230968 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feabc15f5c0 con 0x7feabc0be150 2023-10-06T03:09:57.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feac21a0700 1 -- 172.21.15.27:0/2680230968 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feabc04be40 con 0x7feabc0be150 2023-10-06T03:09:57.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.281+0000 7feab97fa700 1 -- 172.21.15.27:0/2680230968 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7feab401b3b0 con 0x7feabc0be150 2023-10-06T03:09:57.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.285+0000 7feab97fa700 1 --2- 172.21.15.27:0/2680230968 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7feaa8060550 0x7feaa8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:57.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.285+0000 7feab97fa700 1 -- 172.21.15.27:0/2680230968 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7feab407bd80 con 0x7feabc0be150 2023-10-06T03:09:57.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.285+0000 7feac119e700 1 --2- 172.21.15.27:0/2680230968 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7feaa8060550 0x7feaa8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:57.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.285+0000 7feac119e700 1 --2- 172.21.15.27:0/2680230968 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7feaa8060550 0x7feaa8062a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feaac009fd0 tx=0x7feaac00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:57.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.293+0000 7feab97fa700 1 -- 172.21.15.27:0/2680230968 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7feab404c130 con 0x7feabc0be150 2023-10-06T03:09:57.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.457+0000 7feac21a0700 1 -- 172.21.15.27:0/2680230968 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feabc0a4df0 con 0x7feabc0be150 2023-10-06T03:09:57.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.457+0000 7feab97fa700 1 -- 172.21.15.27:0/2680230968 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16961 (secure 0 0 0) 0x7feab4005e60 con 0x7feabc0be150 2023-10-06T03:09:57.461 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:09:57.461 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":26,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T03:00:34.725027+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:59:47.570918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:51.949130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:52.638817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:09:57.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.461+0000 7feac21a0700 1 -- 172.21.15.27:0/2680230968 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7feaa8060550 msgr2=0x7feaa8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:57.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.461+0000 7feac21a0700 1 --2- 172.21.15.27:0/2680230968 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7feaa8060550 0x7feaa8062a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feaac009fd0 tx=0x7feaac00b040 comp rx=0 tx=0).stop 2023-10-06T03:09:57.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.461+0000 7feac21a0700 1 -- 172.21.15.27:0/2680230968 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feabc0be150 msgr2=0x7feabc14b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:57.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.461+0000 7feac21a0700 1 --2- 172.21.15.27:0/2680230968 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feabc0be150 0x7feabc14b0f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feab400c5b0 tx=0x7feab4007cb0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.461+0000 7feac21a0700 1 -- 172.21.15.27:0/2680230968 shutdown_connections 2023-10-06T03:09:57.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.461+0000 7feac21a0700 1 --2- 172.21.15.27:0/2680230968 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7feaa8060550 0x7feaa8062a00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.461+0000 7feac21a0700 1 --2- 172.21.15.27:0/2680230968 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feabc0be150 0x7feabc14b0f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.461+0000 7feac21a0700 1 --2- 172.21.15.27:0/2680230968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feabc0b5ec0 0x7feabc14abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.461+0000 7feac21a0700 1 --2- 172.21.15.27:0/2680230968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feabc0b5520 0x7feabc0b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:57.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.461+0000 7feac21a0700 1 -- 172.21.15.27:0/2680230968 >> 172.21.15.27:0/2680230968 conn(0x7feabc0bf440 msgr2=0x7feabc151910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:57.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.461+0000 7feac21a0700 1 -- 172.21.15.27:0/2680230968 shutdown_connections 2023-10-06T03:09:57.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:57.461+0000 7feac21a0700 1 -- 172.21.15.27:0/2680230968 wait complete. 2023-10-06T03:09:58.476 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T03:09:58.476 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:09:58.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.601+0000 7fab45989700 1 Processor -- start 2023-10-06T03:09:58.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.601+0000 7fab45989700 1 -- start start 2023-10-06T03:09:58.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45989700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab400a3c20 0x7fab400a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:58.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45989700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fab400be530 0x7fab4006ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:58.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45989700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab400bd2e0 con 0x7fab400b5520 2023-10-06T03:09:58.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45989700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab400a7970 con 0x7fab400be530 2023-10-06T03:09:58.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45989700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab400a4700 con 0x7fab400a3c20 2023-10-06T03:09:58.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab3ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fab400be530 0x7fab4006ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:58.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab3ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fab400be530 0x7fab4006ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41214/0 (socket says 172.21.15.27:41214) 2023-10-06T03:09:58.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab3ffff700 1 -- 172.21.15.27:0/602839221 learned_addr learned my addr 172.21.15.27:0/602839221 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:58.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45188700 1 --1- 172.21.15.27:0/602839221 >> v1:172.21.15.27:6789/0 conn(0x7fab400b5520 0x7fab400a3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54690/0 (socket says 172.21.15.27:54690) 2023-10-06T03:09:58.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab44987700 1 --2- 172.21.15.27:0/602839221 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab400a3c20 0x7fab400a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:58.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab3ffff700 1 -- 172.21.15.27:0/602839221 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab400a3c20 msgr2=0x7fab400a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:09:58.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab3ffff700 1 --2- 172.21.15.27:0/602839221 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab400a3c20 0x7fab400a4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab3ffff700 1 -- 172.21.15.27:0/602839221 >> v1:172.21.15.27:6789/0 conn(0x7fab400b5520 legacy=0x7fab400a3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab3ffff700 1 -- 172.21.15.27:0/602839221 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab400bd530 con 0x7fab400be530 2023-10-06T03:09:58.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab3ffff700 1 --2- 172.21.15.27:0/602839221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab400be530 0x7fab4006ca10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab300099b0 tx=0x7fab30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38947b29d5f2d57a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:58.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab3f7fe700 1 -- 172.21.15.27:0/602839221 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3000b860 con 0x7fab400be530 2023-10-06T03:09:58.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab3f7fe700 1 -- 172.21.15.27:0/602839221 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3000b9c0 con 0x7fab400be530 2023-10-06T03:09:58.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab3f7fe700 1 -- 172.21.15.27:0/602839221 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3000bd60 con 0x7fab400be530 2023-10-06T03:09:58.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45989700 1 -- 172.21.15.27:0/602839221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab400be530 msgr2=0x7fab4006ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45989700 1 --2- 172.21.15.27:0/602839221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab400be530 0x7fab4006ca10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab300099b0 tx=0x7fab30009250 comp rx=0 tx=0).stop 2023-10-06T03:09:58.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45989700 1 -- 172.21.15.27:0/602839221 shutdown_connections 2023-10-06T03:09:58.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45989700 1 --2- 172.21.15.27:0/602839221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab400be530 0x7fab4006ca10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45989700 1 --2- 172.21.15.27:0/602839221 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab400a3c20 0x7fab400a4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45989700 1 -- 172.21.15.27:0/602839221 >> 172.21.15.27:0/602839221 conn(0x7fab400bf440 msgr2=0x7fab4006df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:58.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45989700 1 -- 172.21.15.27:0/602839221 shutdown_connections 2023-10-06T03:09:58.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.605+0000 7fab45989700 1 -- 172.21.15.27:0/602839221 wait complete. 2023-10-06T03:09:58.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45989700 1 Processor -- start 2023-10-06T03:09:58.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45989700 1 -- start start 2023-10-06T03:09:58.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45989700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab400a3c20 0x7fab4015c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:58.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45989700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab400b5520 0x7fab400b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:58.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45989700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab400baf10 0x7fab4015ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:58.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45989700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab400b9400 con 0x7fab400baf10 2023-10-06T03:09:58.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45989700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab400b8be0 con 0x7fab400a3c20 2023-10-06T03:09:58.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45989700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4015c6d0 con 0x7fab400b5520 2023-10-06T03:09:58.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45188700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab400baf10 0x7fab4015ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:58.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45188700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab400baf10 0x7fab4015ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41230/0 (socket says 172.21.15.27:41230) 2023-10-06T03:09:58.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45188700 1 -- 172.21.15.27:0/605323908 learned_addr learned my addr 172.21.15.27:0/605323908 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:58.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab3ffff700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab400b5520 0x7fab400b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:58.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab44987700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab400a3c20 0x7fab4015c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:58.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45188700 1 -- 172.21.15.27:0/605323908 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab400b5520 msgr2=0x7fab400b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45188700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab400b5520 0x7fab400b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.609+0000 7fab45188700 1 -- 172.21.15.27:0/605323908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab400a3c20 msgr2=0x7fab4015c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab45188700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab400a3c20 0x7fab4015c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab45188700 1 -- 172.21.15.27:0/605323908 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab300094f0 con 0x7fab400baf10 2023-10-06T03:09:58.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab45188700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab400baf10 0x7fab4015ed10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fab3800cd30 tx=0x7fab38001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:58.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab3cff9700 1 -- 172.21.15.27:0/605323908 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3800ce30 con 0x7fab400baf10 2023-10-06T03:09:58.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab3cff9700 1 -- 172.21.15.27:0/605323908 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab38005df0 con 0x7fab400baf10 2023-10-06T03:09:58.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab3cff9700 1 -- 172.21.15.27:0/605323908 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3800ab00 con 0x7fab400baf10 2023-10-06T03:09:58.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab45989700 1 -- 172.21.15.27:0/605323908 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab400b9090 con 0x7fab400baf10 2023-10-06T03:09:58.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab45989700 1 -- 172.21.15.27:0/605323908 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab400b6090 con 0x7fab400baf10 2023-10-06T03:09:58.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab45989700 1 -- 172.21.15.27:0/605323908 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab400b7d80 con 0x7fab400baf10 2023-10-06T03:09:58.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab3cff9700 1 -- 172.21.15.27:0/605323908 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fab380070f0 con 0x7fab400baf10 2023-10-06T03:09:58.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab3cff9700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fab20060550 0x7fab20062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:58.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab3cff9700 1 -- 172.21.15.27:0/605323908 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fab3807ca40 con 0x7fab400baf10 2023-10-06T03:09:58.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab44987700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fab20060550 0x7fab20062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:58.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab3cff9700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] conn(0x7fab20068ec0 0x7fab2006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:58.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab3cff9700 1 -- 172.21.15.27:0/605323908 --> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab2006b9c0 con 0x7fab20068ec0 2023-10-06T03:09:58.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.613+0000 7fab3cff9700 1 -- 172.21.15.27:0/605323908 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab38081220 con 0x7fab400baf10 2023-10-06T03:09:58.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.617+0000 7fab3ffff700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] conn(0x7fab20068ec0 0x7fab2006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:58.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.617+0000 7fab44987700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fab20060550 0x7fab20062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fab28006fd0 tx=0x7fab28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:58.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.617+0000 7fab3ffff700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] conn(0x7fab20068ec0 0x7fab2006b2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:58.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.617+0000 7fab3cff9700 1 -- 172.21.15.27:0/605323908 <== osd.0 v2:172.21.15.27:6824/33281 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fab2006b9c0 con 0x7fab20068ec0 2023-10-06T03:09:58.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.637+0000 7fab45989700 1 -- 172.21.15.27:0/605323908 --> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fab4004be40 con 0x7fab20068ec0 2023-10-06T03:09:58.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.637+0000 7fab3cff9700 1 -- 172.21.15.27:0/605323908 <== osd.0 v2:172.21.15.27:6824/33281 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fab4004be40 con 0x7fab20068ec0 2023-10-06T03:09:58.638 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-06T03:09:58.638 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:09:58.638 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-06T03:09:58.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.637+0000 7fab45989700 1 -- 172.21.15.27:0/605323908 >> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] conn(0x7fab20068ec0 msgr2=0x7fab2006b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.637+0000 7fab45989700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.27:6824/33281,v1:172.21.15.27:6825/33281] conn(0x7fab20068ec0 0x7fab2006b2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.637+0000 7fab45989700 1 -- 172.21.15.27:0/605323908 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fab20060550 msgr2=0x7fab20062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.637+0000 7fab45989700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fab20060550 0x7fab20062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fab28006fd0 tx=0x7fab28008040 comp rx=0 tx=0).stop 2023-10-06T03:09:58.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.637+0000 7fab45989700 1 -- 172.21.15.27:0/605323908 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab400baf10 msgr2=0x7fab4015ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.637+0000 7fab45989700 1 --2- 172.21.15.27:0/605323908 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab400baf10 0x7fab4015ed10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fab3800cd30 tx=0x7fab38001ab0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.637+0000 7fab45188700 1 -- 172.21.15.27:0/605323908 reap_dead start 2023-10-06T03:09:58.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.637+0000 7fab45989700 1 -- 172.21.15.27:0/605323908 shutdown_connections 2023-10-06T03:09:58.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.637+0000 7fab45989700 1 -- 172.21.15.27:0/605323908 >> 172.21.15.27:0/605323908 conn(0x7fab400bf440 msgr2=0x7fab400bfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:58.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.637+0000 7fab45989700 1 -- 172.21.15.27:0/605323908 shutdown_connections 2023-10-06T03:09:58.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.637+0000 7fab45989700 1 -- 172.21.15.27:0/605323908 wait complete. 2023-10-06T03:09:58.651 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T03:09:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23e1cbb700 1 Processor -- start 2023-10-06T03:09:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23e1cbb700 1 -- start start 2023-10-06T03:09:58.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23e1cbb700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23dc0a4760 0x7f23dc14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:58.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23e1cbb700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc0a18e0 con 0x7f23dc0b7f40 2023-10-06T03:09:58.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23e1cbb700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc14f970 con 0x7f23dc14aed0 2023-10-06T03:09:58.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23e1cbb700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0bdbb0 con 0x7f23dc0a4760 2023-10-06T03:09:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23e14ba700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f23dc0b7f40 0x7f23dc14c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54700/0 (socket says 172.21.15.27:54700) 2023-10-06T03:09:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23e14ba700 1 -- 172.21.15.27:0/207877839 learned_addr learned my addr 172.21.15.27:0/207877839 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:09:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23dbfff700 1 --2- 172.21.15.27:0/207877839 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23dc0a4760 0x7f23dc14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23db7fe700 1 -- 172.21.15.27:0/207877839 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791312737 0 0) 0x7f23dc0a18e0 con 0x7f23dc0b7f40 2023-10-06T03:09:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23db7fe700 1 -- 172.21.15.27:0/207877839 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23cc003570 con 0x7f23dc0b7f40 2023-10-06T03:09:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23db7fe700 1 -- 172.21.15.27:0/207877839 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008419866 0 0) 0x7f23dc14f970 con 0x7f23dc14aed0 2023-10-06T03:09:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23db7fe700 1 -- 172.21.15.27:0/207877839 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23dc0a18e0 con 0x7f23dc14aed0 2023-10-06T03:09:58.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23dbfff700 1 -- 172.21.15.27:0/207877839 >> v1:172.21.15.123:6789/0 conn(0x7f23dc14aed0 legacy=0x7f23dc06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23db7fe700 1 -- 172.21.15.27:0/207877839 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1801413657 0 0) 0x7f23cc003570 con 0x7f23dc0b7f40 2023-10-06T03:09:58.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23dbfff700 1 -- 172.21.15.27:0/207877839 >> v1:172.21.15.27:6789/0 conn(0x7f23dc0b7f40 legacy=0x7f23dc14c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23dbfff700 1 -- 172.21.15.27:0/207877839 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc14c950 con 0x7f23dc0a4760 2023-10-06T03:09:58.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23dbfff700 1 --2- 172.21.15.27:0/207877839 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23dc0a4760 0x7f23dc14b2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009910 tx=0x7f23c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45acae3d0114e2b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:58.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23db7fe700 1 -- 172.21.15.27:0/207877839 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d40017f0 con 0x7f23dc0a4760 2023-10-06T03:09:58.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23db7fe700 1 -- 172.21.15.27:0/207877839 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c8011420 con 0x7f23dc0a4760 2023-10-06T03:09:58.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.769+0000 7f23db7fe700 1 -- 172.21.15.27:0/207877839 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80117c0 con 0x7f23dc0a4760 2023-10-06T03:09:58.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 -- 172.21.15.27:0/207877839 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23dc0a4760 msgr2=0x7f23dc14b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 --2- 172.21.15.27:0/207877839 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23dc0a4760 0x7f23dc14b2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009910 tx=0x7f23c80091a0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 -- 172.21.15.27:0/207877839 shutdown_connections 2023-10-06T03:09:58.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 --2- 172.21.15.27:0/207877839 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23dc0a4760 0x7f23dc14b2a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 -- 172.21.15.27:0/207877839 >> 172.21.15.27:0/207877839 conn(0x7f23dc0beae0 msgr2=0x7f23dc0beee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:58.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 -- 172.21.15.27:0/207877839 shutdown_connections 2023-10-06T03:09:58.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 -- 172.21.15.27:0/207877839 wait complete. 2023-10-06T03:09:58.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 Processor -- start 2023-10-06T03:09:58.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 -- start start 2023-10-06T03:09:58.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23dc0a4760 0x7f23dc15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:58.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23dc0b7f40 0x7f23dc0a2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23dc14aed0 0x7f23dc15bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0b8830 con 0x7f23dc0a4760 2023-10-06T03:09:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0a59d0 con 0x7f23dc14aed0 2023-10-06T03:09:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e1cbb700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0bade0 con 0x7f23dc0b7f40 2023-10-06T03:09:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e0cb9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23dc0a4760 0x7f23dc15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e0cb9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23dc0a4760 0x7f23dc15b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41236/0 (socket says 172.21.15.27:41236) 2023-10-06T03:09:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e0cb9700 1 -- 172.21.15.27:0/3777846624 learned_addr learned my addr 172.21.15.27:0/3777846624 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.773+0000 7f23e14ba700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23dc14aed0 0x7f23dc15bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23dbfff700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23dc0b7f40 0x7f23dc0a2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23e14ba700 1 -- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23dc0b7f40 msgr2=0x7f23dc0a2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23e14ba700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23dc0b7f40 0x7f23dc0a2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23e14ba700 1 -- 172.21.15.27:0/3777846624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23dc0a4760 msgr2=0x7f23dc15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23e14ba700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23dc0a4760 0x7f23dc15b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23e14ba700 1 -- 172.21.15.27:0/3777846624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8009420 con 0x7f23dc14aed0 2023-10-06T03:09:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23dbfff700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23dc0b7f40 0x7f23dc0a2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:09:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23e0cb9700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23dc0a4760 0x7f23dc15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:09:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23e14ba700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23dc14aed0 0x7f23dc15bc80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f23d4001560 tx=0x7f23d4007c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:58.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23d8ff9700 1 -- 172.21.15.27:0/3777846624 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4004dc0 con 0x7f23dc14aed0 2023-10-06T03:09:58.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23e1cbb700 1 -- 172.21.15.27:0/3777846624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23dc0bb0c0 con 0x7f23dc14aed0 2023-10-06T03:09:58.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23d8ff9700 1 -- 172.21.15.27:0/3777846624 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d4007150 con 0x7f23dc14aed0 2023-10-06T03:09:58.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23d8ff9700 1 -- 172.21.15.27:0/3777846624 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4007510 con 0x7f23dc14aed0 2023-10-06T03:09:58.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23e1cbb700 1 -- 172.21.15.27:0/3777846624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc0a3430 con 0x7f23dc14aed0 2023-10-06T03:09:58.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.777+0000 7f23e1cbb700 1 -- 172.21.15.27:0/3777846624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23dc0a3680 con 0x7f23dc14aed0 2023-10-06T03:09:58.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.781+0000 7f23d8ff9700 1 -- 172.21.15.27:0/3777846624 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f23d4007900 con 0x7f23dc14aed0 2023-10-06T03:09:58.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.781+0000 7f23d8ff9700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f23c0060550 0x7f23c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:58.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.781+0000 7f23d8ff9700 1 -- 172.21.15.27:0/3777846624 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f23d407bf10 con 0x7f23dc14aed0 2023-10-06T03:09:58.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.781+0000 7f23e0cb9700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f23c0060550 0x7f23c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:58.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.781+0000 7f23e0cb9700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f23c0060550 0x7f23c0062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f23d0001010 tx=0x7f23d0007ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:58.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.789+0000 7f23d8ff9700 1 -- 172.21.15.27:0/3777846624 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f23d404c360 con 0x7f23dc14aed0 2023-10-06T03:09:58.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.957+0000 7f23e1cbb700 1 -- 172.21.15.27:0/3777846624 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f23dc0a5b10 con 0x7f23c0060550 2023-10-06T03:09:58.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.957+0000 7f23d8ff9700 1 -- 172.21.15.27:0/3777846624 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f23dc0a5b10 con 0x7f23c0060550 2023-10-06T03:09:58.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.961+0000 7f23e1cbb700 1 -- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f23c0060550 msgr2=0x7f23c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.961+0000 7f23e1cbb700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f23c0060550 0x7f23c0062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f23d0001010 tx=0x7f23d0007ea0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.961+0000 7f23e1cbb700 1 -- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23dc14aed0 msgr2=0x7f23dc15bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:58.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.961+0000 7f23e1cbb700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23dc14aed0 0x7f23dc15bc80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f23d4001560 tx=0x7f23d4007c70 comp rx=0 tx=0).stop 2023-10-06T03:09:58.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.961+0000 7f23e1cbb700 1 -- 172.21.15.27:0/3777846624 shutdown_connections 2023-10-06T03:09:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.961+0000 7f23e1cbb700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f23c0060550 0x7f23c0062a00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.961+0000 7f23e1cbb700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23dc14aed0 0x7f23dc15bc80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.961+0000 7f23e1cbb700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23dc0b7f40 0x7f23dc0a2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.961+0000 7f23e1cbb700 1 --2- 172.21.15.27:0/3777846624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23dc0a4760 0x7f23dc15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.961+0000 7f23e1cbb700 1 -- 172.21.15.27:0/3777846624 >> 172.21.15.27:0/3777846624 conn(0x7f23dc0beae0 msgr2=0x7f23dc06b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.961+0000 7f23e1cbb700 1 -- 172.21.15.27:0/3777846624 shutdown_connections 2023-10-06T03:09:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:58.961+0000 7f23e1cbb700 1 -- 172.21.15.27:0/3777846624 wait complete. 2023-10-06T03:09:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T03:09:58.974 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T03:09:58.974 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:09:59.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.081+0000 7f879759e700 1 Processor -- start 2023-10-06T03:09:59.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.081+0000 7f879759e700 1 -- start start 2023-10-06T03:09:59.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.081+0000 7f879759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8798147980 0x7f87980a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.081+0000 7f879759e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f879809cee0 0x7f8798147d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.081+0000 7f879759e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8798149030 con 0x7f87980a36d0 2023-10-06T03:09:59.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.081+0000 7f879759e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8798149310 con 0x7f879809cee0 2023-10-06T03:09:59.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.081+0000 7f879759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87980a3190 con 0x7f8798147980 2023-10-06T03:09:59.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.081+0000 7f8795d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f879809cee0 0x7f8798147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.081+0000 7f8795d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f879809cee0 0x7f8798147d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41238/0 (socket says 172.21.15.27:41238) 2023-10-06T03:09:59.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.081+0000 7f8795d9b700 1 -- 172.21.15.27:0/1282982255 learned_addr learned my addr 172.21.15.27:0/1282982255 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:59.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.081+0000 7f879659c700 1 --2- 172.21.15.27:0/1282982255 >> v2:172.21.15.123:3300/0 conn(0x7f8798147980 0x7f87980a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f8795d9b700 1 -- 172.21.15.27:0/1282982255 >> v2:172.21.15.123:3300/0 conn(0x7f8798147980 msgr2=0x7f87980a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:09:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f8795d9b700 1 --2- 172.21.15.27:0/1282982255 >> v2:172.21.15.123:3300/0 conn(0x7f8798147980 0x7f87980a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f8795d9b700 1 -- 172.21.15.27:0/1282982255 >> v1:172.21.15.123:6789/0 conn(0x7f87980a36d0 legacy=0x7f879806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f8795d9b700 1 -- 172.21.15.27:0/1282982255 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879806d020 con 0x7f879809cee0 2023-10-06T03:09:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f8795d9b700 1 --2- 172.21.15.27:0/1282982255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f879809cee0 0x7f8798147d50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f879806dcf0 tx=0x7f8788009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc6eca4dc9cac1e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f879559a700 1 -- 172.21.15.27:0/1282982255 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800e070 con 0x7f879809cee0 2023-10-06T03:09:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f879559a700 1 -- 172.21.15.27:0/1282982255 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878800ba50 con 0x7f879809cee0 2023-10-06T03:09:59.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f879559a700 1 -- 172.21.15.27:0/1282982255 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880092e0 con 0x7f879809cee0 2023-10-06T03:09:59.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f879759e700 1 -- 172.21.15.27:0/1282982255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f879809cee0 msgr2=0x7f8798147d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f879759e700 1 --2- 172.21.15.27:0/1282982255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f879809cee0 0x7f8798147d50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f879806dcf0 tx=0x7f8788009840 comp rx=0 tx=0).stop 2023-10-06T03:09:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f879759e700 1 -- 172.21.15.27:0/1282982255 shutdown_connections 2023-10-06T03:09:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f879759e700 1 --2- 172.21.15.27:0/1282982255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f879809cee0 0x7f8798147d50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f879759e700 1 --2- 172.21.15.27:0/1282982255 >> v2:172.21.15.123:3300/0 conn(0x7f8798147980 0x7f87980a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f879759e700 1 -- 172.21.15.27:0/1282982255 >> 172.21.15.27:0/1282982255 conn(0x7f879806eb00 msgr2=0x7f87980ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f879759e700 1 -- 172.21.15.27:0/1282982255 shutdown_connections 2023-10-06T03:09:59.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.085+0000 7f879759e700 1 -- 172.21.15.27:0/1282982255 wait complete. 2023-10-06T03:09:59.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879759e700 1 Processor -- start 2023-10-06T03:09:59.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879759e700 1 -- start start 2023-10-06T03:09:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f879809cee0 0x7f8798143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87980a36d0 0x7f879809e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879759e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8798147980 0x7f8798068c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8798144030 con 0x7f879809cee0 2023-10-06T03:09:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8798145060 con 0x7f87980a36d0 2023-10-06T03:09:59.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879759e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879809ee10 con 0x7f8798147980 2023-10-06T03:09:59.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f879809cee0 0x7f8798143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f879809cee0 0x7f8798143af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41240/0 (socket says 172.21.15.27:41240) 2023-10-06T03:09:59.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879659c700 1 -- 172.21.15.27:0/771671161 learned_addr learned my addr 172.21.15.27:0/771671161 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:59.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f8796d9d700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8798147980 0x7f8798068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f8795d9b700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87980a36d0 0x7f879809e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879659c700 1 -- 172.21.15.27:0/771671161 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8798147980 msgr2=0x7f8798068c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879659c700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8798147980 0x7f8798068c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879659c700 1 -- 172.21.15.27:0/771671161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87980a36d0 msgr2=0x7f879809e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879659c700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87980a36d0 0x7f879809e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879659c700 1 -- 172.21.15.27:0/771671161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8788009ae0 con 0x7f879809cee0 2023-10-06T03:09:59.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.089+0000 7f879659c700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f879809cee0 0x7f8798143af0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f878c00d860 tx=0x7f878c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f87867fc700 1 -- 172.21.15.27:0/771671161 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c0125f0 con 0x7f879809cee0 2023-10-06T03:09:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f87867fc700 1 -- 172.21.15.27:0/771671161 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c012750 con 0x7f879809cee0 2023-10-06T03:09:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f879759e700 1 -- 172.21.15.27:0/771671161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8798144d80 con 0x7f879809cee0 2023-10-06T03:09:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f87867fc700 1 -- 172.21.15.27:0/771671161 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c012b10 con 0x7f879809cee0 2023-10-06T03:09:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f879759e700 1 -- 172.21.15.27:0/771671161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87981448f0 con 0x7f879809cee0 2023-10-06T03:09:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f87867fc700 1 -- 172.21.15.27:0/771671161 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f878c01e460 con 0x7f879809cee0 2023-10-06T03:09:59.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f879759e700 1 -- 172.21.15.27:0/771671161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f879804be40 con 0x7f879809cee0 2023-10-06T03:09:59.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f87867fc700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8778060550 0x7f8778062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f87867fc700 1 -- 172.21.15.27:0/771671161 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f878c07cea0 con 0x7f879809cee0 2023-10-06T03:09:59.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f8795d9b700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8778060550 0x7f8778062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f87867fc700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] conn(0x7f8778068ec0 0x7f877806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f87867fc700 1 -- 172.21.15.27:0/771671161 --> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f877806b9c0 con 0x7f8778068ec0 2023-10-06T03:09:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f87867fc700 1 -- 172.21.15.27:0/771671161 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f878c07f400 con 0x7f879809cee0 2023-10-06T03:09:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.093+0000 7f8796d9d700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] conn(0x7f8778068ec0 0x7f877806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.097+0000 7f8796d9d700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] conn(0x7f8778068ec0 0x7f877806b2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.097+0000 7f8795d9b700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8778060550 0x7f8778062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8788009880 tx=0x7f8788018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.097+0000 7f87867fc700 1 -- 172.21.15.27:0/771671161 <== osd.1 v2:172.21.15.27:6800/33280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f877806b9c0 con 0x7f8778068ec0 2023-10-06T03:09:59.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.113+0000 7f879759e700 1 -- 172.21.15.27:0/771671161 --> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8798063470 con 0x7f8778068ec0 2023-10-06T03:09:59.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.117+0000 7f87867fc700 1 -- 172.21.15.27:0/771671161 <== osd.1 v2:172.21.15.27:6800/33280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8798063470 con 0x7f8778068ec0 2023-10-06T03:09:59.117 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-06T03:09:59.117 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:09:59.117 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-06T03:09:59.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.117+0000 7f879759e700 1 -- 172.21.15.27:0/771671161 >> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] conn(0x7f8778068ec0 msgr2=0x7f877806b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.117+0000 7f879759e700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.27:6800/33280,v1:172.21.15.27:6801/33280] conn(0x7f8778068ec0 0x7f877806b2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.117+0000 7f879759e700 1 -- 172.21.15.27:0/771671161 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8778060550 msgr2=0x7f8778062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.117+0000 7f879759e700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8778060550 0x7f8778062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8788009880 tx=0x7f8788018000 comp rx=0 tx=0).stop 2023-10-06T03:09:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.117+0000 7f879759e700 1 -- 172.21.15.27:0/771671161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f879809cee0 msgr2=0x7f8798143af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.117+0000 7f879759e700 1 --2- 172.21.15.27:0/771671161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f879809cee0 0x7f8798143af0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f878c00d860 tx=0x7f878c008040 comp rx=0 tx=0).stop 2023-10-06T03:09:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.117+0000 7f8796d9d700 1 -- 172.21.15.27:0/771671161 reap_dead start 2023-10-06T03:09:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.117+0000 7f879759e700 1 -- 172.21.15.27:0/771671161 shutdown_connections 2023-10-06T03:09:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.117+0000 7f879759e700 1 -- 172.21.15.27:0/771671161 >> 172.21.15.27:0/771671161 conn(0x7f879806eb00 msgr2=0x7f87981466f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.117+0000 7f879759e700 1 -- 172.21.15.27:0/771671161 shutdown_connections 2023-10-06T03:09:59.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.117+0000 7f879759e700 1 -- 172.21.15.27:0/771671161 wait complete. 2023-10-06T03:09:59.129 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T03:09:59.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.233+0000 7f9379993700 1 Processor -- start 2023-10-06T03:09:59.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.233+0000 7f9379993700 1 -- start start 2023-10-06T03:09:59.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.233+0000 7f9379993700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f93740bafc0 0x7f937406aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.233+0000 7f9379993700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f93740bb390 0x7f93740b9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.233+0000 7f9379993700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937414d460 con 0x7f937406afb0 2023-10-06T03:09:59.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.233+0000 7f9379993700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93740ba2d0 con 0x7f93740bafc0 2023-10-06T03:09:59.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.233+0000 7f9379993700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93740b9480 con 0x7f93740bb390 2023-10-06T03:09:59.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9372ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f93740bafc0 0x7f937406aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9372ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f93740bafc0 0x7f937406aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41256/0 (socket says 172.21.15.27:41256) 2023-10-06T03:09:59.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9372ffd700 1 -- 172.21.15.27:0/1768982498 learned_addr learned my addr 172.21.15.27:0/1768982498 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:59.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f93727fc700 1 --2- 172.21.15.27:0/1768982498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f93740bb390 0x7f93740b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9372ffd700 1 -- 172.21.15.27:0/1768982498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f93740bb390 msgr2=0x7f93740b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:09:59.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9372ffd700 1 --2- 172.21.15.27:0/1768982498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f93740bb390 0x7f93740b9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9372ffd700 1 -- 172.21.15.27:0/1768982498 >> v1:172.21.15.123:6789/0 conn(0x7f937406afb0 legacy=0x7f93740b9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9372ffd700 1 -- 172.21.15.27:0/1768982498 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937414ce10 con 0x7f93740bafc0 2023-10-06T03:09:59.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9372ffd700 1 --2- 172.21.15.27:0/1768982498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93740bafc0 0x7f937406aa70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f93680099e0 tx=0x7f9368009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac360a936f41e62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9371ffb700 1 -- 172.21.15.27:0/1768982498 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800b820 con 0x7f93740bafc0 2023-10-06T03:09:59.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9371ffb700 1 -- 172.21.15.27:0/1768982498 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936800b980 con 0x7f93740bafc0 2023-10-06T03:09:59.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9371ffb700 1 -- 172.21.15.27:0/1768982498 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800bd20 con 0x7f93740bafc0 2023-10-06T03:09:59.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9379993700 1 -- 172.21.15.27:0/1768982498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93740bafc0 msgr2=0x7f937406aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9379993700 1 --2- 172.21.15.27:0/1768982498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93740bafc0 0x7f937406aa70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f93680099e0 tx=0x7f9368009250 comp rx=0 tx=0).stop 2023-10-06T03:09:59.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9379993700 1 -- 172.21.15.27:0/1768982498 shutdown_connections 2023-10-06T03:09:59.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9379993700 1 --2- 172.21.15.27:0/1768982498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f93740bb390 0x7f93740b9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9379993700 1 --2- 172.21.15.27:0/1768982498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93740bafc0 0x7f937406aa70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9379993700 1 -- 172.21.15.27:0/1768982498 >> 172.21.15.27:0/1768982498 conn(0x7f93740be770 msgr2=0x7f93740ba710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:59.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9379993700 1 -- 172.21.15.27:0/1768982498 shutdown_connections 2023-10-06T03:09:59.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.237+0000 7f9379993700 1 -- 172.21.15.27:0/1768982498 wait complete. 2023-10-06T03:09:59.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f9379993700 1 Processor -- start 2023-10-06T03:09:59.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f9379993700 1 -- start start 2023-10-06T03:09:59.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f9379993700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f937406afb0 0x7f93740bbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f9379993700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f93740bb390 0x7f937415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f9379993700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9374143de0 0x7f9374147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f9379993700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937414c4a0 con 0x7f9374143de0 2023-10-06T03:09:59.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f9379993700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937415d270 con 0x7f937406afb0 2023-10-06T03:09:59.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f9379993700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937415d550 con 0x7f93740bb390 2023-10-06T03:09:59.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f93737fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9374143de0 0x7f9374147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f9372ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f937406afb0 0x7f93740bbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f93737fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9374143de0 0x7f9374147aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41268/0 (socket says 172.21.15.27:41268) 2023-10-06T03:09:59.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f93737fe700 1 -- 172.21.15.27:0/100945002 learned_addr learned my addr 172.21.15.27:0/100945002 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:59.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f93727fc700 1 --2- 172.21.15.27:0/100945002 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f93740bb390 0x7f937415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f93737fe700 1 -- 172.21.15.27:0/100945002 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f93740bb390 msgr2=0x7f937415c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f93737fe700 1 --2- 172.21.15.27:0/100945002 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f93740bb390 0x7f937415c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f93737fe700 1 -- 172.21.15.27:0/100945002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f937406afb0 msgr2=0x7f93740bbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f93737fe700 1 --2- 172.21.15.27:0/100945002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f937406afb0 0x7f93740bbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f93737fe700 1 -- 172.21.15.27:0/100945002 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93680094f0 con 0x7f9374143de0 2023-10-06T03:09:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f93737fe700 1 --2- 172.21.15.27:0/100945002 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9374143de0 0x7f9374147aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f936c00c8e0 tx=0x7f936c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f935affd700 1 -- 172.21.15.27:0/100945002 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c012630 con 0x7f9374143de0 2023-10-06T03:09:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f935affd700 1 -- 172.21.15.27:0/100945002 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c0127b0 con 0x7f9374143de0 2023-10-06T03:09:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f9379993700 1 -- 172.21.15.27:0/100945002 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f937415ced0 con 0x7f9374143de0 2023-10-06T03:09:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f935affd700 1 -- 172.21.15.27:0/100945002 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c012b70 con 0x7f9374143de0 2023-10-06T03:09:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.241+0000 7f9379993700 1 -- 172.21.15.27:0/100945002 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9374142e50 con 0x7f9374143de0 2023-10-06T03:09:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.245+0000 7f9379993700 1 -- 172.21.15.27:0/100945002 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f937415d0e0 con 0x7f9374143de0 2023-10-06T03:09:59.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.245+0000 7f935affd700 1 -- 172.21.15.27:0/100945002 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f936c003030 con 0x7f9374143de0 2023-10-06T03:09:59.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.245+0000 7f935affd700 1 --2- 172.21.15.27:0/100945002 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9360060580 0x7f9360062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.245+0000 7f935affd700 1 -- 172.21.15.27:0/100945002 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f936c07c850 con 0x7f9374143de0 2023-10-06T03:09:59.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.245+0000 7f9372ffd700 1 --2- 172.21.15.27:0/100945002 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9360060580 0x7f9360062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.245+0000 7f9372ffd700 1 --2- 172.21.15.27:0/100945002 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9360060580 0x7f9360062a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f93680099e0 tx=0x7f9368017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.253+0000 7f935affd700 1 -- 172.21.15.27:0/100945002 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f936c04cc00 con 0x7f9374143de0 2023-10-06T03:09:59.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.421+0000 7f9379993700 1 -- 172.21.15.27:0/100945002 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f93740b63e0 con 0x7f9360060580 2023-10-06T03:09:59.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.421+0000 7f935affd700 1 -- 172.21.15.27:0/100945002 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f93740b63e0 con 0x7f9360060580 2023-10-06T03:09:59.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.425+0000 7f9379993700 1 -- 172.21.15.27:0/100945002 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9360060580 msgr2=0x7f9360062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.425+0000 7f9379993700 1 --2- 172.21.15.27:0/100945002 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9360060580 0x7f9360062a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f93680099e0 tx=0x7f9368017000 comp rx=0 tx=0).stop 2023-10-06T03:09:59.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.425+0000 7f9379993700 1 -- 172.21.15.27:0/100945002 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9374143de0 msgr2=0x7f9374147aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.425+0000 7f9379993700 1 --2- 172.21.15.27:0/100945002 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9374143de0 0x7f9374147aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f936c00c8e0 tx=0x7f936c001710 comp rx=0 tx=0).stop 2023-10-06T03:09:59.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.425+0000 7f9379993700 1 -- 172.21.15.27:0/100945002 shutdown_connections 2023-10-06T03:09:59.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.425+0000 7f9379993700 1 --2- 172.21.15.27:0/100945002 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f9360060580 0x7f9360062a30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.425+0000 7f9379993700 1 --2- 172.21.15.27:0/100945002 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9374143de0 0x7f9374147aa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.425+0000 7f9379993700 1 --2- 172.21.15.27:0/100945002 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f93740bb390 0x7f937415c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.425+0000 7f9379993700 1 --2- 172.21.15.27:0/100945002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f937406afb0 0x7f93740bbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.425+0000 7f9379993700 1 -- 172.21.15.27:0/100945002 >> 172.21.15.27:0/100945002 conn(0x7f93740be770 msgr2=0x7f937406c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:59.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.425+0000 7f9379993700 1 -- 172.21.15.27:0/100945002 shutdown_connections 2023-10-06T03:09:59.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.425+0000 7f9379993700 1 -- 172.21.15.27:0/100945002 wait complete. 2023-10-06T03:09:59.428 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T03:09:59.438 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T03:09:59.438 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:09:59.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.549+0000 7f41aca00700 1 Processor -- start 2023-10-06T03:09:59.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.549+0000 7f41aca00700 1 -- start start 2023-10-06T03:09:59.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41aca00700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f41a80a36d0 0x7f41a80a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41aca00700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a8149030 con 0x7f41a809cee0 2023-10-06T03:09:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41aca00700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a8149310 con 0x7f41a8147980 2023-10-06T03:09:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41aca00700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a80a3190 con 0x7f41a80a36d0 2023-10-06T03:09:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41a7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f41a80a36d0 0x7f41a80a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41a7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f41a80a36d0 0x7f41a80a01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41270/0 (socket says 172.21.15.27:41270) 2023-10-06T03:09:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41a6ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f41a809cee0 0x7f41a80a0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54706/0 (socket says 172.21.15.27:54706) 2023-10-06T03:09:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41a7fff700 1 -- 172.21.15.27:0/2938205469 learned_addr learned my addr 172.21.15.27:0/2938205469 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:59.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41a7fff700 1 -- 172.21.15.27:0/2938205469 >> v1:172.21.15.123:6789/0 conn(0x7f41a8147980 legacy=0x7f41a806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41a7fff700 1 -- 172.21.15.27:0/2938205469 >> v1:172.21.15.27:6789/0 conn(0x7f41a809cee0 legacy=0x7f41a80a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41a67fc700 1 -- 172.21.15.27:0/2938205469 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271007042 0 0) 0x7f41a8149030 con 0x7f41a809cee0 2023-10-06T03:09:59.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41a7fff700 1 -- 172.21.15.27:0/2938205469 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a806d020 con 0x7f41a80a36d0 2023-10-06T03:09:59.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41a7fff700 1 --2- 172.21.15.27:0/2938205469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41a80a36d0 0x7f41a80a01a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009f20 tx=0x7f41a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7267414ee8460b6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41a67fc700 1 -- 172.21.15.27:0/2938205469 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a000e070 con 0x7f41a80a36d0 2023-10-06T03:09:59.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41a67fc700 1 -- 172.21.15.27:0/2938205469 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a000ba80 con 0x7f41a80a36d0 2023-10-06T03:09:59.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41a67fc700 1 -- 172.21.15.27:0/2938205469 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a00092e0 con 0x7f41a80a36d0 2023-10-06T03:09:59.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41aca00700 1 -- 172.21.15.27:0/2938205469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41a80a36d0 msgr2=0x7f41a80a01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41aca00700 1 --2- 172.21.15.27:0/2938205469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41a80a36d0 0x7f41a80a01a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009f20 tx=0x7f41a0009840 comp rx=0 tx=0).stop 2023-10-06T03:09:59.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41aca00700 1 -- 172.21.15.27:0/2938205469 shutdown_connections 2023-10-06T03:09:59.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41aca00700 1 --2- 172.21.15.27:0/2938205469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41a80a36d0 0x7f41a80a01a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41aca00700 1 -- 172.21.15.27:0/2938205469 >> 172.21.15.27:0/2938205469 conn(0x7f41a806eb00 msgr2=0x7f41a80ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:59.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41aca00700 1 -- 172.21.15.27:0/2938205469 shutdown_connections 2023-10-06T03:09:59.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.553+0000 7f41aca00700 1 -- 172.21.15.27:0/2938205469 wait complete. 2023-10-06T03:09:59.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41aca00700 1 Processor -- start 2023-10-06T03:09:59.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41aca00700 1 -- start start 2023-10-06T03:09:59.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41aca00700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a809cee0 0x7f41a809eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41aca00700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41a80a36d0 0x7f41a8132830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41aca00700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41a8147980 0x7f41a8132d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41aca00700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a809f420 con 0x7f41a80a36d0 2023-10-06T03:09:59.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41aca00700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a815e9d0 con 0x7f41a809cee0 2023-10-06T03:09:59.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41aca00700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a815ecb0 con 0x7f41a8147980 2023-10-06T03:09:59.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41a6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41a80a36d0 0x7f41a8132830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41a6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41a80a36d0 0x7f41a8132830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41276/0 (socket says 172.21.15.27:41276) 2023-10-06T03:09:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41a6ffd700 1 -- 172.21.15.27:0/1219218965 learned_addr learned my addr 172.21.15.27:0/1219218965 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41a77fe700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a809cee0 0x7f41a809eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41a7fff700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41a8147980 0x7f41a8132d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41a6ffd700 1 -- 172.21.15.27:0/1219218965 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41a8147980 msgr2=0x7f41a8132d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41a6ffd700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41a8147980 0x7f41a8132d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41a6ffd700 1 -- 172.21.15.27:0/1219218965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a809cee0 msgr2=0x7f41a809eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41a6ffd700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a809cee0 0x7f41a809eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41a6ffd700 1 -- 172.21.15.27:0/1219218965 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a0009ae0 con 0x7f41a80a36d0 2023-10-06T03:09:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41a77fe700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a809cee0 0x7f41a809eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:09:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41a6ffd700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41a80a36d0 0x7f41a8132830 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f41900011e0 tx=0x7f4190007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f419f7fe700 1 -- 172.21.15.27:0/1219218965 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190007300 con 0x7f41a80a36d0 2023-10-06T03:09:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f419f7fe700 1 -- 172.21.15.27:0/1219218965 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190007460 con 0x7f41a80a36d0 2023-10-06T03:09:59.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41aca00700 1 -- 172.21.15.27:0/1219218965 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a8137f00 con 0x7f41a80a36d0 2023-10-06T03:09:59.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f419f7fe700 1 -- 172.21.15.27:0/1219218965 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190004830 con 0x7f41a80a36d0 2023-10-06T03:09:59.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41aca00700 1 -- 172.21.15.27:0/1219218965 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a814b9b0 con 0x7f41a80a36d0 2023-10-06T03:09:59.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.557+0000 7f41aca00700 1 -- 172.21.15.27:0/1219218965 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41a804be40 con 0x7f41a80a36d0 2023-10-06T03:09:59.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.561+0000 7f419f7fe700 1 -- 172.21.15.27:0/1219218965 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4190004be0 con 0x7f41a80a36d0 2023-10-06T03:09:59.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.561+0000 7f419f7fe700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4188060550 0x7f4188062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.561+0000 7f419f7fe700 1 -- 172.21.15.27:0/1219218965 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f419007c5b0 con 0x7f41a80a36d0 2023-10-06T03:09:59.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.561+0000 7f41a77fe700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4188060550 0x7f4188062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.561+0000 7f419f7fe700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] conn(0x7f4188068ec0 0x7f418806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.561+0000 7f419f7fe700 1 -- 172.21.15.27:0/1219218965 --> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f418806b9c0 con 0x7f4188068ec0 2023-10-06T03:09:59.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.561+0000 7f419f7fe700 1 -- 172.21.15.27:0/1219218965 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f419007c980 con 0x7f41a80a36d0 2023-10-06T03:09:59.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.561+0000 7f41a7fff700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] conn(0x7f4188068ec0 0x7f418806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.561+0000 7f41a7fff700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] conn(0x7f4188068ec0 0x7f418806b2f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.561+0000 7f41a77fe700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4188060550 0x7f4188062a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4198000c00 tx=0x7f4198009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.561+0000 7f419f7fe700 1 -- 172.21.15.27:0/1219218965 <== osd.2 v2:172.21.15.27:6808/33282 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f418806b9c0 con 0x7f4188068ec0 2023-10-06T03:09:59.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.577+0000 7f41aca00700 1 -- 172.21.15.27:0/1219218965 --> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f41a814be20 con 0x7f4188068ec0 2023-10-06T03:09:59.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.577+0000 7f419f7fe700 1 -- 172.21.15.27:0/1219218965 <== osd.2 v2:172.21.15.27:6808/33282 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f41a814be20 con 0x7f4188068ec0 2023-10-06T03:09:59.579 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-06T03:09:59.580 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:09:59.580 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-06T03:09:59.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.577+0000 7f41aca00700 1 -- 172.21.15.27:0/1219218965 >> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] conn(0x7f4188068ec0 msgr2=0x7f418806b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.577+0000 7f41aca00700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.27:6808/33282,v1:172.21.15.27:6809/33282] conn(0x7f4188068ec0 0x7f418806b2f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.577+0000 7f41aca00700 1 -- 172.21.15.27:0/1219218965 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4188060550 msgr2=0x7f4188062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.577+0000 7f41aca00700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4188060550 0x7f4188062a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4198000c00 tx=0x7f4198009040 comp rx=0 tx=0).stop 2023-10-06T03:09:59.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.577+0000 7f41aca00700 1 -- 172.21.15.27:0/1219218965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41a80a36d0 msgr2=0x7f41a8132830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.577+0000 7f41aca00700 1 --2- 172.21.15.27:0/1219218965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41a80a36d0 0x7f41a8132830 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f41900011e0 tx=0x7f4190007e10 comp rx=0 tx=0).stop 2023-10-06T03:09:59.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.577+0000 7f41a7fff700 1 -- 172.21.15.27:0/1219218965 reap_dead start 2023-10-06T03:09:59.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.577+0000 7f41aca00700 1 -- 172.21.15.27:0/1219218965 shutdown_connections 2023-10-06T03:09:59.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.577+0000 7f41aca00700 1 -- 172.21.15.27:0/1219218965 >> 172.21.15.27:0/1219218965 conn(0x7f41a806eb00 msgr2=0x7f41a80baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:59.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.577+0000 7f41aca00700 1 -- 172.21.15.27:0/1219218965 shutdown_connections 2023-10-06T03:09:59.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.577+0000 7f41aca00700 1 -- 172.21.15.27:0/1219218965 wait complete. 2023-10-06T03:09:59.591 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T03:09:59.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fe0977700 1 Processor -- start 2023-10-06T03:09:59.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fe0977700 1 -- start start 2023-10-06T03:09:59.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fe0977700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fdc0bafc0 0x7f7fdc06aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fe0977700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7fdc0bb390 0x7f7fdc0b9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fe0977700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fdc14d460 con 0x7f7fdc06afb0 2023-10-06T03:09:59.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fe0977700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fdc0ba2d0 con 0x7f7fdc0bb390 2023-10-06T03:09:59.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fe0977700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0b9480 con 0x7f7fdc0bafc0 2023-10-06T03:09:59.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fdad9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7fdc06afb0 0x7f7fdc0b9bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54716/0 (socket says 172.21.15.27:54716) 2023-10-06T03:09:59.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fdad9d700 1 -- 172.21.15.27:0/639336355 learned_addr learned my addr 172.21.15.27:0/639336355 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:09:59.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fda59c700 1 --2- 172.21.15.27:0/639336355 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fdc0bafc0 0x7f7fdc06aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fd9d9b700 1 --2- 172.21.15.27:0/639336355 >> v2:172.21.15.123:3300/0 conn(0x7f7fdc0bb390 0x7f7fdc0b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fd959a700 1 -- 172.21.15.27:0/639336355 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900255322 0 0) 0x7f7fdc14d460 con 0x7f7fdc06afb0 2023-10-06T03:09:59.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fd959a700 1 -- 172.21.15.27:0/639336355 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc4003570 con 0x7f7fdc06afb0 2023-10-06T03:09:59.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fd9d9b700 1 -- 172.21.15.27:0/639336355 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fdc0bafc0 msgr2=0x7f7fdc06aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:09:59.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fd9d9b700 1 --2- 172.21.15.27:0/639336355 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fdc0bafc0 0x7f7fdc06aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fd9d9b700 1 -- 172.21.15.27:0/639336355 >> v1:172.21.15.27:6789/0 conn(0x7f7fdc06afb0 legacy=0x7f7fdc0b9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fd9d9b700 1 -- 172.21.15.27:0/639336355 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc14ce10 con 0x7f7fdc0bb390 2023-10-06T03:09:59.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fd9d9b700 1 --2- 172.21.15.27:0/639336355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fdc0bb390 0x7f7fdc0b9680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009910 tx=0x7f7fd00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3768511d65aa4729 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fd959a700 1 -- 172.21.15.27:0/639336355 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0011630 con 0x7f7fdc0bb390 2023-10-06T03:09:59.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fd959a700 1 -- 172.21.15.27:0/639336355 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd0011790 con 0x7f7fdc0bb390 2023-10-06T03:09:59.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.697+0000 7f7fd959a700 1 -- 172.21.15.27:0/639336355 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0011b30 con 0x7f7fdc0bb390 2023-10-06T03:09:59.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.701+0000 7f7fe0977700 1 -- 172.21.15.27:0/639336355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fdc0bb390 msgr2=0x7f7fdc0b9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.701+0000 7f7fe0977700 1 --2- 172.21.15.27:0/639336355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fdc0bb390 0x7f7fdc0b9680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009910 tx=0x7f7fd00091a0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.701+0000 7f7fe0977700 1 -- 172.21.15.27:0/639336355 shutdown_connections 2023-10-06T03:09:59.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.701+0000 7f7fe0977700 1 --2- 172.21.15.27:0/639336355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fdc0bb390 0x7f7fdc0b9680 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.701+0000 7f7fe0977700 1 --2- 172.21.15.27:0/639336355 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fdc0bafc0 0x7f7fdc06aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.701+0000 7f7fe0977700 1 -- 172.21.15.27:0/639336355 >> 172.21.15.27:0/639336355 conn(0x7f7fdc0be770 msgr2=0x7f7fdc0ba710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:59.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.701+0000 7f7fe0977700 1 -- 172.21.15.27:0/639336355 shutdown_connections 2023-10-06T03:09:59.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.701+0000 7f7fe0977700 1 -- 172.21.15.27:0/639336355 wait complete. 2023-10-06T03:09:59.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.701+0000 7f7fe0977700 1 Processor -- start 2023-10-06T03:09:59.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.701+0000 7f7fe0977700 1 -- start start 2023-10-06T03:09:59.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fe0977700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fdc06afb0 0x7f7fdc15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fe0977700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fdc0bafc0 0x7f7fdc0bc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fe0977700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fdc0bb390 0x7f7fdc14ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fe0977700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc15bb80 con 0x7f7fdc06afb0 2023-10-06T03:09:59.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fe0977700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc15c550 con 0x7f7fdc0bafc0 2023-10-06T03:09:59.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fe0977700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0bcd10 con 0x7f7fdc0bb390 2023-10-06T03:09:59.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fda59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fdc06afb0 0x7f7fdc15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fda59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fdc06afb0 0x7f7fdc15c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41284/0 (socket says 172.21.15.27:41284) 2023-10-06T03:09:59.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fda59c700 1 -- 172.21.15.27:0/4149579716 learned_addr learned my addr 172.21.15.27:0/4149579716 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:09:59.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fdad9d700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fdc0bb390 0x7f7fdc14ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fd9d9b700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fdc0bafc0 0x7f7fdc0bc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fda59c700 1 -- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fdc0bb390 msgr2=0x7f7fdc14ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fda59c700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fdc0bb390 0x7f7fdc14ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fda59c700 1 -- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fdc0bafc0 msgr2=0x7f7fdc0bc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fda59c700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fdc0bafc0 0x7f7fdc0bc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fda59c700 1 -- 172.21.15.27:0/4149579716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0009420 con 0x7f7fdc06afb0 2023-10-06T03:09:59.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fda59c700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fdc06afb0 0x7f7fdc15c010 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009ef0 tx=0x7f7fcc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fca7fc700 1 -- 172.21.15.27:0/4149579716 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc00cb70 con 0x7f7fdc06afb0 2023-10-06T03:09:59.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fca7fc700 1 -- 172.21.15.27:0/4149579716 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc00f040 con 0x7f7fdc06afb0 2023-10-06T03:09:59.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fe0977700 1 -- 172.21.15.27:0/4149579716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc15b530 con 0x7f7fdc06afb0 2023-10-06T03:09:59.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fca7fc700 1 -- 172.21.15.27:0/4149579716 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc014480 con 0x7f7fdc06afb0 2023-10-06T03:09:59.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fe0977700 1 -- 172.21.15.27:0/4149579716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fdc147410 con 0x7f7fdc06afb0 2023-10-06T03:09:59.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fe0977700 1 -- 172.21.15.27:0/4149579716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fdc04be40 con 0x7f7fdc06afb0 2023-10-06T03:09:59.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.705+0000 7f7fca7fc700 1 -- 172.21.15.27:0/4149579716 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7fcc0147f0 con 0x7f7fdc06afb0 2023-10-06T03:09:59.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.709+0000 7f7fca7fc700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7fbc060550 0x7f7fbc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:09:59.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.709+0000 7f7fca7fc700 1 -- 172.21.15.27:0/4149579716 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f7fcc07d2b0 con 0x7f7fdc06afb0 2023-10-06T03:09:59.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.709+0000 7f7fd9d9b700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7fbc060550 0x7f7fbc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:09:59.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.709+0000 7f7fd9d9b700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7fbc060550 0x7f7fbc062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0bb780 tx=0x7f7fd0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:09:59.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.713+0000 7f7fca7fc700 1 -- 172.21.15.27:0/4149579716 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7fcc04d700 con 0x7f7fdc06afb0 2023-10-06T03:09:59.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.881+0000 7f7fe0977700 1 -- 172.21.15.27:0/4149579716 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fdc14d0f0 con 0x7f7fbc060550 2023-10-06T03:09:59.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.881+0000 7f7fca7fc700 1 -- 172.21.15.27:0/4149579716 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7fdc14d0f0 con 0x7f7fbc060550 2023-10-06T03:09:59.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.885+0000 7f7fe0977700 1 -- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7fbc060550 msgr2=0x7f7fbc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.885+0000 7f7fe0977700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7fbc060550 0x7f7fbc062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0bb780 tx=0x7f7fd0017000 comp rx=0 tx=0).stop 2023-10-06T03:09:59.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.885+0000 7f7fe0977700 1 -- 172.21.15.27:0/4149579716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fdc06afb0 msgr2=0x7f7fdc15c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:09:59.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.885+0000 7f7fe0977700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fdc06afb0 0x7f7fdc15c010 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009ef0 tx=0x7f7fcc00b040 comp rx=0 tx=0).stop 2023-10-06T03:09:59.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.885+0000 7f7fe0977700 1 -- 172.21.15.27:0/4149579716 shutdown_connections 2023-10-06T03:09:59.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.885+0000 7f7fe0977700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f7fbc060550 0x7f7fbc062a00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.885+0000 7f7fe0977700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fdc0bb390 0x7f7fdc14ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.885+0000 7f7fe0977700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fdc0bafc0 0x7f7fdc0bc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.885+0000 7f7fe0977700 1 --2- 172.21.15.27:0/4149579716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fdc06afb0 0x7f7fdc15c010 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:09:59.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.885+0000 7f7fe0977700 1 -- 172.21.15.27:0/4149579716 >> 172.21.15.27:0/4149579716 conn(0x7f7fdc0be770 msgr2=0x7f7fdc06c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:09:59.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.885+0000 7f7fe0977700 1 -- 172.21.15.27:0/4149579716 shutdown_connections 2023-10-06T03:09:59.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:09:59.885+0000 7f7fe0977700 1 -- 172.21.15.27:0/4149579716 wait complete. 2023-10-06T03:09:59.888 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T03:09:59.903 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T03:09:59.904 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:10:00.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.013+0000 7f011a36e700 1 Processor -- start 2023-10-06T03:10:00.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.013+0000 7f011a36e700 1 -- start start 2023-10-06T03:10:00.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f011a36e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f011406d3d0 0x7f01141450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f011a36e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011414bf90 con 0x7f01140bbcd0 2023-10-06T03:10:00.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f011a36e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011414c270 con 0x7f011406b900 2023-10-06T03:10:00.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f011a36e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01140b4900 con 0x7f011406d3d0 2023-10-06T03:10:00.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f011936c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f011406d3d0 0x7f01141450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f011936c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f011406d3d0 0x7f01141450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41298/0 (socket says 172.21.15.27:41298) 2023-10-06T03:10:00.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f011936c700 1 -- 172.21.15.27:0/1516205432 learned_addr learned my addr 172.21.15.27:0/1516205432 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:00.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f011936c700 1 -- 172.21.15.27:0/1516205432 >> v1:172.21.15.123:6789/0 conn(0x7f011406b900 legacy=0x7f011414eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f011936c700 1 -- 172.21.15.27:0/1516205432 >> v1:172.21.15.27:6789/0 conn(0x7f01140bbcd0 legacy=0x7f011414f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f011936c700 1 -- 172.21.15.27:0/1516205432 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0114069970 con 0x7f011406d3d0 2023-10-06T03:10:00.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f011936c700 1 --2- 172.21.15.27:0/1516205432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f011406d3d0 0x7f01141450a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f01100099b0 tx=0x7f0110009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f2614c0ddcb640 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f010bfff700 1 -- 172.21.15.27:0/1516205432 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000b860 con 0x7f011406d3d0 2023-10-06T03:10:00.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f010bfff700 1 -- 172.21.15.27:0/1516205432 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011000b9c0 con 0x7f011406d3d0 2023-10-06T03:10:00.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.017+0000 7f010bfff700 1 -- 172.21.15.27:0/1516205432 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000bd60 con 0x7f011406d3d0 2023-10-06T03:10:00.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.021+0000 7f011a36e700 1 -- 172.21.15.27:0/1516205432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f011406d3d0 msgr2=0x7f01141450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.021+0000 7f011a36e700 1 --2- 172.21.15.27:0/1516205432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f011406d3d0 0x7f01141450a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f01100099b0 tx=0x7f0110009250 comp rx=0 tx=0).stop 2023-10-06T03:10:00.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.021+0000 7f011a36e700 1 -- 172.21.15.27:0/1516205432 shutdown_connections 2023-10-06T03:10:00.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.021+0000 7f011a36e700 1 --2- 172.21.15.27:0/1516205432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f011406d3d0 0x7f01141450a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.021+0000 7f011a36e700 1 -- 172.21.15.27:0/1516205432 >> 172.21.15.27:0/1516205432 conn(0x7f01140bae20 msgr2=0x7f01140bb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:00.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.021+0000 7f011a36e700 1 -- 172.21.15.27:0/1516205432 shutdown_connections 2023-10-06T03:10:00.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.021+0000 7f011a36e700 1 -- 172.21.15.27:0/1516205432 wait complete. 2023-10-06T03:10:00.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.021+0000 7f011a36e700 1 Processor -- start 2023-10-06T03:10:00.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.021+0000 7f011a36e700 1 -- start start 2023-10-06T03:10:00.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f011a36e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011406b900 0x7f0114145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f011a36e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f011406d3d0 0x7f01140b9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f011a36e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f01140bbcd0 0x7f011414a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f011a36e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01141473f0 con 0x7f011406d3d0 2023-10-06T03:10:00.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f011a36e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011415b2f0 con 0x7f011406b900 2023-10-06T03:10:00.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f011a36e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011415afa0 con 0x7f01140bbcd0 2023-10-06T03:10:00.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f0118b6b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f011406d3d0 0x7f01140b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f0118b6b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f011406d3d0 0x7f01140b9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41302/0 (socket says 172.21.15.27:41302) 2023-10-06T03:10:00.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f0118b6b700 1 -- 172.21.15.27:0/2208240740 learned_addr learned my addr 172.21.15.27:0/2208240740 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:00.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f011936c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011406b900 0x7f0114145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f0119b6d700 1 --2- 172.21.15.27:0/2208240740 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f01140bbcd0 0x7f011414a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f0118b6b700 1 -- 172.21.15.27:0/2208240740 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f01140bbcd0 msgr2=0x7f011414a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f0118b6b700 1 --2- 172.21.15.27:0/2208240740 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f01140bbcd0 0x7f011414a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f0118b6b700 1 -- 172.21.15.27:0/2208240740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011406b900 msgr2=0x7f0114145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f0118b6b700 1 --2- 172.21.15.27:0/2208240740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011406b900 0x7f0114145530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f0118b6b700 1 -- 172.21.15.27:0/2208240740 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01100094f0 con 0x7f011406d3d0 2023-10-06T03:10:00.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f0118b6b700 1 --2- 172.21.15.27:0/2208240740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f011406d3d0 0x7f01140b9620 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f010400c5c0 tx=0x7f010400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f01097fa700 1 -- 172.21.15.27:0/2208240740 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104011590 con 0x7f011406d3d0 2023-10-06T03:10:00.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f01097fa700 1 -- 172.21.15.27:0/2208240740 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0104011710 con 0x7f011406d3d0 2023-10-06T03:10:00.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f011a36e700 1 -- 172.21.15.27:0/2208240740 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011414cbb0 con 0x7f011406d3d0 2023-10-06T03:10:00.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f01097fa700 1 -- 172.21.15.27:0/2208240740 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104011ad0 con 0x7f011406d3d0 2023-10-06T03:10:00.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.025+0000 7f011a36e700 1 -- 172.21.15.27:0/2208240740 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01140b9b60 con 0x7f011406d3d0 2023-10-06T03:10:00.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.029+0000 7f011a36e700 1 -- 172.21.15.27:0/2208240740 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0114067370 con 0x7f011406d3d0 2023-10-06T03:10:00.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.029+0000 7f01097fa700 1 -- 172.21.15.27:0/2208240740 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f010401b3b0 con 0x7f011406d3d0 2023-10-06T03:10:00.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.029+0000 7f01097fa700 1 --2- 172.21.15.27:0/2208240740 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f00f8060550 0x7f00f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.029+0000 7f01097fa700 1 -- 172.21.15.27:0/2208240740 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f010407bd90 con 0x7f011406d3d0 2023-10-06T03:10:00.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.029+0000 7f011936c700 1 --2- 172.21.15.27:0/2208240740 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f00f8060550 0x7f00f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.029+0000 7f01097fa700 1 --2- 172.21.15.27:0/2208240740 >> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] conn(0x7f00f8068ec0 0x7f00f806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.029+0000 7f01097fa700 1 -- 172.21.15.27:0/2208240740 --> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00f806b9c0 con 0x7f00f8068ec0 2023-10-06T03:10:00.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.029+0000 7f01097fa700 1 -- 172.21.15.27:0/2208240740 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f010407e3d0 con 0x7f011406d3d0 2023-10-06T03:10:00.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.029+0000 7f0119b6d700 1 --2- 172.21.15.27:0/2208240740 >> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] conn(0x7f00f8068ec0 0x7f00f806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.029+0000 7f011936c700 1 --2- 172.21.15.27:0/2208240740 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f00f8060550 0x7f00f8062a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f01100099b0 tx=0x7f0110017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.029+0000 7f0119b6d700 1 --2- 172.21.15.27:0/2208240740 >> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] conn(0x7f00f8068ec0 0x7f00f806b2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.029+0000 7f01097fa700 1 -- 172.21.15.27:0/2208240740 <== osd.3 v2:172.21.15.27:6816/33279 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f00f806b9c0 con 0x7f00f8068ec0 2023-10-06T03:10:00.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.049+0000 7f011a36e700 1 -- 172.21.15.27:0/2208240740 --> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f011414ca10 con 0x7f00f8068ec0 2023-10-06T03:10:00.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.049+0000 7f01097fa700 1 -- 172.21.15.27:0/2208240740 <== osd.3 v2:172.21.15.27:6816/33279 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f011414ca10 con 0x7f00f8068ec0 2023-10-06T03:10:00.050 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-06T03:10:00.050 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:10:00.050 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-06T03:10:00.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.049+0000 7f011a36e700 1 -- 172.21.15.27:0/2208240740 >> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] conn(0x7f00f8068ec0 msgr2=0x7f00f806b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.049+0000 7f011a36e700 1 --2- 172.21.15.27:0/2208240740 >> [v2:172.21.15.27:6816/33279,v1:172.21.15.27:6817/33279] conn(0x7f00f8068ec0 0x7f00f806b2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.049+0000 7f011a36e700 1 -- 172.21.15.27:0/2208240740 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f00f8060550 msgr2=0x7f00f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.049+0000 7f011a36e700 1 --2- 172.21.15.27:0/2208240740 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f00f8060550 0x7f00f8062a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f01100099b0 tx=0x7f0110017000 comp rx=0 tx=0).stop 2023-10-06T03:10:00.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.049+0000 7f011a36e700 1 -- 172.21.15.27:0/2208240740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f011406d3d0 msgr2=0x7f01140b9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.049+0000 7f011a36e700 1 --2- 172.21.15.27:0/2208240740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f011406d3d0 0x7f01140b9620 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f010400c5c0 tx=0x7f010400c8d0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.049+0000 7f0119b6d700 1 -- 172.21.15.27:0/2208240740 reap_dead start 2023-10-06T03:10:00.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.049+0000 7f011a36e700 1 -- 172.21.15.27:0/2208240740 shutdown_connections 2023-10-06T03:10:00.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.049+0000 7f011a36e700 1 -- 172.21.15.27:0/2208240740 >> 172.21.15.27:0/2208240740 conn(0x7f01140bae20 msgr2=0x7f0114142dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:00.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.049+0000 7f011a36e700 1 -- 172.21.15.27:0/2208240740 shutdown_connections 2023-10-06T03:10:00.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.049+0000 7f011a36e700 1 -- 172.21.15.27:0/2208240740 wait complete. 2023-10-06T03:10:00.062 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T03:10:00.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.169+0000 7f6d2e6de700 1 Processor -- start 2023-10-06T03:10:00.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.169+0000 7f6d2e6de700 1 -- start start 2023-10-06T03:10:00.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.169+0000 7f6d2e6de700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d2814aed0 0x7f6d2814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.169+0000 7f6d2e6de700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6d280b7f40 0x7f6d2814c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.169+0000 7f6d2e6de700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d280a18e0 con 0x7f6d280a4760 2023-10-06T03:10:00.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.169+0000 7f6d2e6de700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d280bdbb0 con 0x7f6d280b7f40 2023-10-06T03:10:00.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.169+0000 7f6d2e6de700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280b8830 con 0x7f6d2814aed0 2023-10-06T03:10:00.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2dedd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6d280b7f40 0x7f6d2814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2dedd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6d280b7f40 0x7f6d2814c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41304/0 (socket says 172.21.15.27:41304) 2023-10-06T03:10:00.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2dedd700 1 -- 172.21.15.27:0/2430544175 learned_addr learned my addr 172.21.15.27:0/2430544175 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:00.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2d6dc700 1 --2- 172.21.15.27:0/2430544175 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d2814aed0 0x7f6d2814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2dedd700 1 -- 172.21.15.27:0/2430544175 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d2814aed0 msgr2=0x7f6d2814b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:00.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2dedd700 1 --2- 172.21.15.27:0/2430544175 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d2814aed0 0x7f6d2814b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2dedd700 1 -- 172.21.15.27:0/2430544175 >> v1:172.21.15.123:6789/0 conn(0x7f6d280a4760 legacy=0x7f6d2806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2dedd700 1 -- 172.21.15.27:0/2430544175 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2814f970 con 0x7f6d280b7f40 2023-10-06T03:10:00.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2dedd700 1 --2- 172.21.15.27:0/2430544175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d280b7f40 0x7f6d2814c240 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009f50 tx=0x7f6d20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a7243c69dc18e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d1ffff700 1 -- 172.21.15.27:0/2430544175 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2000e070 con 0x7f6d280b7f40 2023-10-06T03:10:00.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d1ffff700 1 -- 172.21.15.27:0/2430544175 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2000ba70 con 0x7f6d280b7f40 2023-10-06T03:10:00.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d1ffff700 1 -- 172.21.15.27:0/2430544175 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200092e0 con 0x7f6d280b7f40 2023-10-06T03:10:00.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2e6de700 1 -- 172.21.15.27:0/2430544175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d280b7f40 msgr2=0x7f6d2814c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2e6de700 1 --2- 172.21.15.27:0/2430544175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d280b7f40 0x7f6d2814c240 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009f50 tx=0x7f6d20009840 comp rx=0 tx=0).stop 2023-10-06T03:10:00.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2e6de700 1 -- 172.21.15.27:0/2430544175 shutdown_connections 2023-10-06T03:10:00.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2e6de700 1 --2- 172.21.15.27:0/2430544175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d280b7f40 0x7f6d2814c240 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2e6de700 1 --2- 172.21.15.27:0/2430544175 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d2814aed0 0x7f6d2814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2e6de700 1 -- 172.21.15.27:0/2430544175 >> 172.21.15.27:0/2430544175 conn(0x7f6d280beae0 msgr2=0x7f6d280beee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:00.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2e6de700 1 -- 172.21.15.27:0/2430544175 shutdown_connections 2023-10-06T03:10:00.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.173+0000 7f6d2e6de700 1 -- 172.21.15.27:0/2430544175 wait complete. 2023-10-06T03:10:00.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2e6de700 1 Processor -- start 2023-10-06T03:10:00.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2e6de700 1 -- start start 2023-10-06T03:10:00.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2e6de700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d280a4760 0x7f6d280a7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2e6de700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d280b7f40 0x7f6d280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2e6de700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2814aed0 0x7f6d2814f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2e6de700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2814edb0 con 0x7f6d280a4760 2023-10-06T03:10:00.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2e6de700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280a3960 con 0x7f6d2814aed0 2023-10-06T03:10:00.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2e6de700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280a5640 con 0x7f6d280b7f40 2023-10-06T03:10:00.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2d6dc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d280a4760 0x7f6d280a7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2d6dc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d280a4760 0x7f6d280a7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41310/0 (socket says 172.21.15.27:41310) 2023-10-06T03:10:00.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2d6dc700 1 -- 172.21.15.27:0/318853404 learned_addr learned my addr 172.21.15.27:0/318853404 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:00.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2dedd700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2814aed0 0x7f6d2814f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2cedb700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d280b7f40 0x7f6d280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2d6dc700 1 -- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d280b7f40 msgr2=0x7f6d280a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2d6dc700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d280b7f40 0x7f6d280a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2d6dc700 1 -- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2814aed0 msgr2=0x7f6d2814f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2d6dc700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2814aed0 0x7f6d2814f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2d6dc700 1 -- 172.21.15.27:0/318853404 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d20009ae0 con 0x7f6d280a4760 2023-10-06T03:10:00.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d2d6dc700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d280a4760 0x7f6d280a7870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400d860 tx=0x7f6d24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.177+0000 7f6d1d7fa700 1 -- 172.21.15.27:0/318853404 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d240125f0 con 0x7f6d280a4760 2023-10-06T03:10:00.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.181+0000 7f6d1d7fa700 1 -- 172.21.15.27:0/318853404 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d24012750 con 0x7f6d280a4760 2023-10-06T03:10:00.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.181+0000 7f6d2e6de700 1 -- 172.21.15.27:0/318853404 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2814ea40 con 0x7f6d280a4760 2023-10-06T03:10:00.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.181+0000 7f6d1d7fa700 1 -- 172.21.15.27:0/318853404 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24012b10 con 0x7f6d280a4760 2023-10-06T03:10:00.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.181+0000 7f6d2e6de700 1 -- 172.21.15.27:0/318853404 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d280a3340 con 0x7f6d280a4760 2023-10-06T03:10:00.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.181+0000 7f6d1d7fa700 1 -- 172.21.15.27:0/318853404 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6d2401e460 con 0x7f6d280a4760 2023-10-06T03:10:00.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.181+0000 7f6d2e6de700 1 -- 172.21.15.27:0/318853404 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d28087a70 con 0x7f6d280a4760 2023-10-06T03:10:00.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.181+0000 7f6d1d7fa700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d0c060580 0x7f6d0c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.181+0000 7f6d1d7fa700 1 -- 172.21.15.27:0/318853404 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f6d2407cd90 con 0x7f6d280a4760 2023-10-06T03:10:00.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.181+0000 7f6d2cedb700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d0c060580 0x7f6d0c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.185+0000 7f6d2cedb700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d0c060580 0x7f6d0c062a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6d280a68c0 tx=0x7f6d18007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.185+0000 7f6d1d7fa700 1 -- 172.21.15.27:0/318853404 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6d2404d1e0 con 0x7f6d280a4760 2023-10-06T03:10:00.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.341+0000 7f6d2e6de700 1 -- 172.21.15.27:0/318853404 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d2814eef0 con 0x7f6d0c060580 2023-10-06T03:10:00.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.341+0000 7f6d1d7fa700 1 -- 172.21.15.27:0/318853404 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6d18014450 con 0x7f6d0c060580 2023-10-06T03:10:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.345+0000 7f6d2e6de700 1 -- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d0c060580 msgr2=0x7f6d0c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.345+0000 7f6d2e6de700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d0c060580 0x7f6d0c062a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6d280a68c0 tx=0x7f6d18007ec0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.345+0000 7f6d2e6de700 1 -- 172.21.15.27:0/318853404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d280a4760 msgr2=0x7f6d280a7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.345+0000 7f6d2e6de700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d280a4760 0x7f6d280a7870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400d860 tx=0x7f6d24008040 comp rx=0 tx=0).stop 2023-10-06T03:10:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.345+0000 7f6d2e6de700 1 -- 172.21.15.27:0/318853404 shutdown_connections 2023-10-06T03:10:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.345+0000 7f6d2e6de700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6d0c060580 0x7f6d0c062a30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.345+0000 7f6d2e6de700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2814aed0 0x7f6d2814f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.345+0000 7f6d2e6de700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d280b7f40 0x7f6d280a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.345+0000 7f6d2e6de700 1 --2- 172.21.15.27:0/318853404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d280a4760 0x7f6d280a7870 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.345+0000 7f6d2e6de700 1 -- 172.21.15.27:0/318853404 >> 172.21.15.27:0/318853404 conn(0x7f6d280beae0 msgr2=0x7f6d2814a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:00.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.345+0000 7f6d2e6de700 1 -- 172.21.15.27:0/318853404 shutdown_connections 2023-10-06T03:10:00.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.345+0000 7f6d2e6de700 1 -- 172.21.15.27:0/318853404 wait complete. 2023-10-06T03:10:00.347 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T03:10:00.362 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T03:10:00.362 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:10:00.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.477+0000 7f070759e700 1 Processor -- start 2023-10-06T03:10:00.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.477+0000 7f070759e700 1 -- start start 2023-10-06T03:10:00.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070759e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f070806d3d0 0x7f07081450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f070806b900 0x7f07081455e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070759e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07080bbcd0 0x7f070814eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070759e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07080b4900 con 0x7f070806d3d0 2023-10-06T03:10:00.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070814bf90 con 0x7f070806b900 2023-10-06T03:10:00.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070759e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070814c270 con 0x7f07080bbcd0 2023-10-06T03:10:00.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070659c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f070806d3d0 0x7f07081450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070659c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f070806d3d0 0x7f07081450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41312/0 (socket says 172.21.15.27:41312) 2023-10-06T03:10:00.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070659c700 1 -- 172.21.15.27:0/456493473 learned_addr learned my addr 172.21.15.27:0/456493473 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:00.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f06fdd9b700 1 --2- 172.21.15.27:0/456493473 >> v2:172.21.15.123:3300/0 conn(0x7f070806b900 0x7f07081455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f0706d9d700 1 --2- 172.21.15.27:0/456493473 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07080bbcd0 0x7f070814eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070659c700 1 -- 172.21.15.27:0/456493473 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07080bbcd0 msgr2=0x7f070814eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:00.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070659c700 1 --2- 172.21.15.27:0/456493473 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07080bbcd0 0x7f070814eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070659c700 1 -- 172.21.15.27:0/456493473 >> v2:172.21.15.123:3300/0 conn(0x7f070806b900 msgr2=0x7f07081455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:00.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070659c700 1 --2- 172.21.15.27:0/456493473 >> v2:172.21.15.123:3300/0 conn(0x7f070806b900 0x7f07081455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070659c700 1 -- 172.21.15.27:0/456493473 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0708069970 con 0x7f070806d3d0 2023-10-06T03:10:00.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f06fdd9b700 1 --2- 172.21.15.27:0/456493473 >> v2:172.21.15.123:3300/0 conn(0x7f070806b900 0x7f07081455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:10:00.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f070659c700 1 --2- 172.21.15.27:0/456493473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f070806d3d0 0x7f07081450a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0708069110 tx=0x7f06f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95c09508d619dae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f0705d9b700 1 -- 172.21.15.27:0/456493473 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f800b640 con 0x7f070806d3d0 2023-10-06T03:10:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f0705d9b700 1 -- 172.21.15.27:0/456493473 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f800b7a0 con 0x7f070806d3d0 2023-10-06T03:10:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.481+0000 7f0705d9b700 1 -- 172.21.15.27:0/456493473 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f800bb60 con 0x7f070806d3d0 2023-10-06T03:10:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.485+0000 7f070759e700 1 -- 172.21.15.27:0/456493473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f070806d3d0 msgr2=0x7f07081450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.485+0000 7f070759e700 1 --2- 172.21.15.27:0/456493473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f070806d3d0 0x7f07081450a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0708069110 tx=0x7f06f8009250 comp rx=0 tx=0).stop 2023-10-06T03:10:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.485+0000 7f070759e700 1 -- 172.21.15.27:0/456493473 shutdown_connections 2023-10-06T03:10:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.485+0000 7f070759e700 1 --2- 172.21.15.27:0/456493473 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07080bbcd0 0x7f070814eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.485+0000 7f070759e700 1 --2- 172.21.15.27:0/456493473 >> v2:172.21.15.123:3300/0 conn(0x7f070806b900 0x7f07081455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.485+0000 7f070759e700 1 --2- 172.21.15.27:0/456493473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f070806d3d0 0x7f07081450a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.485+0000 7f070759e700 1 -- 172.21.15.27:0/456493473 >> 172.21.15.27:0/456493473 conn(0x7f07080bae20 msgr2=0x7f07080bb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.485+0000 7f070759e700 1 -- 172.21.15.27:0/456493473 shutdown_connections 2023-10-06T03:10:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.485+0000 7f070759e700 1 -- 172.21.15.27:0/456493473 wait complete. 2023-10-06T03:10:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.485+0000 7f070759e700 1 Processor -- start 2023-10-06T03:10:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.485+0000 7f070759e700 1 -- start start 2023-10-06T03:10:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f070759e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f070806b900 0x7f070814a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f070759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070806d3d0 0x7f0708149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f070759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07080bbcd0 0x7f0708148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f070759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070815ab60 con 0x7f07080bbcd0 2023-10-06T03:10:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f070759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708146a30 con 0x7f070806d3d0 2023-10-06T03:10:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f070759e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070814a260 con 0x7f070806b900 2023-10-06T03:10:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f0706d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07080bbcd0 0x7f0708148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f06fdd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070806d3d0 0x7f0708149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f0706d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07080bbcd0 0x7f0708148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41322/0 (socket says 172.21.15.27:41322) 2023-10-06T03:10:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f0706d9d700 1 -- 172.21.15.27:0/2813833307 learned_addr learned my addr 172.21.15.27:0/2813833307 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f070659c700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f070806b900 0x7f070814a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f06fdd9b700 1 -- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f070806b900 msgr2=0x7f070814a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f06fdd9b700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f070806b900 0x7f070814a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f06fdd9b700 1 -- 172.21.15.27:0/2813833307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07080bbcd0 msgr2=0x7f0708148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f06fdd9b700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07080bbcd0 0x7f0708148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f06fdd9b700 1 -- 172.21.15.27:0/2813833307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f0009420 con 0x7f070806d3d0 2023-10-06T03:10:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f0706d9d700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07080bbcd0 0x7f0708148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:10:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f06fdd9b700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070806d3d0 0x7f0708149b90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06f000ecb0 tx=0x7f06f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f06feffd700 1 -- 172.21.15.27:0/2813833307 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f000c850 con 0x7f070806d3d0 2023-10-06T03:10:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f06feffd700 1 -- 172.21.15.27:0/2813833307 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f000c9b0 con 0x7f070806d3d0 2023-10-06T03:10:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f070759e700 1 -- 172.21.15.27:0/2813833307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f80094f0 con 0x7f070806d3d0 2023-10-06T03:10:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f06feffd700 1 -- 172.21.15.27:0/2813833307 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f000cd50 con 0x7f070806d3d0 2023-10-06T03:10:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f070759e700 1 -- 172.21.15.27:0/2813833307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0708148960 con 0x7f070806d3d0 2023-10-06T03:10:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.489+0000 7f070759e700 1 -- 172.21.15.27:0/2813833307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f070804be40 con 0x7f070806d3d0 2023-10-06T03:10:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.493+0000 7f06feffd700 1 -- 172.21.15.27:0/2813833307 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f06f0005a00 con 0x7f070806d3d0 2023-10-06T03:10:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.493+0000 7f06feffd700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f06e8060550 0x7f06e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.493+0000 7f06feffd700 1 -- 172.21.15.27:0/2813833307 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f06f007d140 con 0x7f070806d3d0 2023-10-06T03:10:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.493+0000 7f06feffd700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] conn(0x7f06e8068ec0 0x7f06e806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.493+0000 7f06feffd700 1 -- 172.21.15.27:0/2813833307 --> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06e806b9c0 con 0x7f06e8068ec0 2023-10-06T03:10:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.493+0000 7f06feffd700 1 -- 172.21.15.27:0/2813833307 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06f007d510 con 0x7f070806d3d0 2023-10-06T03:10:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.493+0000 7f070659c700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f06e8060550 0x7f06e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.493+0000 7f0706d9d700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] conn(0x7f06e8068ec0 0x7f06e806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.493+0000 7f0706d9d700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] conn(0x7f06e8068ec0 0x7f06e806b2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.493+0000 7f070659c700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f06e8060550 0x7f06e8062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0708069110 tx=0x7f06f8017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.497+0000 7f06feffd700 1 -- 172.21.15.27:0/2813833307 <== osd.4 v2:172.21.15.123:6816/33673 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f06e806b9c0 con 0x7f06e8068ec0 2023-10-06T03:10:00.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.513+0000 7f070759e700 1 -- 172.21.15.27:0/2813833307 --> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0708151220 con 0x7f06e8068ec0 2023-10-06T03:10:00.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.513+0000 7f06feffd700 1 -- 172.21.15.27:0/2813833307 <== osd.4 v2:172.21.15.123:6816/33673 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0708151220 con 0x7f06e8068ec0 2023-10-06T03:10:00.514 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-06T03:10:00.514 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:10:00.514 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-06T03:10:00.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.513+0000 7f070759e700 1 -- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] conn(0x7f06e8068ec0 msgr2=0x7f06e806b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.513+0000 7f070759e700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:6816/33673,v1:172.21.15.123:6818/33673] conn(0x7f06e8068ec0 0x7f06e806b2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.513+0000 7f070759e700 1 -- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f06e8060550 msgr2=0x7f06e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.513+0000 7f070759e700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f06e8060550 0x7f06e8062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0708069110 tx=0x7f06f8017000 comp rx=0 tx=0).stop 2023-10-06T03:10:00.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.513+0000 7f070759e700 1 -- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070806d3d0 msgr2=0x7f0708149b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.513+0000 7f070759e700 1 --2- 172.21.15.27:0/2813833307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070806d3d0 0x7f0708149b90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06f000ecb0 tx=0x7f06f00091a0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.513+0000 7f0706d9d700 1 -- 172.21.15.27:0/2813833307 reap_dead start 2023-10-06T03:10:00.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.513+0000 7f070759e700 1 -- 172.21.15.27:0/2813833307 shutdown_connections 2023-10-06T03:10:00.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.513+0000 7f070759e700 1 -- 172.21.15.27:0/2813833307 >> 172.21.15.27:0/2813833307 conn(0x7f07080bae20 msgr2=0x7f0708141d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:00.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.513+0000 7f070759e700 1 -- 172.21.15.27:0/2813833307 shutdown_connections 2023-10-06T03:10:00.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.513+0000 7f070759e700 1 -- 172.21.15.27:0/2813833307 wait complete. 2023-10-06T03:10:00.527 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T03:10:00.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd40adc3700 1 Processor -- start 2023-10-06T03:10:00.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd40adc3700 1 -- start start 2023-10-06T03:10:00.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd40adc3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd40406d3d0 0x7fd40406afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd40adc3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd40414eb60 0x7fd40414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd40adc3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd40414f4d0 0x7fd40414aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd40adc3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4040bacd0 con 0x7fd40414f4d0 2023-10-06T03:10:00.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd40adc3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd404069550 con 0x7fd40414eb60 2023-10-06T03:10:00.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd40adc3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40414f950 con 0x7fd40406d3d0 2023-10-06T03:10:00.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd40a5c2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd40414f4d0 0x7fd40414aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd4095c0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd40414eb60 0x7fd40414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd40a5c2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd40414f4d0 0x7fd40414aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41334/0 (socket says 172.21.15.27:41334) 2023-10-06T03:10:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd409dc1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd40406d3d0 0x7fd40406afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd40a5c2700 1 -- 172.21.15.27:0/2648296656 learned_addr learned my addr 172.21.15.27:0/2648296656 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd4095c0700 1 -- 172.21.15.27:0/2648296656 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd40406d3d0 msgr2=0x7fd40406afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd4095c0700 1 --2- 172.21.15.27:0/2648296656 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd40406d3d0 0x7fd40406afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd4095c0700 1 -- 172.21.15.27:0/2648296656 >> v2:172.21.15.27:3300/0 conn(0x7fd40414f4d0 msgr2=0x7fd40414aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd4095c0700 1 --2- 172.21.15.27:0/2648296656 >> v2:172.21.15.27:3300/0 conn(0x7fd40414f4d0 0x7fd40414aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd4095c0700 1 -- 172.21.15.27:0/2648296656 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40406b4f0 con 0x7fd40414eb60 2023-10-06T03:10:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd40a5c2700 1 --2- 172.21.15.27:0/2648296656 >> v2:172.21.15.27:3300/0 conn(0x7fd40414f4d0 0x7fd40414aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:10:00.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.637+0000 7fd4095c0700 1 --2- 172.21.15.27:0/2648296656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd40414eb60 0x7fd40414ef90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd404068770 tx=0x7fd3f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6d45f206613d936 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd408dbf700 1 -- 172.21.15.27:0/2648296656 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8011630 con 0x7fd40414eb60 2023-10-06T03:10:00.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd408dbf700 1 -- 172.21.15.27:0/2648296656 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f80117b0 con 0x7fd40414eb60 2023-10-06T03:10:00.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd408dbf700 1 -- 172.21.15.27:0/2648296656 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8011b70 con 0x7fd40414eb60 2023-10-06T03:10:00.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd40adc3700 1 -- 172.21.15.27:0/2648296656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd40414eb60 msgr2=0x7fd40414ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd40adc3700 1 --2- 172.21.15.27:0/2648296656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd40414eb60 0x7fd40414ef90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd404068770 tx=0x7fd3f80091a0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd40adc3700 1 -- 172.21.15.27:0/2648296656 shutdown_connections 2023-10-06T03:10:00.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd40adc3700 1 --2- 172.21.15.27:0/2648296656 >> v2:172.21.15.27:3300/0 conn(0x7fd40414f4d0 0x7fd40414aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd40adc3700 1 --2- 172.21.15.27:0/2648296656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd40414eb60 0x7fd40414ef90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd40adc3700 1 --2- 172.21.15.27:0/2648296656 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd40406d3d0 0x7fd40406afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd40adc3700 1 -- 172.21.15.27:0/2648296656 >> 172.21.15.27:0/2648296656 conn(0x7fd4040bee60 msgr2=0x7fd4040bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:00.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd40adc3700 1 -- 172.21.15.27:0/2648296656 shutdown_connections 2023-10-06T03:10:00.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd40adc3700 1 -- 172.21.15.27:0/2648296656 wait complete. 2023-10-06T03:10:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd40adc3700 1 Processor -- start 2023-10-06T03:10:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.641+0000 7fd40adc3700 1 -- start start 2023-10-06T03:10:00.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd40adc3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd40406d3d0 0x7fd4040b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd40adc3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd40414eb60 0x7fd404146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd40adc3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd40414f4d0 0x7fd4041467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd40adc3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040b7630 con 0x7fd40406d3d0 2023-10-06T03:10:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd40adc3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040b5df0 con 0x7fd40414eb60 2023-10-06T03:10:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd40adc3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040b9150 con 0x7fd40414f4d0 2023-10-06T03:10:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd409dc1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd40406d3d0 0x7fd4040b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd409dc1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd40406d3d0 0x7fd4040b8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41348/0 (socket says 172.21.15.27:41348) 2023-10-06T03:10:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd409dc1700 1 -- 172.21.15.27:0/3106194581 learned_addr learned my addr 172.21.15.27:0/3106194581 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd4095c0700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd40414eb60 0x7fd404146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd40a5c2700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd40414f4d0 0x7fd4041467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd409dc1700 1 -- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd40414f4d0 msgr2=0x7fd4041467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd409dc1700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd40414f4d0 0x7fd4041467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd409dc1700 1 -- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd40414eb60 msgr2=0x7fd404146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd409dc1700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd40414eb60 0x7fd404146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd409dc1700 1 -- 172.21.15.27:0/3106194581 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc009ae0 con 0x7fd40406d3d0 2023-10-06T03:10:00.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd40a5c2700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd40414f4d0 0x7fd4041467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:10:00.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd4095c0700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd40414eb60 0x7fd404146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:10:00.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd409dc1700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd40406d3d0 0x7fd4040b8c10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd40000e930 tx=0x7fd4000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd3f5ffb700 1 -- 172.21.15.27:0/3106194581 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40000eed0 con 0x7fd40406d3d0 2023-10-06T03:10:00.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd3f5ffb700 1 -- 172.21.15.27:0/3106194581 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40000c850 con 0x7fd40406d3d0 2023-10-06T03:10:00.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd40adc3700 1 -- 172.21.15.27:0/3106194581 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f8009420 con 0x7fd40406d3d0 2023-10-06T03:10:00.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd3f5ffb700 1 -- 172.21.15.27:0/3106194581 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40000cbf0 con 0x7fd40406d3d0 2023-10-06T03:10:00.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd40adc3700 1 -- 172.21.15.27:0/3106194581 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4040b5a80 con 0x7fd40406d3d0 2023-10-06T03:10:00.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.645+0000 7fd40adc3700 1 -- 172.21.15.27:0/3106194581 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4040bbf90 con 0x7fd40406d3d0 2023-10-06T03:10:00.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.649+0000 7fd3f5ffb700 1 -- 172.21.15.27:0/3106194581 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd400013470 con 0x7fd40406d3d0 2023-10-06T03:10:00.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.649+0000 7fd3f5ffb700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd3e8060550 0x7fd3e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.649+0000 7fd3f5ffb700 1 -- 172.21.15.27:0/3106194581 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fd40007cba0 con 0x7fd40406d3d0 2023-10-06T03:10:00.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.649+0000 7fd4095c0700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd3e8060550 0x7fd3e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.649+0000 7fd4095c0700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd3e8060550 0x7fd3e8062a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd404068770 tx=0x7fd3f8017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.657+0000 7fd3f5ffb700 1 -- 172.21.15.27:0/3106194581 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd40004cff0 con 0x7fd40406d3d0 2023-10-06T03:10:00.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.821+0000 7fd40adc3700 1 -- 172.21.15.27:0/3106194581 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd40404b600 con 0x7fd3e8060550 2023-10-06T03:10:00.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.821+0000 7fd3f5ffb700 1 -- 172.21.15.27:0/3106194581 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd40404b600 con 0x7fd3e8060550 2023-10-06T03:10:00.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.825+0000 7fd40adc3700 1 -- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd3e8060550 msgr2=0x7fd3e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.825+0000 7fd40adc3700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd3e8060550 0x7fd3e8062a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd404068770 tx=0x7fd3f8017000 comp rx=0 tx=0).stop 2023-10-06T03:10:00.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.825+0000 7fd40adc3700 1 -- 172.21.15.27:0/3106194581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd40406d3d0 msgr2=0x7fd4040b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.825+0000 7fd40adc3700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd40406d3d0 0x7fd4040b8c10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd40000e930 tx=0x7fd4000091a0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.825+0000 7fd40adc3700 1 -- 172.21.15.27:0/3106194581 shutdown_connections 2023-10-06T03:10:00.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.825+0000 7fd40adc3700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd3e8060550 0x7fd3e8062a00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.825+0000 7fd40adc3700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd40414f4d0 0x7fd4041467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.825+0000 7fd40adc3700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd40414eb60 0x7fd404146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.825+0000 7fd40adc3700 1 --2- 172.21.15.27:0/3106194581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd40406d3d0 0x7fd4040b8c10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.825+0000 7fd40adc3700 1 -- 172.21.15.27:0/3106194581 >> 172.21.15.27:0/3106194581 conn(0x7fd4040bee60 msgr2=0x7fd4040bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:00.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.825+0000 7fd40adc3700 1 -- 172.21.15.27:0/3106194581 shutdown_connections 2023-10-06T03:10:00.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.825+0000 7fd40adc3700 1 -- 172.21.15.27:0/3106194581 wait complete. 2023-10-06T03:10:00.828 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T03:10:00.838 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T03:10:00.838 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:10:00.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.945+0000 7f6dd9ed3700 1 Processor -- start 2023-10-06T03:10:00.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.945+0000 7f6dd9ed3700 1 -- start start 2023-10-06T03:10:00.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd9ed3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6dd4147980 0x7f6dd40a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd9ed3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6dd409cee0 0x7f6dd4147d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd9ed3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd4149030 con 0x7f6dd40a36d0 2023-10-06T03:10:00.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd9ed3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd4149310 con 0x7f6dd4147980 2023-10-06T03:10:00.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd9ed3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd40a3190 con 0x7f6dd409cee0 2023-10-06T03:10:00.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd96d2700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6dd40a36d0 0x7f6dd406c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54742/0 (socket says 172.21.15.27:54742) 2023-10-06T03:10:00.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd96d2700 1 -- 172.21.15.27:0/3621216045 learned_addr learned my addr 172.21.15.27:0/3621216045 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:10:00.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd8ed1700 1 --2- 172.21.15.27:0/3621216045 >> v2:172.21.15.27:3300/0 conn(0x7f6dd4147980 0x7f6dd40a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd3fff700 1 --2- 172.21.15.27:0/3621216045 >> v2:172.21.15.123:3300/0 conn(0x7f6dd409cee0 0x7f6dd4147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd37fe700 1 -- 172.21.15.27:0/3621216045 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686185431 0 0) 0x7f6dd4149030 con 0x7f6dd40a36d0 2023-10-06T03:10:00.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd37fe700 1 -- 172.21.15.27:0/3621216045 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dbc003570 con 0x7f6dd40a36d0 2023-10-06T03:10:00.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd3fff700 1 -- 172.21.15.27:0/3621216045 >> v2:172.21.15.27:3300/0 conn(0x7f6dd4147980 msgr2=0x7f6dd40a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:00.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd3fff700 1 --2- 172.21.15.27:0/3621216045 >> v2:172.21.15.27:3300/0 conn(0x7f6dd4147980 0x7f6dd40a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd3fff700 1 -- 172.21.15.27:0/3621216045 >> v1:172.21.15.27:6789/0 conn(0x7f6dd40a36d0 legacy=0x7f6dd406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd37fe700 1 -- 172.21.15.27:0/3621216045 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4144513877 0 0) 0x7f6dbc003570 con 0x7f6dd40a36d0 2023-10-06T03:10:00.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd3fff700 1 -- 172.21.15.27:0/3621216045 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd406d020 con 0x7f6dd409cee0 2023-10-06T03:10:00.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd3fff700 1 --2- 172.21.15.27:0/3621216045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dd409cee0 0x7f6dd4147d50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6dd406dad0 tx=0x7f6dc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9535c314a4604605 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd37fe700 1 -- 172.21.15.27:0/3621216045 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc0017f0 con 0x7f6dd409cee0 2023-10-06T03:10:00.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd37fe700 1 -- 172.21.15.27:0/3621216045 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc8011420 con 0x7f6dd409cee0 2023-10-06T03:10:00.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd37fe700 1 -- 172.21.15.27:0/3621216045 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80117a0 con 0x7f6dd409cee0 2023-10-06T03:10:00.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/3621216045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dd409cee0 msgr2=0x7f6dd4147d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd9ed3700 1 --2- 172.21.15.27:0/3621216045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dd409cee0 0x7f6dd4147d50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6dd406dad0 tx=0x7f6dc80091a0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/3621216045 shutdown_connections 2023-10-06T03:10:00.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd9ed3700 1 --2- 172.21.15.27:0/3621216045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dd409cee0 0x7f6dd4147d50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.949+0000 7f6dd9ed3700 1 --2- 172.21.15.27:0/3621216045 >> v2:172.21.15.27:3300/0 conn(0x7f6dd4147980 0x7f6dd40a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.953+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/3621216045 >> 172.21.15.27:0/3621216045 conn(0x7f6dd406eb00 msgr2=0x7f6dd40ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:00.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.953+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/3621216045 shutdown_connections 2023-10-06T03:10:00.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.953+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/3621216045 wait complete. 2023-10-06T03:10:00.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.953+0000 7f6dd9ed3700 1 Processor -- start 2023-10-06T03:10:00.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.953+0000 7f6dd9ed3700 1 -- start start 2023-10-06T03:10:00.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd9ed3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dd409cee0 0x7f6dd4146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd9ed3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dd40a36d0 0x7f6dd415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd9ed3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6dd4147980 0x7f6dd4149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd9ed3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd414a970 con 0x7f6dd409cee0 2023-10-06T03:10:00.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd9ed3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd406b010 con 0x7f6dd40a36d0 2023-10-06T03:10:00.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd9ed3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4149880 con 0x7f6dd4147980 2023-10-06T03:10:00.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd8ed1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dd409cee0 0x7f6dd4146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd8ed1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dd409cee0 0x7f6dd4146680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41372/0 (socket says 172.21.15.27:41372) 2023-10-06T03:10:00.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd8ed1700 1 -- 172.21.15.27:0/2953233182 learned_addr learned my addr 172.21.15.27:0/2953233182 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:00.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd3fff700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dd40a36d0 0x7f6dd415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd96d2700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6dd4147980 0x7f6dd4149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd8ed1700 1 -- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6dd4147980 msgr2=0x7f6dd4149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd8ed1700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6dd4147980 0x7f6dd4149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd8ed1700 1 -- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dd40a36d0 msgr2=0x7f6dd415a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd8ed1700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dd40a36d0 0x7f6dd415a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd8ed1700 1 -- 172.21.15.27:0/2953233182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc8009420 con 0x7f6dd409cee0 2023-10-06T03:10:00.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd3fff700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dd40a36d0 0x7f6dd415a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:10:00.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd8ed1700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dd409cee0 0x7f6dd4146680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400e930 tx=0x7f6dc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd0ff9700 1 -- 172.21.15.27:0/2953233182 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4013680 con 0x7f6dd409cee0 2023-10-06T03:10:00.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd0ff9700 1 -- 172.21.15.27:0/2953233182 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc40137e0 con 0x7f6dd409cee0 2023-10-06T03:10:00.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/2953233182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd406b260 con 0x7f6dd409cee0 2023-10-06T03:10:00.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd0ff9700 1 -- 172.21.15.27:0/2953233182 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4013b80 con 0x7f6dd409cee0 2023-10-06T03:10:00.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/2953233182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd406a0b0 con 0x7f6dd409cee0 2023-10-06T03:10:00.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.957+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/2953233182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6dd404be40 con 0x7f6dd409cee0 2023-10-06T03:10:00.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.961+0000 7f6dd0ff9700 1 -- 172.21.15.27:0/2953233182 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6dc4025420 con 0x7f6dd409cee0 2023-10-06T03:10:00.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.961+0000 7f6dd0ff9700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6dc0060550 0x7f6dc0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.961+0000 7f6dd0ff9700 1 -- 172.21.15.27:0/2953233182 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f6dc407ce20 con 0x7f6dd409cee0 2023-10-06T03:10:00.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.961+0000 7f6dd0ff9700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] conn(0x7f6dc0068e40 0x7f6dc006b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:00.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.961+0000 7f6dd0ff9700 1 -- 172.21.15.27:0/2953233182 --> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6dc006b940 con 0x7f6dc0068e40 2023-10-06T03:10:00.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.961+0000 7f6dd0ff9700 1 -- 172.21.15.27:0/2953233182 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6dc407d1f0 con 0x7f6dd409cee0 2023-10-06T03:10:00.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.961+0000 7f6dd3fff700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6dc0060550 0x7f6dc0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.961+0000 7f6dd96d2700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] conn(0x7f6dc0068e40 0x7f6dc006b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:00.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.961+0000 7f6dd3fff700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6dc0060550 0x7f6dc0062a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6dd406dad0 tx=0x7f6dc8016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.965+0000 7f6dd96d2700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] conn(0x7f6dc0068e40 0x7f6dc006b270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:00.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.965+0000 7f6dd0ff9700 1 -- 172.21.15.27:0/2953233182 <== osd.5 v2:172.21.15.123:6800/33671 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6dc006b940 con 0x7f6dc0068e40 2023-10-06T03:10:00.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.981+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/2953233182 --> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6dd406a360 con 0x7f6dc0068e40 2023-10-06T03:10:00.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.981+0000 7f6dd0ff9700 1 -- 172.21.15.27:0/2953233182 <== osd.5 v2:172.21.15.123:6800/33671 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6dd406a360 con 0x7f6dc0068e40 2023-10-06T03:10:00.984 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-06T03:10:00.984 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:10:00.984 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-06T03:10:00.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.981+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] conn(0x7f6dc0068e40 msgr2=0x7f6dc006b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.981+0000 7f6dd9ed3700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:6800/33671,v1:172.21.15.123:6801/33671] conn(0x7f6dc0068e40 0x7f6dc006b270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.981+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6dc0060550 msgr2=0x7f6dc0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.985+0000 7f6dd9ed3700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6dc0060550 0x7f6dc0062a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6dd406dad0 tx=0x7f6dc8016000 comp rx=0 tx=0).stop 2023-10-06T03:10:00.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.985+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/2953233182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dd409cee0 msgr2=0x7f6dd4146680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:00.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.985+0000 7f6dd9ed3700 1 --2- 172.21.15.27:0/2953233182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6dd409cee0 0x7f6dd4146680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400e930 tx=0x7f6dc40091a0 comp rx=0 tx=0).stop 2023-10-06T03:10:00.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.985+0000 7f6dd96d2700 1 -- 172.21.15.27:0/2953233182 reap_dead start 2023-10-06T03:10:00.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.985+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/2953233182 shutdown_connections 2023-10-06T03:10:00.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.985+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/2953233182 >> 172.21.15.27:0/2953233182 conn(0x7f6dd406eb00 msgr2=0x7f6dd406c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:00.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.985+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/2953233182 shutdown_connections 2023-10-06T03:10:00.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:00.985+0000 7f6dd9ed3700 1 -- 172.21.15.27:0/2953233182 wait complete. 2023-10-06T03:10:00.996 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T03:10:01.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.109+0000 7f3d8b59e700 1 Processor -- start 2023-10-06T03:10:01.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.109+0000 7f3d8b59e700 1 -- start start 2023-10-06T03:10:01.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8b59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d8c0a4760 0x7f3d8c14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8b59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c0a18e0 con 0x7f3d8c0b7f40 2023-10-06T03:10:01.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8b59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c14f970 con 0x7f3d8c14aed0 2023-10-06T03:10:01.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8b59e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0bdbb0 con 0x7f3d8c0a4760 2023-10-06T03:10:01.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8ad9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3d8c0b7f40 0x7f3d8c14c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54758/0 (socket says 172.21.15.27:54758) 2023-10-06T03:10:01.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8ad9d700 1 -- 172.21.15.27:0/123081763 learned_addr learned my addr 172.21.15.27:0/123081763 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:10:01.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d89d9b700 1 --2- 172.21.15.27:0/123081763 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d8c0a4760 0x7f3d8c14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621299525 0 0) 0x7f3d8c0a18e0 con 0x7f3d8c0b7f40 2023-10-06T03:10:01.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d78003570 con 0x7f3d8c0b7f40 2023-10-06T03:10:01.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2903935399 0 0) 0x7f3d78003570 con 0x7f3d8c0b7f40 2023-10-06T03:10:01.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d8c0a4760 msgr2=0x7f3d8c14b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 --2- 172.21.15.27:0/123081763 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d8c0a4760 0x7f3d8c14b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 >> v1:172.21.15.123:6789/0 conn(0x7f3d8c14aed0 legacy=0x7f3d8c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c14c950 con 0x7f3d8c0b7f40 2023-10-06T03:10:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1323929577 0 0) 0x7f3d7c0017f0 con 0x7f3d8c0b7f40 2023-10-06T03:10:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 >> v1:172.21.15.27:6789/0 conn(0x7f3d8c0b7f40 legacy=0x7f3d8c14c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 --2- 172.21.15.27:0/123081763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d78003a90 0x7f3d78003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 --2- 172.21.15.27:0/123081763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d78004810 0x7f3d78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 --2- 172.21.15.27:0/123081763 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d8c0a4760 0x7f3d780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0bdbb0 con 0x7f3d78003a90 2023-10-06T03:10:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7800bb40 con 0x7f3d78004810 2023-10-06T03:10:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7800bd00 con 0x7f3d8c0a4760 2023-10-06T03:10:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8a59c700 1 --2- 172.21.15.27:0/123081763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d78003a90 0x7f3d78003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8ad9d700 1 --2- 172.21.15.27:0/123081763 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d8c0a4760 0x7f3d780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d89d9b700 1 --2- 172.21.15.27:0/123081763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d78004810 0x7f3d78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8a59c700 1 -- 172.21.15.27:0/123081763 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d8c0a4760 msgr2=0x7f3d780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8a59c700 1 --2- 172.21.15.27:0/123081763 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d8c0a4760 0x7f3d780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8a59c700 1 -- 172.21.15.27:0/123081763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d78004810 msgr2=0x7f3d78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8a59c700 1 --2- 172.21.15.27:0/123081763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d78004810 0x7f3d78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8a59c700 1 -- 172.21.15.27:0/123081763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d78003570 con 0x7f3d78003a90 2023-10-06T03:10:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8a59c700 1 --2- 172.21.15.27:0/123081763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d78003a90 0x7f3d78003e60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3d840019a0 tx=0x7f3d84007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67d62cec9d1f9c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400c5d0 con 0x7f3d78003a90 2023-10-06T03:10:01.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8400c730 con 0x7f3d78003a90 2023-10-06T03:10:01.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.113+0000 7f3d8959a700 1 -- 172.21.15.27:0/123081763 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400cad0 con 0x7f3d78003a90 2023-10-06T03:10:01.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 -- 172.21.15.27:0/123081763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d78003a90 msgr2=0x7f3d78003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 --2- 172.21.15.27:0/123081763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d78003a90 0x7f3d78003e60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3d840019a0 tx=0x7f3d84007d10 comp rx=0 tx=0).stop 2023-10-06T03:10:01.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8ad9d700 1 -- 172.21.15.27:0/123081763 reap_dead start 2023-10-06T03:10:01.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 -- 172.21.15.27:0/123081763 shutdown_connections 2023-10-06T03:10:01.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 -- 172.21.15.27:0/123081763 >> 172.21.15.27:0/123081763 conn(0x7f3d8c0beae0 msgr2=0x7f3d8c0beee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:01.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 -- 172.21.15.27:0/123081763 shutdown_connections 2023-10-06T03:10:01.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 -- 172.21.15.27:0/123081763 wait complete. 2023-10-06T03:10:01.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 Processor -- start 2023-10-06T03:10:01.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 -- start start 2023-10-06T03:10:01.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d78003a90 0x7f3d8c0a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d8c14efa0 0x7f3d8c15e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d8c0ba450 0x7f3d8c148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0b8830 con 0x7f3d8c0ba450 2023-10-06T03:10:01.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0a5620 con 0x7f3d78003a90 2023-10-06T03:10:01.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8b59e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0a52f0 con 0x7f3d8c14efa0 2023-10-06T03:10:01.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d8c0ba450 0x7f3d8c148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d8c0ba450 0x7f3d8c148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41382/0 (socket says 172.21.15.27:41382) 2023-10-06T03:10:01.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8ad9d700 1 -- 172.21.15.27:0/1453281815 learned_addr learned my addr 172.21.15.27:0/1453281815 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:01.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.117+0000 7f3d8a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d78003a90 0x7f3d8c0a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d89d9b700 1 --2- 172.21.15.27:0/1453281815 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d8c14efa0 0x7f3d8c15e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d8ad9d700 1 -- 172.21.15.27:0/1453281815 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d8c14efa0 msgr2=0x7f3d8c15e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d8ad9d700 1 --2- 172.21.15.27:0/1453281815 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d8c14efa0 0x7f3d8c15e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d8ad9d700 1 -- 172.21.15.27:0/1453281815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d78003a90 msgr2=0x7f3d8c0a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d8ad9d700 1 --2- 172.21.15.27:0/1453281815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d78003a90 0x7f3d8c0a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d8ad9d700 1 -- 172.21.15.27:0/1453281815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c0a0110 con 0x7f3d8c0ba450 2023-10-06T03:10:01.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d8ad9d700 1 --2- 172.21.15.27:0/1453281815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d8c0ba450 0x7f3d8c148400 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c088070 tx=0x7f3d8c14f8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d827fc700 1 -- 172.21.15.27:0/1453281815 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c007b60 con 0x7f3d8c0ba450 2023-10-06T03:10:01.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d827fc700 1 -- 172.21.15.27:0/1453281815 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c00ad30 con 0x7f3d8c0ba450 2023-10-06T03:10:01.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d8b59e700 1 -- 172.21.15.27:0/1453281815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c0a0930 con 0x7f3d8c0ba450 2023-10-06T03:10:01.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d827fc700 1 -- 172.21.15.27:0/1453281815 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00aea0 con 0x7f3d8c0ba450 2023-10-06T03:10:01.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d8b59e700 1 -- 172.21.15.27:0/1453281815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c15ede0 con 0x7f3d8c0ba450 2023-10-06T03:10:01.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d8b59e700 1 -- 172.21.15.27:0/1453281815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8c087a70 con 0x7f3d8c0ba450 2023-10-06T03:10:01.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.121+0000 7f3d827fc700 1 -- 172.21.15.27:0/1453281815 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3d7c0138f0 con 0x7f3d8c0ba450 2023-10-06T03:10:01.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.125+0000 7f3d827fc700 1 --2- 172.21.15.27:0/1453281815 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3d6c060550 0x7f3d6c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.125+0000 7f3d827fc700 1 -- 172.21.15.27:0/1453281815 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f3d7c07cfa0 con 0x7f3d8c0ba450 2023-10-06T03:10:01.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.125+0000 7f3d8a59c700 1 --2- 172.21.15.27:0/1453281815 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3d6c060550 0x7f3d6c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.125+0000 7f3d8a59c700 1 --2- 172.21.15.27:0/1453281815 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3d6c060550 0x7f3d6c062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3d84008fd0 tx=0x7f3d84015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.129+0000 7f3d827fc700 1 -- 172.21.15.27:0/1453281815 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3d7c04d3f0 con 0x7f3d8c0ba450 2023-10-06T03:10:01.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.289+0000 7f3d8b59e700 1 -- 172.21.15.27:0/1453281815 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d8c0a5760 con 0x7f3d6c060550 2023-10-06T03:10:01.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.289+0000 7f3d827fc700 1 -- 172.21.15.27:0/1453281815 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3d8c0a5760 con 0x7f3d6c060550 2023-10-06T03:10:01.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.293+0000 7f3d8b59e700 1 -- 172.21.15.27:0/1453281815 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3d6c060550 msgr2=0x7f3d6c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.293+0000 7f3d8b59e700 1 --2- 172.21.15.27:0/1453281815 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3d6c060550 0x7f3d6c062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3d84008fd0 tx=0x7f3d84015000 comp rx=0 tx=0).stop 2023-10-06T03:10:01.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.293+0000 7f3d8b59e700 1 -- 172.21.15.27:0/1453281815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d8c0ba450 msgr2=0x7f3d8c148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.293+0000 7f3d8b59e700 1 --2- 172.21.15.27:0/1453281815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d8c0ba450 0x7f3d8c148400 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c088070 tx=0x7f3d8c14f8e0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.293+0000 7f3d8b59e700 1 -- 172.21.15.27:0/1453281815 shutdown_connections 2023-10-06T03:10:01.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.293+0000 7f3d8b59e700 1 --2- 172.21.15.27:0/1453281815 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3d6c060550 0x7f3d6c062a00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.293+0000 7f3d8b59e700 1 --2- 172.21.15.27:0/1453281815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d8c0ba450 0x7f3d8c148400 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.293+0000 7f3d8b59e700 1 --2- 172.21.15.27:0/1453281815 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d8c14efa0 0x7f3d8c15e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.293+0000 7f3d8b59e700 1 --2- 172.21.15.27:0/1453281815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d78003a90 0x7f3d8c0a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.293+0000 7f3d8b59e700 1 -- 172.21.15.27:0/1453281815 >> 172.21.15.27:0/1453281815 conn(0x7f3d8c0beae0 msgr2=0x7f3d8c14a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:01.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.293+0000 7f3d8b59e700 1 -- 172.21.15.27:0/1453281815 shutdown_connections 2023-10-06T03:10:01.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.293+0000 7f3d8b59e700 1 -- 172.21.15.27:0/1453281815 wait complete. 2023-10-06T03:10:01.295 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T03:10:01.306 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T03:10:01.306 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:10:01.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.417+0000 7f3c4a5ea700 1 Processor -- start 2023-10-06T03:10:01.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.417+0000 7f3c4a5ea700 1 -- start start 2023-10-06T03:10:01.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c4a5ea700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3c440be530 0x7f3c4406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c4a5ea700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c440b5520 0x7f3c440a3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c4a5ea700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c440bd2e0 con 0x7f3c440a3c20 2023-10-06T03:10:01.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c4a5ea700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c440a7970 con 0x7f3c440be530 2023-10-06T03:10:01.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c4a5ea700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440a54e0 con 0x7f3c440b5520 2023-10-06T03:10:01.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c49de9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c440b5520 0x7f3c440a3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c48de7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3c440be530 0x7f3c4406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c49de9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c440b5520 0x7f3c440a3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.27:56916/0 (socket says 172.21.15.27:56916) 2023-10-06T03:10:01.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c495e8700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3c440a3c20 0x7f3c440a4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.27:35890/0 (socket says 172.21.15.27:35890) 2023-10-06T03:10:01.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c48de7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3c440be530 0x7f3c4406ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:46874/0 (socket says 172.21.15.27:46874) 2023-10-06T03:10:01.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c49de9700 1 -- 172.21.15.27:0/1698476601 learned_addr learned my addr 172.21.15.27:0/1698476601 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:01.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c49de9700 1 -- 172.21.15.27:0/1698476601 >> v2:172.21.15.123:3300/0 conn(0x7f3c440be530 msgr2=0x7f3c4406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:01.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c49de9700 1 --2- 172.21.15.27:0/1698476601 >> v2:172.21.15.123:3300/0 conn(0x7f3c440be530 0x7f3c4406ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c49de9700 1 -- 172.21.15.27:0/1698476601 >> v1:172.21.15.123:6789/0 conn(0x7f3c440a3c20 legacy=0x7f3c440a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c49de9700 1 -- 172.21.15.27:0/1698476601 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c440bd530 con 0x7f3c440b5520 2023-10-06T03:10:01.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c49de9700 1 --2- 172.21.15.27:0/1698476601 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c440b5520 0x7f3c440a3ff0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009f20 tx=0x7f3c3c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbe5dea9f1672fa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c3bfff700 1 -- 172.21.15.27:0/1698476601 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00e070 con 0x7f3c440b5520 2023-10-06T03:10:01.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c3bfff700 1 -- 172.21.15.27:0/1698476601 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c00b9d0 con 0x7f3c440b5520 2023-10-06T03:10:01.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c3bfff700 1 -- 172.21.15.27:0/1698476601 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0092e0 con 0x7f3c440b5520 2023-10-06T03:10:01.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/1698476601 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c440b5520 msgr2=0x7f3c440a3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c4a5ea700 1 --2- 172.21.15.27:0/1698476601 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c440b5520 0x7f3c440a3ff0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009f20 tx=0x7f3c3c009840 comp rx=0 tx=0).stop 2023-10-06T03:10:01.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/1698476601 shutdown_connections 2023-10-06T03:10:01.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c4a5ea700 1 --2- 172.21.15.27:0/1698476601 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c440b5520 0x7f3c440a3ff0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c4a5ea700 1 --2- 172.21.15.27:0/1698476601 >> v2:172.21.15.123:3300/0 conn(0x7f3c440be530 0x7f3c4406ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/1698476601 >> 172.21.15.27:0/1698476601 conn(0x7f3c440bf440 msgr2=0x7f3c4406df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:01.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/1698476601 shutdown_connections 2023-10-06T03:10:01.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.421+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/1698476601 wait complete. 2023-10-06T03:10:01.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c4a5ea700 1 Processor -- start 2023-10-06T03:10:01.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c4a5ea700 1 -- start start 2023-10-06T03:10:01.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c4a5ea700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c440a3c20 0x7f3c4415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c4a5ea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c440b5520 0x7f3c440b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c4a5ea700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c440b58f0 0x7f3c4414d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c4a5ea700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440ba250 con 0x7f3c440a3c20 2023-10-06T03:10:01.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c4a5ea700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440bc1f0 con 0x7f3c440b5520 2023-10-06T03:10:01.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c4a5ea700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4414ddf0 con 0x7f3c440b58f0 2023-10-06T03:10:01.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c495e8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c440a3c20 0x7f3c4415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c495e8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c440a3c20 0x7f3c4415ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41386/0 (socket says 172.21.15.27:41386) 2023-10-06T03:10:01.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c48de7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c440b5520 0x7f3c440b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c495e8700 1 -- 172.21.15.27:0/2569053685 learned_addr learned my addr 172.21.15.27:0/2569053685 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:01.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c49de9700 1 --2- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c440b58f0 0x7f3c4414d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c48de7700 1 -- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c440b58f0 msgr2=0x7f3c4414d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c48de7700 1 --2- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c440b58f0 0x7f3c4414d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c48de7700 1 -- 172.21.15.27:0/2569053685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c440a3c20 msgr2=0x7f3c4415ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c48de7700 1 --2- 172.21.15.27:0/2569053685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c440a3c20 0x7f3c4415ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.425+0000 7f3c48de7700 1 -- 172.21.15.27:0/2569053685 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c009ae0 con 0x7f3c440b5520 2023-10-06T03:10:01.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.429+0000 7f3c48de7700 1 --2- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c440b5520 0x7f3c440b5f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400e900 tx=0x7f3c340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.429+0000 7f3c397fa700 1 -- 172.21.15.27:0/2569053685 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34013680 con 0x7f3c440b5520 2023-10-06T03:10:01.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.429+0000 7f3c397fa700 1 -- 172.21.15.27:0/2569053685 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c340137e0 con 0x7f3c440b5520 2023-10-06T03:10:01.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.429+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/2569053685 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4415c100 con 0x7f3c440b5520 2023-10-06T03:10:01.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.429+0000 7f3c397fa700 1 -- 172.21.15.27:0/2569053685 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34013b80 con 0x7f3c440b5520 2023-10-06T03:10:01.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.429+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/2569053685 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c440ba6e0 con 0x7f3c440b5520 2023-10-06T03:10:01.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.429+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/2569053685 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c4404be40 con 0x7f3c440b5520 2023-10-06T03:10:01.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.429+0000 7f3c397fa700 1 -- 172.21.15.27:0/2569053685 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3c34025420 con 0x7f3c440b5520 2023-10-06T03:10:01.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.433+0000 7f3c397fa700 1 --2- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3c28060580 0x7f3c28062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.433+0000 7f3c397fa700 1 -- 172.21.15.27:0/2569053685 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f3c3407ccc0 con 0x7f3c440b5520 2023-10-06T03:10:01.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.433+0000 7f3c397fa700 1 --2- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] conn(0x7f3c28068ef0 0x7f3c2806b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.433+0000 7f3c397fa700 1 -- 172.21.15.27:0/2569053685 --> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c2806b9f0 con 0x7f3c28068ef0 2023-10-06T03:10:01.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.433+0000 7f3c397fa700 1 -- 172.21.15.27:0/2569053685 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c3407d090 con 0x7f3c440b5520 2023-10-06T03:10:01.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.433+0000 7f3c495e8700 1 --2- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3c28060580 0x7f3c28062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.433+0000 7f3c49de9700 1 --2- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] conn(0x7f3c28068ef0 0x7f3c2806b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.433+0000 7f3c495e8700 1 --2- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3c28060580 0x7f3c28062a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3c40004fd0 tx=0x7f3c40007f70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.433+0000 7f3c49de9700 1 --2- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] conn(0x7f3c28068ef0 0x7f3c2806b320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.433+0000 7f3c397fa700 1 -- 172.21.15.27:0/2569053685 <== osd.6 v2:172.21.15.123:6817/33672 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3c2806b9f0 con 0x7f3c28068ef0 2023-10-06T03:10:01.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.453+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/2569053685 --> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3c440ba080 con 0x7f3c28068ef0 2023-10-06T03:10:01.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.453+0000 7f3c397fa700 1 -- 172.21.15.27:0/2569053685 <== osd.6 v2:172.21.15.123:6817/33672 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3c440ba080 con 0x7f3c28068ef0 2023-10-06T03:10:01.454 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-06T03:10:01.454 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:10:01.454 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-06T03:10:01.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.453+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] conn(0x7f3c28068ef0 msgr2=0x7f3c2806b320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.453+0000 7f3c4a5ea700 1 --2- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:6817/33672,v1:172.21.15.123:6820/33672] conn(0x7f3c28068ef0 0x7f3c2806b320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.453+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3c28060580 msgr2=0x7f3c28062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.453+0000 7f3c4a5ea700 1 --2- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3c28060580 0x7f3c28062a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3c40004fd0 tx=0x7f3c40007f70 comp rx=0 tx=0).stop 2023-10-06T03:10:01.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.453+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c440b5520 msgr2=0x7f3c440b5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.453+0000 7f3c4a5ea700 1 --2- 172.21.15.27:0/2569053685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c440b5520 0x7f3c440b5f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400e900 tx=0x7f3c340091a0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.453+0000 7f3c49de9700 1 -- 172.21.15.27:0/2569053685 reap_dead start 2023-10-06T03:10:01.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.453+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/2569053685 shutdown_connections 2023-10-06T03:10:01.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.453+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/2569053685 >> 172.21.15.27:0/2569053685 conn(0x7f3c440bf440 msgr2=0x7f3c4406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:01.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.453+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/2569053685 shutdown_connections 2023-10-06T03:10:01.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.453+0000 7f3c4a5ea700 1 -- 172.21.15.27:0/2569053685 wait complete. 2023-10-06T03:10:01.467 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T03:10:01.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.577+0000 7f87c4223700 1 Processor -- start 2023-10-06T03:10:01.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.577+0000 7f87c4223700 1 -- start start 2023-10-06T03:10:01.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.577+0000 7f87c4223700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87bc0bb1f0 0x7f87bc148d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.577+0000 7f87c4223700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87bc06ad80 con 0x7f87bc068ae0 2023-10-06T03:10:01.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c4223700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87bc14c870 con 0x7f87bc0bae20 2023-10-06T03:10:01.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c4223700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0bb630 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c17be700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f87bc068ae0 0x7f87bc148630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54760/0 (socket says 172.21.15.27:54760) 2023-10-06T03:10:01.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c17be700 1 -- 172.21.15.27:0/964559774 learned_addr learned my addr 172.21.15.27:0/964559774 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:10:01.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c27c0700 1 --2- 172.21.15.27:0/964559774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87bc0bb1f0 0x7f87bc148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c0fbd700 1 -- 172.21.15.27:0/964559774 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151100739 0 0) 0x7f87bc06ad80 con 0x7f87bc068ae0 2023-10-06T03:10:01.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c0fbd700 1 -- 172.21.15.27:0/964559774 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87a8003570 con 0x7f87bc068ae0 2023-10-06T03:10:01.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c0fbd700 1 -- 172.21.15.27:0/964559774 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890216390 0 0) 0x7f87bc14c870 con 0x7f87bc0bae20 2023-10-06T03:10:01.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c0fbd700 1 -- 172.21.15.27:0/964559774 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87bc06ad80 con 0x7f87bc0bae20 2023-10-06T03:10:01.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c27c0700 1 -- 172.21.15.27:0/964559774 >> v1:172.21.15.123:6789/0 conn(0x7f87bc0bae20 legacy=0x7f87bc069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c27c0700 1 -- 172.21.15.27:0/964559774 >> v1:172.21.15.27:6789/0 conn(0x7f87bc068ae0 legacy=0x7f87bc148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c27c0700 1 -- 172.21.15.27:0/964559774 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc0695e0 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c27c0700 1 --2- 172.21.15.27:0/964559774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87bc0bb1f0 0x7f87bc148d40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009e90 tx=0x7f87b4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f27f695f4bc41efc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c0fbd700 1 -- 172.21.15.27:0/964559774 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b400e070 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c0fbd700 1 -- 172.21.15.27:0/964559774 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b400bb80 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c0fbd700 1 -- 172.21.15.27:0/964559774 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4012430 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c4223700 1 -- 172.21.15.27:0/964559774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87bc0bb1f0 msgr2=0x7f87bc148d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c4223700 1 --2- 172.21.15.27:0/964559774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87bc0bb1f0 0x7f87bc148d40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009e90 tx=0x7f87b4009780 comp rx=0 tx=0).stop 2023-10-06T03:10:01.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c4223700 1 -- 172.21.15.27:0/964559774 shutdown_connections 2023-10-06T03:10:01.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c4223700 1 --2- 172.21.15.27:0/964559774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87bc0bb1f0 0x7f87bc148d40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c4223700 1 -- 172.21.15.27:0/964559774 >> 172.21.15.27:0/964559774 conn(0x7f87bc0be770 msgr2=0x7f87bc0ba710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:01.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c4223700 1 -- 172.21.15.27:0/964559774 shutdown_connections 2023-10-06T03:10:01.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.581+0000 7f87c4223700 1 -- 172.21.15.27:0/964559774 wait complete. 2023-10-06T03:10:01.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c4223700 1 Processor -- start 2023-10-06T03:10:01.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c4223700 1 -- start start 2023-10-06T03:10:01.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c4223700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87bc068ae0 0x7f87bc15b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c4223700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87bc0bae20 0x7f87bc0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c4223700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87bc0bb1f0 0x7f87bc157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c4223700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0a6390 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c4223700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc15bda0 con 0x7f87bc068ae0 2023-10-06T03:10:01.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c4223700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc14f360 con 0x7f87bc0bae20 2023-10-06T03:10:01.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c27c0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87bc0bb1f0 0x7f87bc157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c27c0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87bc0bb1f0 0x7f87bc157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41390/0 (socket says 172.21.15.27:41390) 2023-10-06T03:10:01.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c27c0700 1 -- 172.21.15.27:0/2692053744 learned_addr learned my addr 172.21.15.27:0/2692053744 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:01.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c1fbf700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87bc068ae0 0x7f87bc15b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c17be700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87bc0bae20 0x7f87bc0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c27c0700 1 -- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87bc0bae20 msgr2=0x7f87bc0b7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c27c0700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87bc0bae20 0x7f87bc0b7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c27c0700 1 -- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87bc068ae0 msgr2=0x7f87bc15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c27c0700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87bc068ae0 0x7f87bc15b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c27c0700 1 -- 172.21.15.27:0/2692053744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b4009a20 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c27c0700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87bc0bb1f0 0x7f87bc157f10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f87bc06d880 tx=0x7f87b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87b1ffb700 1 -- 172.21.15.27:0/2692053744 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4022070 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87b1ffb700 1 -- 172.21.15.27:0/2692053744 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b401c590 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87b1ffb700 1 -- 172.21.15.27:0/2692053744 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b401c930 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c4223700 1 -- 172.21.15.27:0/2692053744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87bc0b7d90 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.585+0000 7f87c4223700 1 -- 172.21.15.27:0/2692053744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87bc1577a0 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.589+0000 7f87c4223700 1 -- 172.21.15.27:0/2692053744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87bc04be40 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.589+0000 7f87b1ffb700 1 -- 172.21.15.27:0/2692053744 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f87b40303b0 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.589+0000 7f87b1ffb700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f87a0060550 0x7f87a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.589+0000 7f87b1ffb700 1 -- 172.21.15.27:0/2692053744 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f87b4080420 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.589+0000 7f87c1fbf700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f87a0060550 0x7f87a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.589+0000 7f87c1fbf700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f87a0060550 0x7f87a0062a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87ac007fd0 tx=0x7f87ac007d50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.597+0000 7f87b1ffb700 1 -- 172.21.15.27:0/2692053744 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f87b40507d0 con 0x7f87bc0bb1f0 2023-10-06T03:10:01.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.769+0000 7f87c4223700 1 -- 172.21.15.27:0/2692053744 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f87bc06aaa0 con 0x7f87a0060550 2023-10-06T03:10:01.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.769+0000 7f87b1ffb700 1 -- 172.21.15.27:0/2692053744 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f87bc06aaa0 con 0x7f87a0060550 2023-10-06T03:10:01.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.769+0000 7f87c4223700 1 -- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f87a0060550 msgr2=0x7f87a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.769+0000 7f87c4223700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f87a0060550 0x7f87a0062a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87ac007fd0 tx=0x7f87ac007d50 comp rx=0 tx=0).stop 2023-10-06T03:10:01.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.769+0000 7f87c4223700 1 -- 172.21.15.27:0/2692053744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87bc0bb1f0 msgr2=0x7f87bc157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.769+0000 7f87c4223700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87bc0bb1f0 0x7f87bc157f10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f87bc06d880 tx=0x7f87b4019000 comp rx=0 tx=0).stop 2023-10-06T03:10:01.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.769+0000 7f87c4223700 1 -- 172.21.15.27:0/2692053744 shutdown_connections 2023-10-06T03:10:01.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.769+0000 7f87c4223700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f87a0060550 0x7f87a0062a00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.769+0000 7f87c4223700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87bc0bb1f0 0x7f87bc157f10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.769+0000 7f87c4223700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87bc0bae20 0x7f87bc0b7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.769+0000 7f87c4223700 1 --2- 172.21.15.27:0/2692053744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87bc068ae0 0x7f87bc15b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.769+0000 7f87c4223700 1 -- 172.21.15.27:0/2692053744 >> 172.21.15.27:0/2692053744 conn(0x7f87bc0be770 msgr2=0x7f87bc0b93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:01.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.773+0000 7f87c4223700 1 -- 172.21.15.27:0/2692053744 shutdown_connections 2023-10-06T03:10:01.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.773+0000 7f87c4223700 1 -- 172.21.15.27:0/2692053744 wait complete. 2023-10-06T03:10:01.774 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T03:10:01.784 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T03:10:01.784 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:10:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.897+0000 7f60b2849700 1 Processor -- start 2023-10-06T03:10:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.897+0000 7f60b2849700 1 -- start start 2023-10-06T03:10:01.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2849700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f60ac06d3d0 0x7f60ac1450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2849700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f60ac0bbcd0 0x7f60ac1455e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2849700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ac14bf90 con 0x7f60ac06b900 2023-10-06T03:10:01.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2849700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac0b4900 con 0x7f60ac06d3d0 2023-10-06T03:10:01.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2849700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac14c270 con 0x7f60ac0bbcd0 2023-10-06T03:10:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b1847700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f60ac06d3d0 0x7f60ac1450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b1046700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f60ac06b900 0x7f60ac14eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54762/0 (socket says 172.21.15.27:54762) 2023-10-06T03:10:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b1046700 1 -- 172.21.15.27:0/2934193523 learned_addr learned my addr 172.21.15.27:0/2934193523 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:10:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2048700 1 --2- 172.21.15.27:0/2934193523 >> v2:172.21.15.123:3300/0 conn(0x7f60ac0bbcd0 0x7f60ac1455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b1847700 1 -- 172.21.15.27:0/2934193523 >> v2:172.21.15.123:3300/0 conn(0x7f60ac0bbcd0 msgr2=0x7f60ac1455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b1847700 1 --2- 172.21.15.27:0/2934193523 >> v2:172.21.15.123:3300/0 conn(0x7f60ac0bbcd0 0x7f60ac1455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b1847700 1 -- 172.21.15.27:0/2934193523 >> v1:172.21.15.27:6789/0 conn(0x7f60ac06b900 legacy=0x7f60ac14eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b0845700 1 -- 172.21.15.27:0/2934193523 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407078065 0 0) 0x7f60ac14bf90 con 0x7f60ac06b900 2023-10-06T03:10:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b1847700 1 -- 172.21.15.27:0/2934193523 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac069970 con 0x7f60ac06d3d0 2023-10-06T03:10:01.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2048700 1 --2- 172.21.15.27:0/2934193523 >> v2:172.21.15.123:3300/0 conn(0x7f60ac0bbcd0 0x7f60ac1455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:10:01.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b1847700 1 --2- 172.21.15.27:0/2934193523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac06d3d0 0x7f60ac1450a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f60ac06ad00 tx=0x7f60a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df746e952c41ed6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b0845700 1 -- 172.21.15.27:0/2934193523 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8011630 con 0x7f60ac06d3d0 2023-10-06T03:10:01.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b0845700 1 -- 172.21.15.27:0/2934193523 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a8011790 con 0x7f60ac06d3d0 2023-10-06T03:10:01.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b0845700 1 -- 172.21.15.27:0/2934193523 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8011b30 con 0x7f60ac06d3d0 2023-10-06T03:10:01.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2849700 1 -- 172.21.15.27:0/2934193523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac06d3d0 msgr2=0x7f60ac1450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2849700 1 --2- 172.21.15.27:0/2934193523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac06d3d0 0x7f60ac1450a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f60ac06ad00 tx=0x7f60a80091a0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2849700 1 -- 172.21.15.27:0/2934193523 shutdown_connections 2023-10-06T03:10:01.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2849700 1 --2- 172.21.15.27:0/2934193523 >> v2:172.21.15.123:3300/0 conn(0x7f60ac0bbcd0 0x7f60ac1455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2849700 1 --2- 172.21.15.27:0/2934193523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac06d3d0 0x7f60ac1450a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2849700 1 -- 172.21.15.27:0/2934193523 >> 172.21.15.27:0/2934193523 conn(0x7f60ac0bae20 msgr2=0x7f60ac0bb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:01.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2849700 1 -- 172.21.15.27:0/2934193523 shutdown_connections 2023-10-06T03:10:01.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.901+0000 7f60b2849700 1 -- 172.21.15.27:0/2934193523 wait complete. 2023-10-06T03:10:01.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2849700 1 Processor -- start 2023-10-06T03:10:01.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2849700 1 -- start start 2023-10-06T03:10:01.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2849700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f60ac06b900 0x7f60ac146a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2849700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60ac06d3d0 0x7f60ac13fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2849700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0bbcd0 0x7f60ac15b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2849700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac15e6f0 con 0x7f60ac0bbcd0 2023-10-06T03:10:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2849700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac15adf0 con 0x7f60ac06d3d0 2023-10-06T03:10:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2849700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac15b090 con 0x7f60ac06b900 2023-10-06T03:10:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2048700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0bbcd0 0x7f60ac15b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2048700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0bbcd0 0x7f60ac15b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41402/0 (socket says 172.21.15.27:41402) 2023-10-06T03:10:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2048700 1 -- 172.21.15.27:0/2661396862 learned_addr learned my addr 172.21.15.27:0/2661396862 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b1847700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f60ac06b900 0x7f60ac146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b1046700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60ac06d3d0 0x7f60ac13fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2048700 1 -- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f60ac06b900 msgr2=0x7f60ac146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2048700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f60ac06b900 0x7f60ac146a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2048700 1 -- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60ac06d3d0 msgr2=0x7f60ac13fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2048700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60ac06d3d0 0x7f60ac13fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.905+0000 7f60b2048700 1 -- 172.21.15.27:0/2661396862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a4009a20 con 0x7f60ac0bbcd0 2023-10-06T03:10:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.909+0000 7f60b1046700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60ac06d3d0 0x7f60ac13fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:10:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.909+0000 7f60b2048700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0bbcd0 0x7f60ac15b520 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009f50 tx=0x7f60a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.909+0000 7f60a1ffb700 1 -- 172.21.15.27:0/2661396862 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a400cc00 con 0x7f60ac0bbcd0 2023-10-06T03:10:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.909+0000 7f60a1ffb700 1 -- 172.21.15.27:0/2661396862 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a400f040 con 0x7f60ac0bbcd0 2023-10-06T03:10:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.909+0000 7f60a1ffb700 1 -- 172.21.15.27:0/2661396862 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a4014480 con 0x7f60ac0bbcd0 2023-10-06T03:10:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.909+0000 7f60b2849700 1 -- 172.21.15.27:0/2661396862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a8009420 con 0x7f60ac0bbcd0 2023-10-06T03:10:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.909+0000 7f60b2849700 1 -- 172.21.15.27:0/2661396862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac0bd610 con 0x7f60ac0bbcd0 2023-10-06T03:10:01.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.909+0000 7f60b2849700 1 -- 172.21.15.27:0/2661396862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60ac04be40 con 0x7f60ac0bbcd0 2023-10-06T03:10:01.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.909+0000 7f60a1ffb700 1 -- 172.21.15.27:0/2661396862 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f60a4003020 con 0x7f60ac0bbcd0 2023-10-06T03:10:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.909+0000 7f60a1ffb700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6090060550 0x7f6090062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.913+0000 7f60a1ffb700 1 -- 172.21.15.27:0/2661396862 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f60a407d290 con 0x7f60ac0bbcd0 2023-10-06T03:10:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.913+0000 7f60b1847700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6090060550 0x7f6090062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.913+0000 7f60a1ffb700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] conn(0x7f6090068ec0 0x7f609006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.913+0000 7f60a1ffb700 1 -- 172.21.15.27:0/2661396862 --> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f609006b9c0 con 0x7f6090068ec0 2023-10-06T03:10:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.913+0000 7f60a1ffb700 1 -- 172.21.15.27:0/2661396862 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60a407f870 con 0x7f60ac0bbcd0 2023-10-06T03:10:01.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.913+0000 7f60b1046700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] conn(0x7f6090068ec0 0x7f609006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:01.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.913+0000 7f60b1847700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6090060550 0x7f6090062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f60a80093f0 tx=0x7f60a8017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.913+0000 7f60b1046700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] conn(0x7f6090068ec0 0x7f609006b2f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:01.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.913+0000 7f60a1ffb700 1 -- 172.21.15.27:0/2661396862 <== osd.7 v2:172.21.15.123:6808/33674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f609006b9c0 con 0x7f6090068ec0 2023-10-06T03:10:01.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.933+0000 7f60b2849700 1 -- 172.21.15.27:0/2661396862 --> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f60ac144e70 con 0x7f6090068ec0 2023-10-06T03:10:01.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.933+0000 7f60a1ffb700 1 -- 172.21.15.27:0/2661396862 <== osd.7 v2:172.21.15.123:6808/33674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f60ac144e70 con 0x7f6090068ec0 2023-10-06T03:10:01.935 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-06T03:10:01.935 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:10:01.935 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-06T03:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.933+0000 7f60b2849700 1 -- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] conn(0x7f6090068ec0 msgr2=0x7f609006b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.933+0000 7f60b2849700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:6808/33674,v1:172.21.15.123:6809/33674] conn(0x7f6090068ec0 0x7f609006b2f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.933+0000 7f60b2849700 1 -- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6090060550 msgr2=0x7f6090062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.933+0000 7f60b2849700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6090060550 0x7f6090062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f60a80093f0 tx=0x7f60a8017000 comp rx=0 tx=0).stop 2023-10-06T03:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.933+0000 7f60b2849700 1 -- 172.21.15.27:0/2661396862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0bbcd0 msgr2=0x7f60ac15b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.933+0000 7f60b2849700 1 --2- 172.21.15.27:0/2661396862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ac0bbcd0 0x7f60ac15b520 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009f50 tx=0x7f60a400b040 comp rx=0 tx=0).stop 2023-10-06T03:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.933+0000 7f60b2048700 1 -- 172.21.15.27:0/2661396862 reap_dead start 2023-10-06T03:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.933+0000 7f60b2849700 1 -- 172.21.15.27:0/2661396862 shutdown_connections 2023-10-06T03:10:01.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.933+0000 7f60b2849700 1 -- 172.21.15.27:0/2661396862 >> 172.21.15.27:0/2661396862 conn(0x7f60ac0bae20 msgr2=0x7f60ac1450b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:01.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.933+0000 7f60b2849700 1 -- 172.21.15.27:0/2661396862 shutdown_connections 2023-10-06T03:10:01.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:01.933+0000 7f60b2849700 1 -- 172.21.15.27:0/2661396862 wait complete. 2023-10-06T03:10:01.948 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T03:10:02.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.061+0000 7f808b267700 1 Processor -- start 2023-10-06T03:10:02.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.061+0000 7f808b267700 1 -- start start 2023-10-06T03:10:02.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808b267700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80840a0fd0 0x7f80840a20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:02.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808b267700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f808414f420 0x7f808414f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:02.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808b267700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808414ef90 con 0x7f80840bd0e0 2023-10-06T03:10:02.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808b267700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80840a3b40 con 0x7f80840a0fd0 2023-10-06T03:10:02.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808b267700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80840a32b0 con 0x7f808414f420 2023-10-06T03:10:02.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f8089a64700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80840a0fd0 0x7f80840a20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:02.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f8089a64700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80840a0fd0 0x7f80840a20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41418/0 (socket says 172.21.15.27:41418) 2023-10-06T03:10:02.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f8089a64700 1 -- 172.21.15.27:0/531307625 learned_addr learned my addr 172.21.15.27:0/531307625 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:02.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808aa66700 1 --2- 172.21.15.27:0/531307625 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f808414f420 0x7f808414f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:02.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f8089a64700 1 -- 172.21.15.27:0/531307625 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f808414f420 msgr2=0x7f808414f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:02.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f8089a64700 1 --2- 172.21.15.27:0/531307625 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f808414f420 0x7f808414f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f8089a64700 1 -- 172.21.15.27:0/531307625 >> v1:172.21.15.123:6789/0 conn(0x7f80840bd0e0 legacy=0x7f808414ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:02.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f8089a64700 1 -- 172.21.15.27:0/531307625 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80840a2fd0 con 0x7f80840a0fd0 2023-10-06T03:10:02.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f8089a64700 1 --2- 172.21.15.27:0/531307625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80840a0fd0 0x7f80840a20e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8080014ac0 tx=0x7f80800143c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ff679365d6cc70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:02.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f8089263700 1 -- 172.21.15.27:0/531307625 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8080013bd0 con 0x7f80840a0fd0 2023-10-06T03:10:02.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f8089263700 1 -- 172.21.15.27:0/531307625 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8080013d30 con 0x7f80840a0fd0 2023-10-06T03:10:02.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f8089263700 1 -- 172.21.15.27:0/531307625 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80800140d0 con 0x7f80840a0fd0 2023-10-06T03:10:02.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808b267700 1 -- 172.21.15.27:0/531307625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80840a0fd0 msgr2=0x7f80840a20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:02.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808b267700 1 --2- 172.21.15.27:0/531307625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80840a0fd0 0x7f80840a20e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8080014ac0 tx=0x7f80800143c0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808b267700 1 -- 172.21.15.27:0/531307625 shutdown_connections 2023-10-06T03:10:02.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808b267700 1 --2- 172.21.15.27:0/531307625 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f808414f420 0x7f808414f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808b267700 1 --2- 172.21.15.27:0/531307625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80840a0fd0 0x7f80840a20e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808b267700 1 -- 172.21.15.27:0/531307625 >> 172.21.15.27:0/531307625 conn(0x7f80840c07d0 msgr2=0x7f80840bc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:02.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808b267700 1 -- 172.21.15.27:0/531307625 shutdown_connections 2023-10-06T03:10:02.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.065+0000 7f808b267700 1 -- 172.21.15.27:0/531307625 wait complete. 2023-10-06T03:10:02.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808b267700 1 Processor -- start 2023-10-06T03:10:02.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808b267700 1 -- start start 2023-10-06T03:10:02.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808b267700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80840a0fd0 0x7f8084143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:02.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808b267700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f80840bd0e0 0x7f808413fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:02.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808b267700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f808414f420 0x7f8084140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:02.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808b267700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8084143000 con 0x7f80840a0fd0 2023-10-06T03:10:02.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808b267700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808414bc60 con 0x7f808414f420 2023-10-06T03:10:02.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808b267700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8084142c90 con 0x7f80840bd0e0 2023-10-06T03:10:02.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808a265700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80840a0fd0 0x7f8084143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:02.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808a265700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80840a0fd0 0x7f8084143800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41422/0 (socket says 172.21.15.27:41422) 2023-10-06T03:10:02.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f8089a64700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f80840bd0e0 0x7f808413fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:02.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808a265700 1 -- 172.21.15.27:0/2995259255 learned_addr learned my addr 172.21.15.27:0/2995259255 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:02.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808aa66700 1 --2- 172.21.15.27:0/2995259255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f808414f420 0x7f8084140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:02.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808a265700 1 -- 172.21.15.27:0/2995259255 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f80840bd0e0 msgr2=0x7f808413fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:02.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808a265700 1 --2- 172.21.15.27:0/2995259255 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f80840bd0e0 0x7f808413fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808a265700 1 -- 172.21.15.27:0/2995259255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f808414f420 msgr2=0x7f8084140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:02.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808a265700 1 --2- 172.21.15.27:0/2995259255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f808414f420 0x7f8084140040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.069+0000 7f808a265700 1 -- 172.21.15.27:0/2995259255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8080014600 con 0x7f80840a0fd0 2023-10-06T03:10:02.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.073+0000 7f808a265700 1 --2- 172.21.15.27:0/2995259255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80840a0fd0 0x7f8084143800 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f807400c590 tx=0x7f807400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:02.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.073+0000 7f807a7fc700 1 -- 172.21.15.27:0/2995259255 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074011590 con 0x7f80840a0fd0 2023-10-06T03:10:02.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.073+0000 7f807a7fc700 1 -- 172.21.15.27:0/2995259255 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8074011710 con 0x7f80840a0fd0 2023-10-06T03:10:02.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.073+0000 7f808b267700 1 -- 172.21.15.27:0/2995259255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8084140580 con 0x7f80840a0fd0 2023-10-06T03:10:02.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.073+0000 7f807a7fc700 1 -- 172.21.15.27:0/2995259255 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074011ad0 con 0x7f80840a0fd0 2023-10-06T03:10:02.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.073+0000 7f808b267700 1 -- 172.21.15.27:0/2995259255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8084159270 con 0x7f80840a0fd0 2023-10-06T03:10:02.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.073+0000 7f808b267700 1 -- 172.21.15.27:0/2995259255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8084142af0 con 0x7f80840a0fd0 2023-10-06T03:10:02.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.073+0000 7f807a7fc700 1 -- 172.21.15.27:0/2995259255 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f807401b3b0 con 0x7f80840a0fd0 2023-10-06T03:10:02.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.073+0000 7f807a7fc700 1 --2- 172.21.15.27:0/2995259255 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8068060550 0x7f8068062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:02.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.073+0000 7f807a7fc700 1 -- 172.21.15.27:0/2995259255 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f807407bdd0 con 0x7f80840a0fd0 2023-10-06T03:10:02.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.073+0000 7f8089a64700 1 --2- 172.21.15.27:0/2995259255 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8068060550 0x7f8068062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:02.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.073+0000 7f8089a64700 1 --2- 172.21.15.27:0/2995259255 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8068060550 0x7f8068062a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8080014400 tx=0x7f808001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:02.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.081+0000 7f807a7fc700 1 -- 172.21.15.27:0/2995259255 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8084142af0 con 0x7f80840a0fd0 2023-10-06T03:10:02.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.249+0000 7f808b267700 1 -- 172.21.15.27:0/2995259255 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f8084142e00 con 0x7f8068060550 2023-10-06T03:10:02.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.249+0000 7f807a7fc700 1 -- 172.21.15.27:0/2995259255 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8084142e00 con 0x7f8068060550 2023-10-06T03:10:02.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.253+0000 7f808b267700 1 -- 172.21.15.27:0/2995259255 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8068060550 msgr2=0x7f8068062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:02.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.253+0000 7f808b267700 1 --2- 172.21.15.27:0/2995259255 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8068060550 0x7f8068062a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8080014400 tx=0x7f808001f000 comp rx=0 tx=0).stop 2023-10-06T03:10:02.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.253+0000 7f808b267700 1 -- 172.21.15.27:0/2995259255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80840a0fd0 msgr2=0x7f8084143800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:02.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.253+0000 7f808b267700 1 --2- 172.21.15.27:0/2995259255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80840a0fd0 0x7f8084143800 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f807400c590 tx=0x7f807400c8a0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.253+0000 7f808b267700 1 -- 172.21.15.27:0/2995259255 shutdown_connections 2023-10-06T03:10:02.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.253+0000 7f808b267700 1 --2- 172.21.15.27:0/2995259255 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f8068060550 0x7f8068062a00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.253+0000 7f808b267700 1 --2- 172.21.15.27:0/2995259255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f808414f420 0x7f8084140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.253+0000 7f808b267700 1 --2- 172.21.15.27:0/2995259255 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f80840bd0e0 0x7f808413fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.253+0000 7f808b267700 1 --2- 172.21.15.27:0/2995259255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80840a0fd0 0x7f8084143800 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.253+0000 7f808b267700 1 -- 172.21.15.27:0/2995259255 >> 172.21.15.27:0/2995259255 conn(0x7f80840c07d0 msgr2=0x7f8084146a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:02.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.253+0000 7f808b267700 1 -- 172.21.15.27:0/2995259255 shutdown_connections 2023-10-06T03:10:02.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.253+0000 7f808b267700 1 -- 172.21.15.27:0/2995259255 wait complete. 2023-10-06T03:10:02.255 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T03:10:02.265 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:10:02.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f3390c43700 1 Processor -- start 2023-10-06T03:10:02.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f3390c43700 1 -- start start 2023-10-06T03:10:02.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f3390c43700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f338c0b9c50 0x7f338c0ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:02.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f3390c43700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f338c0a3550 0x7f338c09f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:02.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f3390c43700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338c09ef80 con 0x7f338c0bb2c0 2023-10-06T03:10:02.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f3390c43700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338c0a0f20 con 0x7f338c0a3550 2023-10-06T03:10:02.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f3390c43700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338c0a3990 con 0x7f338c0b9c50 2023-10-06T03:10:02.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f338c0a3550 0x7f338c09f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:02.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338affd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f338c0bb2c0 0x7f338c06c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54766/0 (socket says 172.21.15.27:54766) 2023-10-06T03:10:02.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338affd700 1 -- 172.21.15.27:0/3717760683 learned_addr learned my addr 172.21.15.27:0/3717760683 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:10:02.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338b7fe700 1 --2- 172.21.15.27:0/3717760683 >> v2:172.21.15.123:3300/0 conn(0x7f338c0b9c50 0x7f338c0ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:02.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338a7fc700 1 -- 172.21.15.27:0/3717760683 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266512264 0 0) 0x7f338c09ef80 con 0x7f338c0bb2c0 2023-10-06T03:10:02.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338a7fc700 1 -- 172.21.15.27:0/3717760683 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3374003570 con 0x7f338c0bb2c0 2023-10-06T03:10:02.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338bfff700 1 -- 172.21.15.27:0/3717760683 >> v2:172.21.15.123:3300/0 conn(0x7f338c0b9c50 msgr2=0x7f338c0ba020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:02.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338bfff700 1 --2- 172.21.15.27:0/3717760683 >> v2:172.21.15.123:3300/0 conn(0x7f338c0b9c50 0x7f338c0ba020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338bfff700 1 -- 172.21.15.27:0/3717760683 >> v1:172.21.15.27:6789/0 conn(0x7f338c0bb2c0 legacy=0x7f338c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:02.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338bfff700 1 -- 172.21.15.27:0/3717760683 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c0a2c50 con 0x7f338c0a3550 2023-10-06T03:10:02.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338b7fe700 1 --2- 172.21.15.27:0/3717760683 >> v2:172.21.15.123:3300/0 conn(0x7f338c0b9c50 0x7f338c0ba020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:10:02.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338bfff700 1 --2- 172.21.15.27:0/3717760683 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f338c0a3550 0x7f338c09f410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f338c068350 tx=0x7f3384009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0adb7c9576910a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:02.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338a7fc700 1 -- 172.21.15.27:0/3717760683 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338400e070 con 0x7f338c0a3550 2023-10-06T03:10:02.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338a7fc700 1 -- 172.21.15.27:0/3717760683 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338400bb60 con 0x7f338c0a3550 2023-10-06T03:10:02.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.369+0000 7f338a7fc700 1 -- 172.21.15.27:0/3717760683 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384012430 con 0x7f338c0a3550 2023-10-06T03:10:02.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.373+0000 7f3390c43700 1 -- 172.21.15.27:0/3717760683 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f338c0a3550 msgr2=0x7f338c09f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:02.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.373+0000 7f3390c43700 1 --2- 172.21.15.27:0/3717760683 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f338c0a3550 0x7f338c09f410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f338c068350 tx=0x7f3384009780 comp rx=0 tx=0).stop 2023-10-06T03:10:02.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.373+0000 7f3390c43700 1 -- 172.21.15.27:0/3717760683 shutdown_connections 2023-10-06T03:10:02.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.373+0000 7f3390c43700 1 --2- 172.21.15.27:0/3717760683 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f338c0a3550 0x7f338c09f410 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.373+0000 7f3390c43700 1 --2- 172.21.15.27:0/3717760683 >> v2:172.21.15.123:3300/0 conn(0x7f338c0b9c50 0x7f338c0ba020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.373+0000 7f3390c43700 1 -- 172.21.15.27:0/3717760683 >> 172.21.15.27:0/3717760683 conn(0x7f338c06eb10 msgr2=0x7f338c0ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:02.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.373+0000 7f3390c43700 1 -- 172.21.15.27:0/3717760683 shutdown_connections 2023-10-06T03:10:02.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.373+0000 7f3390c43700 1 -- 172.21.15.27:0/3717760683 wait complete. 2023-10-06T03:10:02.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.373+0000 7f3390c43700 1 Processor -- start 2023-10-06T03:10:02.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.373+0000 7f3390c43700 1 -- start start 2023-10-06T03:10:02.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f3390c43700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f338c0a3550 0x7f338c06ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:02.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f3390c43700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f338c0b9c50 0x7f338c15fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:02.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f3390c43700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f338c0bb2c0 0x7f338c153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:02.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f3390c43700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c15f150 con 0x7f338c0a3550 2023-10-06T03:10:02.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f3390c43700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c06b090 con 0x7f338c0b9c50 2023-10-06T03:10:02.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f3390c43700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c15f410 con 0x7f338c0bb2c0 2023-10-06T03:10:02.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f338b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f338c0a3550 0x7f338c06ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:02.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f338b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f338c0a3550 0x7f338c06ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41446/0 (socket says 172.21.15.27:41446) 2023-10-06T03:10:02.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f338b7fe700 1 -- 172.21.15.27:0/881720819 learned_addr learned my addr 172.21.15.27:0/881720819 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:02.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f338affd700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f338c0b9c50 0x7f338c15fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:02.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f338bfff700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f338c0bb2c0 0x7f338c153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:02.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f338b7fe700 1 -- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f338c0bb2c0 msgr2=0x7f338c153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:02.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f338b7fe700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f338c0bb2c0 0x7f338c153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f338b7fe700 1 -- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f338c0b9c50 msgr2=0x7f338c15fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:02.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f338b7fe700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f338c0b9c50 0x7f338c15fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f338b7fe700 1 -- 172.21.15.27:0/881720819 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384009a20 con 0x7f338c0a3550 2023-10-06T03:10:02.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f338b7fe700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f338c0a3550 0x7f338c06ab50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f338000e8d0 tx=0x7f3380008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:02.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f33737fe700 1 -- 172.21.15.27:0/881720819 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380013410 con 0x7f338c0a3550 2023-10-06T03:10:02.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f33737fe700 1 -- 172.21.15.27:0/881720819 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380013570 con 0x7f338c0a3550 2023-10-06T03:10:02.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f33737fe700 1 -- 172.21.15.27:0/881720819 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380013910 con 0x7f338c0a3550 2023-10-06T03:10:02.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f3390c43700 1 -- 172.21.15.27:0/881720819 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c15f6f0 con 0x7f338c0a3550 2023-10-06T03:10:02.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f3390c43700 1 -- 172.21.15.27:0/881720819 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338c160150 con 0x7f338c0a3550 2023-10-06T03:10:02.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.377+0000 7f3390c43700 1 -- 172.21.15.27:0/881720819 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338c0674b0 con 0x7f338c0a3550 2023-10-06T03:10:02.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.381+0000 7f33737fe700 1 -- 172.21.15.27:0/881720819 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3380013d40 con 0x7f338c0a3550 2023-10-06T03:10:02.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.381+0000 7f33737fe700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3378060550 0x7f3378062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:02.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.381+0000 7f33737fe700 1 -- 172.21.15.27:0/881720819 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f338007c6b0 con 0x7f338c0a3550 2023-10-06T03:10:02.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.381+0000 7f338affd700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3378060550 0x7f3378062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:02.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.381+0000 7f338affd700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3378060550 0x7f3378062a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f338c0a0bd0 tx=0x7f337c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:02.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.389+0000 7f33737fe700 1 -- 172.21.15.27:0/881720819 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f338004ca60 con 0x7f338c0a3550 2023-10-06T03:10:02.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.545+0000 7f3390c43700 1 -- 172.21.15.27:0/881720819 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f338c15f290 con 0x7f3378060550 2023-10-06T03:10:02.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.561+0000 7f33737fe700 1 -- 172.21.15.27:0/881720819 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310215 (secure 0 0 0) 0x7f337c00f620 con 0x7f3378060550 2023-10-06T03:10:02.566 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:10:02.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.565+0000 7f3390c43700 1 -- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3378060550 msgr2=0x7f3378062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:02.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.565+0000 7f3390c43700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3378060550 0x7f3378062a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f338c0a0bd0 tx=0x7f337c009040 comp rx=0 tx=0).stop 2023-10-06T03:10:02.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.565+0000 7f3390c43700 1 -- 172.21.15.27:0/881720819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f338c0a3550 msgr2=0x7f338c06ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:02.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.565+0000 7f3390c43700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f338c0a3550 0x7f338c06ab50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f338000e8d0 tx=0x7f3380008040 comp rx=0 tx=0).stop 2023-10-06T03:10:02.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.565+0000 7f3390c43700 1 -- 172.21.15.27:0/881720819 shutdown_connections 2023-10-06T03:10:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.565+0000 7f3390c43700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3378060550 0x7f3378062a00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.565+0000 7f3390c43700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f338c0bb2c0 0x7f338c153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.565+0000 7f3390c43700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f338c0b9c50 0x7f338c15fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.565+0000 7f3390c43700 1 --2- 172.21.15.27:0/881720819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f338c0a3550 0x7f338c06ab50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.565+0000 7f3390c43700 1 -- 172.21.15.27:0/881720819 >> 172.21.15.27:0/881720819 conn(0x7f338c06eb10 msgr2=0x7f338c0bc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.565+0000 7f3390c43700 1 -- 172.21.15.27:0/881720819 shutdown_connections 2023-10-06T03:10:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:02.565+0000 7f3390c43700 1 -- 172.21.15.27:0/881720819 wait complete. 2023-10-06T03:10:02.571 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-10-06T03:10:02.582 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2023-10-06T03:10:01.185542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76103972,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":599,"num_read_kb":1179,"num_write":11705,"num_write_kb":82701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20586,"ondisk_log_size":20586,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2570144,"kb_used_data":150880,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752404576,"statfs":{"total":773094113280,"available":770462285824,"internally_reserved":0,"allocated":154501120,"data_stored":153061288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":265,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004161"},"pg_stats":[{"pgid":"4.3f","version":"26'91","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205300+0000","last_change":"2023-10-06T02:59:53.681789+0000","last_active":"2023-10-06T03:09:49.205300+0000","last_peered":"2023-10-06T03:09:49.205300+0000","last_clean":"2023-10-06T03:09:49.205300+0000","last_became_active":"2023-10-06T02:59:53.681495+0000","last_became_peered":"2023-10-06T02:59:53.681495+0000","last_unstale":"2023-10-06T03:09:49.205300+0000","last_undegraded":"2023-10-06T03:09:49.205300+0000","last_fullsized":"2023-10-06T03:09:49.205300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:19.626429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194862+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T03:09:49.194862+0000","last_peered":"2023-10-06T03:09:49.194862+0000","last_clean":"2023-10-06T03:09:49.194862+0000","last_became_active":"2023-10-06T02:59:53.681849+0000","last_became_peered":"2023-10-06T02:59:53.681849+0000","last_unstale":"2023-10-06T03:09:49.194862+0000","last_undegraded":"2023-10-06T03:09:49.194862+0000","last_fullsized":"2023-10-06T03:09:49.194862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"26'65","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195589+0000","last_change":"2023-10-06T02:59:53.679536+0000","last_active":"2023-10-06T03:09:49.195589+0000","last_peered":"2023-10-06T03:09:49.195589+0000","last_clean":"2023-10-06T03:09:49.195589+0000","last_became_active":"2023-10-06T02:59:53.678264+0000","last_became_peered":"2023-10-06T02:59:53.678264+0000","last_unstale":"2023-10-06T03:09:49.195589+0000","last_undegraded":"2023-10-06T03:09:49.195589+0000","last_fullsized":"2023-10-06T03:09:49.195589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:18.566933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"26'76","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.178090+0000","last_change":"2023-10-06T02:59:53.671821+0000","last_active":"2023-10-06T03:09:49.178090+0000","last_peered":"2023-10-06T03:09:49.178090+0000","last_clean":"2023-10-06T03:09:49.178090+0000","last_became_active":"2023-10-06T02:59:53.671555+0000","last_became_peered":"2023-10-06T02:59:53.671555+0000","last_unstale":"2023-10-06T03:09:49.178090+0000","last_undegraded":"2023-10-06T03:09:49.178090+0000","last_fullsized":"2023-10-06T03:09:49.178090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:36:28.006545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"26'85","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205702+0000","last_change":"2023-10-06T02:59:53.682691+0000","last_active":"2023-10-06T03:09:49.205702+0000","last_peered":"2023-10-06T03:09:49.205702+0000","last_clean":"2023-10-06T03:09:49.205702+0000","last_became_active":"2023-10-06T02:59:53.682399+0000","last_became_peered":"2023-10-06T02:59:53.682399+0000","last_unstale":"2023-10-06T03:09:49.205702+0000","last_undegraded":"2023-10-06T03:09:49.205702+0000","last_fullsized":"2023-10-06T03:09:49.205702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195685+0000","last_change":"2023-10-06T02:59:53.678208+0000","last_active":"2023-10-06T03:09:49.195685+0000","last_peered":"2023-10-06T03:09:49.195685+0000","last_clean":"2023-10-06T03:09:49.195685+0000","last_became_active":"2023-10-06T02:59:53.676481+0000","last_became_peered":"2023-10-06T02:59:53.676481+0000","last_unstale":"2023-10-06T03:09:49.195685+0000","last_undegraded":"2023-10-06T03:09:49.195685+0000","last_fullsized":"2023-10-06T03:09:49.195685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:42.767531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"26'93","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194495+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T03:09:49.194495+0000","last_peered":"2023-10-06T03:09:49.194495+0000","last_clean":"2023-10-06T03:09:49.194495+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:09:49.194495+0000","last_undegraded":"2023-10-06T03:09:49.194495+0000","last_fullsized":"2023-10-06T03:09:49.194495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"26'77","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196046+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T03:09:49.196046+0000","last_peered":"2023-10-06T03:09:49.196046+0000","last_clean":"2023-10-06T03:09:49.196046+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:09:49.196046+0000","last_undegraded":"2023-10-06T03:09:49.196046+0000","last_fullsized":"2023-10-06T03:09:49.196046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"26'89","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205683+0000","last_change":"2023-10-06T02:59:53.680395+0000","last_active":"2023-10-06T03:09:49.205683+0000","last_peered":"2023-10-06T03:09:49.205683+0000","last_clean":"2023-10-06T03:09:49.205683+0000","last_became_active":"2023-10-06T02:59:53.680086+0000","last_became_peered":"2023-10-06T02:59:53.680086+0000","last_unstale":"2023-10-06T03:09:49.205683+0000","last_undegraded":"2023-10-06T03:09:49.205683+0000","last_fullsized":"2023-10-06T03:09:49.205683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"26'73","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.189574+0000","last_change":"2023-10-06T02:59:53.675582+0000","last_active":"2023-10-06T03:09:49.189574+0000","last_peered":"2023-10-06T03:09:49.189574+0000","last_clean":"2023-10-06T03:09:49.189574+0000","last_became_active":"2023-10-06T02:59:53.675243+0000","last_became_peered":"2023-10-06T02:59:53.675243+0000","last_unstale":"2023-10-06T03:09:49.189574+0000","last_undegraded":"2023-10-06T03:09:49.189574+0000","last_fullsized":"2023-10-06T03:09:49.189574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194979+0000","last_change":"2023-10-06T02:59:53.679489+0000","last_active":"2023-10-06T03:09:49.194979+0000","last_peered":"2023-10-06T03:09:49.194979+0000","last_clean":"2023-10-06T03:09:49.194979+0000","last_became_active":"2023-10-06T02:59:53.678985+0000","last_became_peered":"2023-10-06T02:59:53.678985+0000","last_unstale":"2023-10-06T03:09:49.194979+0000","last_undegraded":"2023-10-06T03:09:49.194979+0000","last_fullsized":"2023-10-06T03:09:49.194979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:12.576010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.199369+0000","last_change":"2023-10-06T02:59:53.682799+0000","last_active":"2023-10-06T03:09:49.199369+0000","last_peered":"2023-10-06T03:09:49.199369+0000","last_clean":"2023-10-06T03:09:49.199369+0000","last_became_active":"2023-10-06T02:59:53.682464+0000","last_became_peered":"2023-10-06T02:59:53.682464+0000","last_unstale":"2023-10-06T03:09:49.199369+0000","last_undegraded":"2023-10-06T03:09:49.199369+0000","last_fullsized":"2023-10-06T03:09:49.199369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:06.403449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"26'84","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192420+0000","last_change":"2023-10-06T03:00:34.741799+0000","last_active":"2023-10-06T03:09:49.192420+0000","last_peered":"2023-10-06T03:09:49.192420+0000","last_clean":"2023-10-06T03:09:49.192420+0000","last_became_active":"2023-10-06T03:00:34.741173+0000","last_became_peered":"2023-10-06T03:00:34.741173+0000","last_unstale":"2023-10-06T03:09:49.192420+0000","last_undegraded":"2023-10-06T03:09:49.192420+0000","last_fullsized":"2023-10-06T03:09:49.192420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:30.493018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"26'74","reported_seq":85,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191870+0000","last_change":"2023-10-06T02:59:53.673321+0000","last_active":"2023-10-06T03:09:49.191870+0000","last_peered":"2023-10-06T03:09:49.191870+0000","last_clean":"2023-10-06T03:09:49.191870+0000","last_became_active":"2023-10-06T02:59:53.672957+0000","last_became_peered":"2023-10-06T02:59:53.672957+0000","last_unstale":"2023-10-06T03:09:49.191870+0000","last_undegraded":"2023-10-06T03:09:49.191870+0000","last_fullsized":"2023-10-06T03:09:49.191870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"26'78","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195086+0000","last_change":"2023-10-06T02:59:53.686669+0000","last_active":"2023-10-06T03:09:49.195086+0000","last_peered":"2023-10-06T03:09:49.195086+0000","last_clean":"2023-10-06T03:09:49.195086+0000","last_became_active":"2023-10-06T02:59:53.686352+0000","last_became_peered":"2023-10-06T02:59:53.686352+0000","last_unstale":"2023-10-06T03:09:49.195086+0000","last_undegraded":"2023-10-06T03:09:49.195086+0000","last_fullsized":"2023-10-06T03:09:49.195086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"26'88","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.197410+0000","last_change":"2023-10-06T02:59:53.680975+0000","last_active":"2023-10-06T03:09:49.197410+0000","last_peered":"2023-10-06T03:09:49.197410+0000","last_clean":"2023-10-06T03:09:49.197410+0000","last_became_active":"2023-10-06T02:59:53.678449+0000","last_became_peered":"2023-10-06T02:59:53.678449+0000","last_unstale":"2023-10-06T03:09:49.197410+0000","last_undegraded":"2023-10-06T03:09:49.197410+0000","last_fullsized":"2023-10-06T03:09:49.197410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:18.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205375+0000","last_change":"2023-10-06T02:59:53.680344+0000","last_active":"2023-10-06T03:09:49.205375+0000","last_peered":"2023-10-06T03:09:49.205375+0000","last_clean":"2023-10-06T03:09:49.205375+0000","last_became_active":"2023-10-06T02:59:53.680028+0000","last_became_peered":"2023-10-06T02:59:53.680028+0000","last_unstale":"2023-10-06T03:09:49.205375+0000","last_undegraded":"2023-10-06T03:09:49.205375+0000","last_fullsized":"2023-10-06T03:09:49.205375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"26'76","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191223+0000","last_change":"2023-10-06T02:59:53.678143+0000","last_active":"2023-10-06T03:09:49.191223+0000","last_peered":"2023-10-06T03:09:49.191223+0000","last_clean":"2023-10-06T03:09:49.191223+0000","last_became_active":"2023-10-06T02:59:53.676602+0000","last_became_peered":"2023-10-06T02:59:53.676602+0000","last_unstale":"2023-10-06T03:09:49.191223+0000","last_undegraded":"2023-10-06T03:09:49.191223+0000","last_fullsized":"2023-10-06T03:09:49.191223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:29.621147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196673+0000","last_change":"2023-10-06T02:59:53.675935+0000","last_active":"2023-10-06T03:09:49.196673+0000","last_peered":"2023-10-06T03:09:49.196673+0000","last_clean":"2023-10-06T03:09:49.196673+0000","last_became_active":"2023-10-06T02:59:53.675657+0000","last_became_peered":"2023-10-06T02:59:53.675657+0000","last_unstale":"2023-10-06T03:09:49.196673+0000","last_undegraded":"2023-10-06T03:09:49.196673+0000","last_fullsized":"2023-10-06T03:09:49.196673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:56.862647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191684+0000","last_change":"2023-10-06T02:59:53.673043+0000","last_active":"2023-10-06T03:09:49.191684+0000","last_peered":"2023-10-06T03:09:49.191684+0000","last_clean":"2023-10-06T03:09:49.191684+0000","last_became_active":"2023-10-06T02:59:53.672690+0000","last_became_peered":"2023-10-06T02:59:53.672690+0000","last_unstale":"2023-10-06T03:09:49.191684+0000","last_undegraded":"2023-10-06T03:09:49.191684+0000","last_fullsized":"2023-10-06T03:09:49.191684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"26'83","reported_seq":94,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194716+0000","last_change":"2023-10-06T02:59:53.684492+0000","last_active":"2023-10-06T03:09:49.194716+0000","last_peered":"2023-10-06T03:09:49.194716+0000","last_clean":"2023-10-06T03:09:49.194716+0000","last_became_active":"2023-10-06T02:59:53.684145+0000","last_became_peered":"2023-10-06T02:59:53.684145+0000","last_unstale":"2023-10-06T03:09:49.194716+0000","last_undegraded":"2023-10-06T03:09:49.194716+0000","last_fullsized":"2023-10-06T03:09:49.194716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"26'88","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200847+0000","last_change":"2023-10-06T02:59:53.683256+0000","last_active":"2023-10-06T03:09:49.200847+0000","last_peered":"2023-10-06T03:09:49.200847+0000","last_clean":"2023-10-06T03:09:49.200847+0000","last_became_active":"2023-10-06T02:59:53.682948+0000","last_became_peered":"2023-10-06T02:59:53.682948+0000","last_unstale":"2023-10-06T03:09:49.200847+0000","last_undegraded":"2023-10-06T03:09:49.200847+0000","last_fullsized":"2023-10-06T03:09:49.200847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"26'69","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206413+0000","last_change":"2023-10-06T02:59:53.675936+0000","last_active":"2023-10-06T03:09:49.206413+0000","last_peered":"2023-10-06T03:09:49.206413+0000","last_clean":"2023-10-06T03:09:49.206413+0000","last_became_active":"2023-10-06T02:59:53.675319+0000","last_became_peered":"2023-10-06T02:59:53.675319+0000","last_unstale":"2023-10-06T03:09:49.206413+0000","last_undegraded":"2023-10-06T03:09:49.206413+0000","last_fullsized":"2023-10-06T03:09:49.206413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195262+0000","last_change":"2023-10-06T02:59:53.686758+0000","last_active":"2023-10-06T03:09:49.195262+0000","last_peered":"2023-10-06T03:09:49.195262+0000","last_clean":"2023-10-06T03:09:49.195262+0000","last_became_active":"2023-10-06T02:59:53.686007+0000","last_became_peered":"2023-10-06T02:59:53.686007+0000","last_unstale":"2023-10-06T03:09:49.195262+0000","last_undegraded":"2023-10-06T03:09:49.195262+0000","last_fullsized":"2023-10-06T03:09:49.195262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"26'91","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200675+0000","last_change":"2023-10-06T02:59:53.682853+0000","last_active":"2023-10-06T03:09:49.200675+0000","last_peered":"2023-10-06T03:09:49.200675+0000","last_clean":"2023-10-06T03:09:49.200675+0000","last_became_active":"2023-10-06T02:59:53.682511+0000","last_became_peered":"2023-10-06T02:59:53.682511+0000","last_unstale":"2023-10-06T03:09:49.200675+0000","last_undegraded":"2023-10-06T03:09:49.200675+0000","last_fullsized":"2023-10-06T03:09:49.200675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"26'98","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196456+0000","last_change":"2023-10-06T02:59:53.682001+0000","last_active":"2023-10-06T03:09:49.196456+0000","last_peered":"2023-10-06T03:09:49.196456+0000","last_clean":"2023-10-06T03:09:49.196456+0000","last_became_active":"2023-10-06T02:59:53.681732+0000","last_became_peered":"2023-10-06T02:59:53.681732+0000","last_unstale":"2023-10-06T03:09:49.196456+0000","last_undegraded":"2023-10-06T03:09:49.196456+0000","last_fullsized":"2023-10-06T03:09:49.196456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.173694+0000","last_change":"2023-10-06T02:59:53.676598+0000","last_active":"2023-10-06T03:09:49.173694+0000","last_peered":"2023-10-06T03:09:49.173694+0000","last_clean":"2023-10-06T03:09:49.173694+0000","last_became_active":"2023-10-06T02:59:53.676284+0000","last_became_peered":"2023-10-06T02:59:53.676284+0000","last_unstale":"2023-10-06T03:09:49.173694+0000","last_undegraded":"2023-10-06T03:09:49.173694+0000","last_fullsized":"2023-10-06T03:09:49.173694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"26'61","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195455+0000","last_change":"2023-10-06T02:59:53.687275+0000","last_active":"2023-10-06T03:09:49.195455+0000","last_peered":"2023-10-06T03:09:49.195455+0000","last_clean":"2023-10-06T03:09:49.195455+0000","last_became_active":"2023-10-06T02:59:53.686912+0000","last_became_peered":"2023-10-06T02:59:53.686912+0000","last_unstale":"2023-10-06T03:09:49.195455+0000","last_undegraded":"2023-10-06T03:09:49.195455+0000","last_fullsized":"2023-10-06T03:09:49.195455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:04.078685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203610+0000","last_change":"2023-10-06T02:59:53.685421+0000","last_active":"2023-10-06T03:09:49.203610+0000","last_peered":"2023-10-06T03:09:49.203610+0000","last_clean":"2023-10-06T03:09:49.203610+0000","last_became_active":"2023-10-06T02:59:53.684806+0000","last_became_peered":"2023-10-06T02:59:53.684806+0000","last_unstale":"2023-10-06T03:09:49.203610+0000","last_undegraded":"2023-10-06T03:09:49.203610+0000","last_fullsized":"2023-10-06T03:09:49.203610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191736+0000","last_change":"2023-10-06T02:59:53.676085+0000","last_active":"2023-10-06T03:09:49.191736+0000","last_peered":"2023-10-06T03:09:49.191736+0000","last_clean":"2023-10-06T03:09:49.191736+0000","last_became_active":"2023-10-06T02:59:53.675718+0000","last_became_peered":"2023-10-06T02:59:53.675718+0000","last_unstale":"2023-10-06T03:09:49.191736+0000","last_undegraded":"2023-10-06T03:09:49.191736+0000","last_fullsized":"2023-10-06T03:09:49.191736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:00.548441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206351+0000","last_change":"2023-10-06T02:59:53.676118+0000","last_active":"2023-10-06T03:09:49.206351+0000","last_peered":"2023-10-06T03:09:49.206351+0000","last_clean":"2023-10-06T03:09:49.206351+0000","last_became_active":"2023-10-06T02:59:53.675682+0000","last_became_peered":"2023-10-06T02:59:53.675682+0000","last_unstale":"2023-10-06T03:09:49.206351+0000","last_undegraded":"2023-10-06T03:09:49.206351+0000","last_fullsized":"2023-10-06T03:09:49.206351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:23.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192921+0000","last_change":"2023-10-06T02:59:53.673225+0000","last_active":"2023-10-06T03:09:49.192921+0000","last_peered":"2023-10-06T03:09:49.192921+0000","last_clean":"2023-10-06T03:09:49.192921+0000","last_became_active":"2023-10-06T02:59:53.672930+0000","last_became_peered":"2023-10-06T02:59:53.672930+0000","last_unstale":"2023-10-06T03:09:49.192921+0000","last_undegraded":"2023-10-06T03:09:49.192921+0000","last_fullsized":"2023-10-06T03:09:49.192921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:02.845187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195360+0000","last_change":"2023-10-06T02:59:53.678742+0000","last_active":"2023-10-06T03:09:49.195360+0000","last_peered":"2023-10-06T03:09:49.195360+0000","last_clean":"2023-10-06T03:09:49.195360+0000","last_became_active":"2023-10-06T02:59:53.678471+0000","last_became_peered":"2023-10-06T02:59:53.678471+0000","last_unstale":"2023-10-06T03:09:49.195360+0000","last_undegraded":"2023-10-06T03:09:49.195360+0000","last_fullsized":"2023-10-06T03:09:49.195360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'1517","reported_seq":1529,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.502219+0000","last_change":"2023-10-06T02:59:53.297136+0000","last_active":"2023-10-06T03:09:37.502219+0000","last_peered":"2023-10-06T03:09:37.502219+0000","last_clean":"2023-10-06T03:09:37.502219+0000","last_became_active":"2023-10-06T02:59:53.296816+0000","last_became_peered":"2023-10-06T02:59:53.296816+0000","last_unstale":"2023-10-06T03:09:37.502219+0000","last_undegraded":"2023-10-06T03:09:37.502219+0000","last_fullsized":"2023-10-06T03:09:37.502219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:58.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1406,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'65","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.175064+0000","last_change":"2023-10-06T02:59:53.684876+0000","last_active":"2023-10-06T03:09:49.175064+0000","last_peered":"2023-10-06T03:09:49.175064+0000","last_clean":"2023-10-06T03:09:49.175064+0000","last_became_active":"2023-10-06T02:59:53.684522+0000","last_became_peered":"2023-10-06T02:59:53.684522+0000","last_unstale":"2023-10-06T03:09:49.175064+0000","last_undegraded":"2023-10-06T03:09:49.175064+0000","last_fullsized":"2023-10-06T03:09:49.175064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"26'125","reported_seq":137,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.507239+0000","last_change":"2023-10-06T02:59:53.292700+0000","last_active":"2023-10-06T03:09:37.507239+0000","last_peered":"2023-10-06T03:09:37.507239+0000","last_clean":"2023-10-06T03:09:37.507239+0000","last_became_active":"2023-10-06T02:59:53.292378+0000","last_became_peered":"2023-10-06T02:59:53.292378+0000","last_unstale":"2023-10-06T03:09:37.507239+0000","last_undegraded":"2023-10-06T03:09:37.507239+0000","last_fullsized":"2023-10-06T03:09:37.507239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204649+0000","last_change":"2023-10-06T02:59:53.675542+0000","last_active":"2023-10-06T03:09:49.204649+0000","last_peered":"2023-10-06T03:09:49.204649+0000","last_clean":"2023-10-06T03:09:49.204649+0000","last_became_active":"2023-10-06T02:59:53.675219+0000","last_became_peered":"2023-10-06T02:59:53.675219+0000","last_unstale":"2023-10-06T03:09:49.204649+0000","last_undegraded":"2023-10-06T03:09:49.204649+0000","last_fullsized":"2023-10-06T03:09:49.204649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"26'124","reported_seq":136,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.177954+0000","last_change":"2023-10-06T02:59:53.302122+0000","last_active":"2023-10-06T03:08:41.177954+0000","last_peered":"2023-10-06T03:08:41.177954+0000","last_clean":"2023-10-06T03:08:41.177954+0000","last_became_active":"2023-10-06T02:59:53.301737+0000","last_became_peered":"2023-10-06T02:59:53.301737+0000","last_unstale":"2023-10-06T03:08:41.177954+0000","last_undegraded":"2023-10-06T03:08:41.177954+0000","last_fullsized":"2023-10-06T03:08:41.177954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203476+0000","last_change":"2023-10-06T02:59:53.684854+0000","last_active":"2023-10-06T03:09:49.203476+0000","last_peered":"2023-10-06T03:09:49.203476+0000","last_clean":"2023-10-06T03:09:49.203476+0000","last_became_active":"2023-10-06T02:59:53.684527+0000","last_became_peered":"2023-10-06T02:59:53.684527+0000","last_unstale":"2023-10-06T03:09:49.203476+0000","last_undegraded":"2023-10-06T03:09:49.203476+0000","last_fullsized":"2023-10-06T03:09:49.203476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"26'135","reported_seq":147,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.502731+0000","last_change":"2023-10-06T02:59:53.294103+0000","last_active":"2023-10-06T03:09:37.502731+0000","last_peered":"2023-10-06T03:09:37.502731+0000","last_clean":"2023-10-06T03:09:37.502731+0000","last_became_active":"2023-10-06T02:59:53.293707+0000","last_became_peered":"2023-10-06T02:59:53.293707+0000","last_unstale":"2023-10-06T03:09:37.502731+0000","last_undegraded":"2023-10-06T03:09:37.502731+0000","last_fullsized":"2023-10-06T03:09:37.502731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"26'118","reported_seq":130,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505440+0000","last_change":"2023-10-06T02:59:53.296507+0000","last_active":"2023-10-06T03:09:37.505440+0000","last_peered":"2023-10-06T03:09:37.505440+0000","last_clean":"2023-10-06T03:09:37.505440+0000","last_became_active":"2023-10-06T02:59:53.296230+0000","last_became_peered":"2023-10-06T02:59:53.296230+0000","last_unstale":"2023-10-06T03:09:37.505440+0000","last_undegraded":"2023-10-06T03:09:37.505440+0000","last_fullsized":"2023-10-06T03:09:37.505440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"26'90","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.176351+0000","last_change":"2023-10-06T02:59:53.684046+0000","last_active":"2023-10-06T03:09:49.176351+0000","last_peered":"2023-10-06T03:09:49.176351+0000","last_clean":"2023-10-06T03:09:49.176351+0000","last_became_active":"2023-10-06T02:59:53.683705+0000","last_became_peered":"2023-10-06T02:59:53.683705+0000","last_unstale":"2023-10-06T03:09:49.176351+0000","last_undegraded":"2023-10-06T03:09:49.176351+0000","last_fullsized":"2023-10-06T03:09:49.176351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'106","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.175579+0000","last_change":"2023-10-06T02:59:53.296465+0000","last_active":"2023-10-06T03:08:41.175579+0000","last_peered":"2023-10-06T03:08:41.175579+0000","last_clean":"2023-10-06T03:08:41.175579+0000","last_became_active":"2023-10-06T02:59:53.296225+0000","last_became_peered":"2023-10-06T02:59:53.296225+0000","last_unstale":"2023-10-06T03:08:41.175579+0000","last_undegraded":"2023-10-06T03:08:41.175579+0000","last_fullsized":"2023-10-06T03:08:41.175579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'81","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.198537+0000","last_change":"2023-10-06T02:59:53.683216+0000","last_active":"2023-10-06T03:09:49.198537+0000","last_peered":"2023-10-06T03:09:49.198537+0000","last_clean":"2023-10-06T03:09:49.198537+0000","last_became_active":"2023-10-06T02:59:53.682938+0000","last_became_peered":"2023-10-06T02:59:53.682938+0000","last_unstale":"2023-10-06T03:09:49.198537+0000","last_undegraded":"2023-10-06T03:09:49.198537+0000","last_fullsized":"2023-10-06T03:09:49.198537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"26'620","reported_seq":632,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.502276+0000","last_change":"2023-10-06T02:59:53.293929+0000","last_active":"2023-10-06T03:09:37.502276+0000","last_peered":"2023-10-06T03:09:37.502276+0000","last_clean":"2023-10-06T03:09:37.502276+0000","last_became_active":"2023-10-06T02:59:53.293602+0000","last_became_peered":"2023-10-06T02:59:53.293602+0000","last_unstale":"2023-10-06T03:09:37.502276+0000","last_undegraded":"2023-10-06T03:09:37.502276+0000","last_fullsized":"2023-10-06T03:09:37.502276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196618+0000","last_change":"2023-10-06T02:59:53.672111+0000","last_active":"2023-10-06T03:09:49.196618+0000","last_peered":"2023-10-06T03:09:49.196618+0000","last_clean":"2023-10-06T03:09:49.196618+0000","last_became_active":"2023-10-06T02:59:53.671511+0000","last_became_peered":"2023-10-06T02:59:53.671511+0000","last_unstale":"2023-10-06T03:09:49.196618+0000","last_undegraded":"2023-10-06T03:09:49.196618+0000","last_fullsized":"2023-10-06T03:09:49.196618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'134","reported_seq":146,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.170376+0000","last_change":"2023-10-06T02:59:53.300059+0000","last_active":"2023-10-06T03:08:41.170376+0000","last_peered":"2023-10-06T03:08:41.170376+0000","last_clean":"2023-10-06T03:08:41.170376+0000","last_became_active":"2023-10-06T02:59:53.299715+0000","last_became_peered":"2023-10-06T02:59:53.299715+0000","last_unstale":"2023-10-06T03:08:41.170376+0000","last_undegraded":"2023-10-06T03:08:41.170376+0000","last_fullsized":"2023-10-06T03:08:41.170376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"26'94","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200602+0000","last_change":"2023-10-06T02:59:53.683331+0000","last_active":"2023-10-06T03:09:49.200602+0000","last_peered":"2023-10-06T03:09:49.200602+0000","last_clean":"2023-10-06T03:09:49.200602+0000","last_became_active":"2023-10-06T02:59:53.682994+0000","last_became_peered":"2023-10-06T02:59:53.682994+0000","last_unstale":"2023-10-06T03:09:49.200602+0000","last_undegraded":"2023-10-06T03:09:49.200602+0000","last_fullsized":"2023-10-06T03:09:49.200602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:09.337917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'618","reported_seq":630,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.504933+0000","last_change":"2023-10-06T02:59:53.301126+0000","last_active":"2023-10-06T03:09:38.504933+0000","last_peered":"2023-10-06T03:09:38.504933+0000","last_clean":"2023-10-06T03:09:38.504933+0000","last_became_active":"2023-10-06T02:59:53.300850+0000","last_became_peered":"2023-10-06T02:59:53.300850+0000","last_unstale":"2023-10-06T03:09:38.504933+0000","last_undegraded":"2023-10-06T03:09:38.504933+0000","last_fullsized":"2023-10-06T03:09:38.504933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204076+0000","last_change":"2023-10-06T02:59:53.678930+0000","last_active":"2023-10-06T03:09:49.204076+0000","last_peered":"2023-10-06T03:09:49.204076+0000","last_clean":"2023-10-06T03:09:49.204076+0000","last_became_active":"2023-10-06T02:59:53.678630+0000","last_became_peered":"2023-10-06T02:59:53.678630+0000","last_unstale":"2023-10-06T03:09:49.204076+0000","last_undegraded":"2023-10-06T03:09:49.204076+0000","last_fullsized":"2023-10-06T03:09:49.204076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:14.961350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'128","reported_seq":140,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:42.163802+0000","last_change":"2023-10-06T02:59:53.291521+0000","last_active":"2023-10-06T03:08:42.163802+0000","last_peered":"2023-10-06T03:08:42.163802+0000","last_clean":"2023-10-06T03:08:42.163802+0000","last_became_active":"2023-10-06T02:59:53.290773+0000","last_became_peered":"2023-10-06T02:59:53.290773+0000","last_unstale":"2023-10-06T03:08:42.163802+0000","last_undegraded":"2023-10-06T03:08:42.163802+0000","last_fullsized":"2023-10-06T03:08:42.163802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.198768+0000","last_change":"2023-10-06T02:59:53.678188+0000","last_active":"2023-10-06T03:09:49.198768+0000","last_peered":"2023-10-06T03:09:49.198768+0000","last_clean":"2023-10-06T03:09:49.198768+0000","last_became_active":"2023-10-06T02:59:53.676507+0000","last_became_peered":"2023-10-06T02:59:53.676507+0000","last_unstale":"2023-10-06T03:09:49.198768+0000","last_undegraded":"2023-10-06T03:09:49.198768+0000","last_fullsized":"2023-10-06T03:09:49.198768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"26'126","reported_seq":138,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.500688+0000","last_change":"2023-10-06T02:59:53.289980+0000","last_active":"2023-10-06T03:09:37.500688+0000","last_peered":"2023-10-06T03:09:37.500688+0000","last_clean":"2023-10-06T03:09:37.500688+0000","last_became_active":"2023-10-06T02:59:53.288601+0000","last_became_peered":"2023-10-06T02:59:53.288601+0000","last_unstale":"2023-10-06T03:09:37.500688+0000","last_undegraded":"2023-10-06T03:09:37.500688+0000","last_fullsized":"2023-10-06T03:09:37.500688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:54.630392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191584+0000","last_change":"2023-10-06T02:59:53.675456+0000","last_active":"2023-10-06T03:09:49.191584+0000","last_peered":"2023-10-06T03:09:49.191584+0000","last_clean":"2023-10-06T03:09:49.191584+0000","last_became_active":"2023-10-06T02:59:53.673268+0000","last_became_peered":"2023-10-06T02:59:53.673268+0000","last_unstale":"2023-10-06T03:09:49.191584+0000","last_undegraded":"2023-10-06T03:09:49.191584+0000","last_fullsized":"2023-10-06T03:09:49.191584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'687","reported_seq":699,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505021+0000","last_change":"2023-10-06T02:59:53.298398+0000","last_active":"2023-10-06T03:09:37.505021+0000","last_peered":"2023-10-06T03:09:37.505021+0000","last_clean":"2023-10-06T03:09:37.505021+0000","last_became_active":"2023-10-06T02:59:53.297896+0000","last_became_peered":"2023-10-06T02:59:53.297896+0000","last_unstale":"2023-10-06T03:09:37.505021+0000","last_undegraded":"2023-10-06T03:09:37.505021+0000","last_fullsized":"2023-10-06T03:09:37.505021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205139+0000","last_change":"2023-10-06T02:59:53.679712+0000","last_active":"2023-10-06T03:09:49.205139+0000","last_peered":"2023-10-06T03:09:49.205139+0000","last_clean":"2023-10-06T03:09:49.205139+0000","last_became_active":"2023-10-06T02:59:53.679390+0000","last_became_peered":"2023-10-06T02:59:53.679390+0000","last_unstale":"2023-10-06T03:09:49.205139+0000","last_undegraded":"2023-10-06T03:09:49.205139+0000","last_fullsized":"2023-10-06T03:09:49.205139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:34.124779+0000","last_change":"2023-10-06T02:59:44.074625+0000","last_active":"2023-10-06T03:00:34.124779+0000","last_peered":"2023-10-06T03:00:34.124779+0000","last_clean":"2023-10-06T03:00:34.124779+0000","last_became_active":"2023-10-06T02:59:44.072854+0000","last_became_peered":"2023-10-06T02:59:44.072854+0000","last_unstale":"2023-10-06T03:00:34.124779+0000","last_undegraded":"2023-10-06T03:00:34.124779+0000","last_fullsized":"2023-10-06T03:00:34.124779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:43.039151+0000","last_clean_scrub_stamp":"2023-10-06T02:59:43.039151+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:04.936706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.738241+0000","last_change":"2023-10-06T02:59:49.107090+0000","last_active":"2023-10-06T03:00:33.738241+0000","last_peered":"2023-10-06T03:00:33.738241+0000","last_clean":"2023-10-06T03:00:33.738241+0000","last_became_active":"2023-10-06T02:59:49.106619+0000","last_became_peered":"2023-10-06T02:59:49.106619+0000","last_unstale":"2023-10-06T03:00:33.738241+0000","last_undegraded":"2023-10-06T03:00:33.738241+0000","last_fullsized":"2023-10-06T03:00:33.738241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"26'1461","reported_seq":1473,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506597+0000","last_change":"2023-10-06T02:59:53.298769+0000","last_active":"2023-10-06T03:09:37.506597+0000","last_peered":"2023-10-06T03:09:37.506597+0000","last_clean":"2023-10-06T03:09:37.506597+0000","last_became_active":"2023-10-06T02:59:53.298012+0000","last_became_peered":"2023-10-06T02:59:53.298012+0000","last_unstale":"2023-10-06T03:09:37.506597+0000","last_undegraded":"2023-10-06T03:09:37.506597+0000","last_fullsized":"2023-10-06T03:09:37.506597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1461,"log_dups_size":0,"ondisk_log_size":1461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1329,"num_write_kb":8969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"26'92","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.181004+0000","last_change":"2023-10-06T02:59:53.679625+0000","last_active":"2023-10-06T03:09:49.181004+0000","last_peered":"2023-10-06T03:09:49.181004+0000","last_clean":"2023-10-06T03:09:49.181004+0000","last_became_active":"2023-10-06T02:59:53.679200+0000","last_became_peered":"2023-10-06T02:59:53.679200+0000","last_unstale":"2023-10-06T03:09:49.181004+0000","last_undegraded":"2023-10-06T03:09:49.181004+0000","last_fullsized":"2023-10-06T03:09:49.181004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:59.309901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:34.124485+0000","last_change":"2023-10-06T02:59:49.107231+0000","last_active":"2023-10-06T03:00:34.124485+0000","last_peered":"2023-10-06T03:00:34.124485+0000","last_clean":"2023-10-06T03:00:34.124485+0000","last_became_active":"2023-10-06T02:59:49.106878+0000","last_became_peered":"2023-10-06T02:59:49.106878+0000","last_unstale":"2023-10-06T03:00:34.124485+0000","last_undegraded":"2023-10-06T03:00:34.124485+0000","last_fullsized":"2023-10-06T03:00:34.124485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"26'603","reported_seq":1098,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:39.495232+0000","last_change":"2023-10-06T02:59:53.296937+0000","last_active":"2023-10-06T03:09:39.495232+0000","last_peered":"2023-10-06T03:09:39.495232+0000","last_clean":"2023-10-06T03:09:39.495232+0000","last_became_active":"2023-10-06T02:59:53.296171+0000","last_became_peered":"2023-10-06T02:59:53.296171+0000","last_unstale":"2023-10-06T03:09:39.495232+0000","last_undegraded":"2023-10-06T03:09:39.495232+0000","last_fullsized":"2023-10-06T03:09:39.495232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770024,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":483,"num_write_kb":1079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"26'88","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200671+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T03:09:49.200671+0000","last_peered":"2023-10-06T03:09:49.200671+0000","last_clean":"2023-10-06T03:09:49.200671+0000","last_became_active":"2023-10-06T02:59:53.681786+0000","last_became_peered":"2023-10-06T02:59:53.681786+0000","last_unstale":"2023-10-06T03:09:49.200671+0000","last_undegraded":"2023-10-06T03:09:49.200671+0000","last_fullsized":"2023-10-06T03:09:49.200671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.390959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.733289+0000","last_change":"2023-10-06T02:59:49.115200+0000","last_active":"2023-10-06T03:00:33.733289+0000","last_peered":"2023-10-06T03:00:33.733289+0000","last_clean":"2023-10-06T03:00:33.733289+0000","last_became_active":"2023-10-06T02:59:49.114769+0000","last_became_peered":"2023-10-06T02:59:49.114769+0000","last_unstale":"2023-10-06T03:00:33.733289+0000","last_undegraded":"2023-10-06T03:00:33.733289+0000","last_fullsized":"2023-10-06T03:00:33.733289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:37.773233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'1468","reported_seq":1480,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:07.312340+0000","last_change":"2023-10-06T02:59:53.298658+0000","last_active":"2023-10-06T03:09:07.312340+0000","last_peered":"2023-10-06T03:09:07.312340+0000","last_clean":"2023-10-06T03:09:07.312340+0000","last_became_active":"2023-10-06T02:59:53.298054+0000","last_became_peered":"2023-10-06T02:59:53.298054+0000","last_unstale":"2023-10-06T03:09:07.312340+0000","last_undegraded":"2023-10-06T03:09:07.312340+0000","last_fullsized":"2023-10-06T03:09:07.312340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1468,"log_dups_size":0,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1335,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.199508+0000","last_change":"2023-10-06T02:59:53.673950+0000","last_active":"2023-10-06T03:09:49.199508+0000","last_peered":"2023-10-06T03:09:49.199508+0000","last_clean":"2023-10-06T03:09:49.199508+0000","last_became_active":"2023-10-06T02:59:53.673677+0000","last_became_peered":"2023-10-06T02:59:53.673677+0000","last_unstale":"2023-10-06T03:09:49.199508+0000","last_undegraded":"2023-10-06T03:09:49.199508+0000","last_fullsized":"2023-10-06T03:09:49.199508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:59.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.738308+0000","last_change":"2023-10-06T02:59:49.107944+0000","last_active":"2023-10-06T03:00:33.738308+0000","last_peered":"2023-10-06T03:00:33.738308+0000","last_clean":"2023-10-06T03:00:33.738308+0000","last_became_active":"2023-10-06T02:59:49.107560+0000","last_became_peered":"2023-10-06T02:59:49.107560+0000","last_unstale":"2023-10-06T03:00:33.738308+0000","last_undegraded":"2023-10-06T03:00:33.738308+0000","last_fullsized":"2023-10-06T03:00:33.738308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'122","reported_seq":134,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506182+0000","last_change":"2023-10-06T02:59:53.300945+0000","last_active":"2023-10-06T03:09:37.506182+0000","last_peered":"2023-10-06T03:09:37.506182+0000","last_clean":"2023-10-06T03:09:37.506182+0000","last_became_active":"2023-10-06T02:59:53.300609+0000","last_became_peered":"2023-10-06T02:59:53.300609+0000","last_unstale":"2023-10-06T03:09:37.506182+0000","last_undegraded":"2023-10-06T03:09:37.506182+0000","last_fullsized":"2023-10-06T03:09:37.506182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"26'78","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192720+0000","last_change":"2023-10-06T03:00:34.740673+0000","last_active":"2023-10-06T03:09:49.192720+0000","last_peered":"2023-10-06T03:09:49.192720+0000","last_clean":"2023-10-06T03:09:49.192720+0000","last_became_active":"2023-10-06T03:00:34.740140+0000","last_became_peered":"2023-10-06T03:00:34.740140+0000","last_unstale":"2023-10-06T03:09:49.192720+0000","last_undegraded":"2023-10-06T03:09:49.192720+0000","last_fullsized":"2023-10-06T03:09:49.192720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.929423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'105","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.499293+0000","last_change":"2023-10-06T02:59:53.301191+0000","last_active":"2023-10-06T03:09:37.499293+0000","last_peered":"2023-10-06T03:09:37.499293+0000","last_clean":"2023-10-06T03:09:37.499293+0000","last_became_active":"2023-10-06T02:59:53.300919+0000","last_became_peered":"2023-10-06T02:59:53.300919+0000","last_unstale":"2023-10-06T03:09:37.499293+0000","last_undegraded":"2023-10-06T03:09:37.499293+0000","last_fullsized":"2023-10-06T03:09:37.499293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.741892+0000","last_change":"2023-10-06T02:59:49.108499+0000","last_active":"2023-10-06T03:00:33.741892+0000","last_peered":"2023-10-06T03:00:33.741892+0000","last_clean":"2023-10-06T03:00:33.741892+0000","last_became_active":"2023-10-06T02:59:49.107967+0000","last_became_peered":"2023-10-06T02:59:49.107967+0000","last_unstale":"2023-10-06T03:00:33.741892+0000","last_undegraded":"2023-10-06T03:00:33.741892+0000","last_fullsized":"2023-10-06T03:00:33.741892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'75","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195724+0000","last_change":"2023-10-06T02:59:53.676753+0000","last_active":"2023-10-06T03:09:49.195724+0000","last_peered":"2023-10-06T03:09:49.195724+0000","last_clean":"2023-10-06T03:09:49.195724+0000","last_became_active":"2023-10-06T02:59:53.676385+0000","last_became_peered":"2023-10-06T02:59:53.676385+0000","last_unstale":"2023-10-06T03:09:49.195724+0000","last_undegraded":"2023-10-06T03:09:49.195724+0000","last_fullsized":"2023-10-06T03:09:49.195724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:39.774858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"26'115","reported_seq":127,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.178338+0000","last_change":"2023-10-06T02:59:53.303221+0000","last_active":"2023-10-06T03:08:41.178338+0000","last_peered":"2023-10-06T03:08:41.178338+0000","last_clean":"2023-10-06T03:08:41.178338+0000","last_became_active":"2023-10-06T02:59:53.302890+0000","last_became_peered":"2023-10-06T02:59:53.302890+0000","last_unstale":"2023-10-06T03:08:41.178338+0000","last_undegraded":"2023-10-06T03:08:41.178338+0000","last_fullsized":"2023-10-06T03:08:41.178338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:34.125363+0000","last_change":"2023-10-06T02:59:49.102005+0000","last_active":"2023-10-06T03:00:34.125363+0000","last_peered":"2023-10-06T03:00:34.125363+0000","last_clean":"2023-10-06T03:00:34.125363+0000","last_became_active":"2023-10-06T02:59:49.101530+0000","last_became_peered":"2023-10-06T02:59:49.101530+0000","last_unstale":"2023-10-06T03:00:34.125363+0000","last_undegraded":"2023-10-06T03:00:34.125363+0000","last_fullsized":"2023-10-06T03:00:34.125363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'79","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.186999+0000","last_change":"2023-10-06T02:59:53.672581+0000","last_active":"2023-10-06T03:09:49.186999+0000","last_peered":"2023-10-06T03:09:49.186999+0000","last_clean":"2023-10-06T03:09:49.186999+0000","last_became_active":"2023-10-06T02:59:53.672299+0000","last_became_peered":"2023-10-06T02:59:53.672299+0000","last_unstale":"2023-10-06T03:09:49.186999+0000","last_undegraded":"2023-10-06T03:09:49.186999+0000","last_fullsized":"2023-10-06T03:09:49.186999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"26'120","reported_seq":132,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.177130+0000","last_change":"2023-10-06T02:59:53.300135+0000","last_active":"2023-10-06T03:08:41.177130+0000","last_peered":"2023-10-06T03:08:41.177130+0000","last_clean":"2023-10-06T03:08:41.177130+0000","last_became_active":"2023-10-06T02:59:53.299271+0000","last_became_peered":"2023-10-06T02:59:53.299271+0000","last_unstale":"2023-10-06T03:08:41.177130+0000","last_undegraded":"2023-10-06T03:08:41.177130+0000","last_fullsized":"2023-10-06T03:08:41.177130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.742127+0000","last_change":"2023-10-06T02:59:49.100171+0000","last_active":"2023-10-06T03:00:33.742127+0000","last_peered":"2023-10-06T03:00:33.742127+0000","last_clean":"2023-10-06T03:00:33.742127+0000","last_became_active":"2023-10-06T02:59:49.099689+0000","last_became_peered":"2023-10-06T02:59:49.099689+0000","last_unstale":"2023-10-06T03:00:33.742127+0000","last_undegraded":"2023-10-06T03:00:33.742127+0000","last_fullsized":"2023-10-06T03:00:33.742127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:29.393217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'94","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203550+0000","last_change":"2023-10-06T02:59:53.685270+0000","last_active":"2023-10-06T03:09:49.203550+0000","last_peered":"2023-10-06T03:09:49.203550+0000","last_clean":"2023-10-06T03:09:49.203550+0000","last_became_active":"2023-10-06T02:59:53.684983+0000","last_became_peered":"2023-10-06T02:59:53.684983+0000","last_unstale":"2023-10-06T03:09:49.203550+0000","last_undegraded":"2023-10-06T03:09:49.203550+0000","last_fullsized":"2023-10-06T03:09:49.203550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:49.904101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'244","reported_seq":256,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.504458+0000","last_change":"2023-10-06T02:59:53.301048+0000","last_active":"2023-10-06T03:09:38.504458+0000","last_peered":"2023-10-06T03:09:38.504458+0000","last_clean":"2023-10-06T03:09:38.504458+0000","last_became_active":"2023-10-06T02:59:53.300086+0000","last_became_peered":"2023-10-06T02:59:53.300086+0000","last_unstale":"2023-10-06T03:09:38.504458+0000","last_undegraded":"2023-10-06T03:09:38.504458+0000","last_fullsized":"2023-10-06T03:09:38.504458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:52.836049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:00:33.732387+0000","last_change":"2023-10-06T02:59:49.102935+0000","last_active":"2023-10-06T03:00:33.732387+0000","last_peered":"2023-10-06T03:00:33.732387+0000","last_clean":"2023-10-06T03:00:33.732387+0000","last_became_active":"2023-10-06T02:59:49.102397+0000","last_became_peered":"2023-10-06T02:59:49.102397+0000","last_unstale":"2023-10-06T03:00:33.732387+0000","last_undegraded":"2023-10-06T03:00:33.732387+0000","last_fullsized":"2023-10-06T03:00:33.732387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:48.080036+0000","last_clean_scrub_stamp":"2023-10-06T02:59:48.080036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:27.739260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'77","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192435+0000","last_change":"2023-10-06T02:59:53.676229+0000","last_active":"2023-10-06T03:09:49.192435+0000","last_peered":"2023-10-06T03:09:49.192435+0000","last_clean":"2023-10-06T03:09:49.192435+0000","last_became_active":"2023-10-06T02:59:53.675895+0000","last_became_peered":"2023-10-06T02:59:53.675895+0000","last_unstale":"2023-10-06T03:09:49.192435+0000","last_undegraded":"2023-10-06T03:09:49.192435+0000","last_fullsized":"2023-10-06T03:09:49.192435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:03.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"26'85","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.188557+0000","last_change":"2023-10-06T02:59:53.676843+0000","last_active":"2023-10-06T03:09:49.188557+0000","last_peered":"2023-10-06T03:09:49.188557+0000","last_clean":"2023-10-06T03:09:49.188557+0000","last_became_active":"2023-10-06T02:59:53.676528+0000","last_became_peered":"2023-10-06T02:59:53.676528+0000","last_unstale":"2023-10-06T03:09:49.188557+0000","last_undegraded":"2023-10-06T03:09:49.188557+0000","last_fullsized":"2023-10-06T03:09:49.188557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:38.704160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'529","reported_seq":541,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505437+0000","last_change":"2023-10-06T02:59:53.294557+0000","last_active":"2023-10-06T03:09:37.505437+0000","last_peered":"2023-10-06T03:09:37.505437+0000","last_clean":"2023-10-06T03:09:37.505437+0000","last_became_active":"2023-10-06T02:59:53.291434+0000","last_became_peered":"2023-10-06T02:59:53.291434+0000","last_unstale":"2023-10-06T03:09:37.505437+0000","last_undegraded":"2023-10-06T03:09:37.505437+0000","last_fullsized":"2023-10-06T03:09:37.505437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:13.761037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'80","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196820+0000","last_change":"2023-10-06T02:59:53.678204+0000","last_active":"2023-10-06T03:09:49.196820+0000","last_peered":"2023-10-06T03:09:49.196820+0000","last_clean":"2023-10-06T03:09:49.196820+0000","last_became_active":"2023-10-06T02:59:53.677924+0000","last_became_peered":"2023-10-06T02:59:53.677924+0000","last_unstale":"2023-10-06T03:09:49.196820+0000","last_undegraded":"2023-10-06T03:09:49.196820+0000","last_fullsized":"2023-10-06T03:09:49.196820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"26'336","reported_seq":348,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.507759+0000","last_change":"2023-10-06T02:59:53.301253+0000","last_active":"2023-10-06T03:09:38.507759+0000","last_peered":"2023-10-06T03:09:38.507759+0000","last_clean":"2023-10-06T03:09:38.507759+0000","last_became_active":"2023-10-06T02:59:53.300926+0000","last_became_peered":"2023-10-06T02:59:53.300926+0000","last_unstale":"2023-10-06T03:09:38.507759+0000","last_undegraded":"2023-10-06T03:09:38.507759+0000","last_fullsized":"2023-10-06T03:09:38.507759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:21.432516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'135","reported_seq":147,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.500451+0000","last_change":"2023-10-06T02:59:53.292844+0000","last_active":"2023-10-06T03:09:37.500451+0000","last_peered":"2023-10-06T03:09:37.500451+0000","last_clean":"2023-10-06T03:09:37.500451+0000","last_became_active":"2023-10-06T02:59:53.292493+0000","last_became_peered":"2023-10-06T02:59:53.292493+0000","last_unstale":"2023-10-06T03:09:37.500451+0000","last_undegraded":"2023-10-06T03:09:37.500451+0000","last_fullsized":"2023-10-06T03:09:37.500451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"26'94","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206446+0000","last_change":"2023-10-06T02:59:53.676684+0000","last_active":"2023-10-06T03:09:49.206446+0000","last_peered":"2023-10-06T03:09:49.206446+0000","last_clean":"2023-10-06T03:09:49.206446+0000","last_became_active":"2023-10-06T02:59:53.676410+0000","last_became_peered":"2023-10-06T02:59:53.676410+0000","last_unstale":"2023-10-06T03:09:49.206446+0000","last_undegraded":"2023-10-06T03:09:49.206446+0000","last_fullsized":"2023-10-06T03:09:49.206446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"26'122","reported_seq":134,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.501788+0000","last_change":"2023-10-06T02:59:53.293924+0000","last_active":"2023-10-06T03:09:37.501788+0000","last_peered":"2023-10-06T03:09:37.501788+0000","last_clean":"2023-10-06T03:09:37.501788+0000","last_became_active":"2023-10-06T02:59:53.293596+0000","last_became_peered":"2023-10-06T02:59:53.293596+0000","last_unstale":"2023-10-06T03:09:37.501788+0000","last_undegraded":"2023-10-06T03:09:37.501788+0000","last_fullsized":"2023-10-06T03:09:37.501788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:05.391436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"26'91","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203618+0000","last_change":"2023-10-06T02:59:53.673847+0000","last_active":"2023-10-06T03:09:49.203618+0000","last_peered":"2023-10-06T03:09:49.203618+0000","last_clean":"2023-10-06T03:09:49.203618+0000","last_became_active":"2023-10-06T02:59:53.673559+0000","last_became_peered":"2023-10-06T02:59:53.673559+0000","last_unstale":"2023-10-06T03:09:49.203618+0000","last_undegraded":"2023-10-06T03:09:49.203618+0000","last_fullsized":"2023-10-06T03:09:49.203618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:48.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"26'76","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.174477+0000","last_change":"2023-10-06T02:59:53.674388+0000","last_active":"2023-10-06T03:09:49.174477+0000","last_peered":"2023-10-06T03:09:49.174477+0000","last_clean":"2023-10-06T03:09:49.174477+0000","last_became_active":"2023-10-06T02:59:53.674086+0000","last_became_peered":"2023-10-06T02:59:53.674086+0000","last_unstale":"2023-10-06T03:09:49.174477+0000","last_undegraded":"2023-10-06T03:09:49.174477+0000","last_fullsized":"2023-10-06T03:09:49.174477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:22.444528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'1576","reported_seq":1588,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.145397+0000","last_change":"2023-10-06T02:59:53.296871+0000","last_active":"2023-10-06T03:09:49.145397+0000","last_peered":"2023-10-06T03:09:49.145397+0000","last_clean":"2023-10-06T03:09:49.145397+0000","last_became_active":"2023-10-06T02:59:53.296550+0000","last_became_peered":"2023-10-06T02:59:53.296550+0000","last_unstale":"2023-10-06T03:09:49.145397+0000","last_undegraded":"2023-10-06T03:09:49.145397+0000","last_fullsized":"2023-10-06T03:09:49.145397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1576,"log_dups_size":0,"ondisk_log_size":1576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7633302,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1449,"num_write_kb":8304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'82","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.178500+0000","last_change":"2023-10-06T02:59:53.683771+0000","last_active":"2023-10-06T03:09:49.178500+0000","last_peered":"2023-10-06T03:09:49.178500+0000","last_clean":"2023-10-06T03:09:49.178500+0000","last_became_active":"2023-10-06T02:59:53.683458+0000","last_became_peered":"2023-10-06T02:59:53.683458+0000","last_unstale":"2023-10-06T03:09:49.178500+0000","last_undegraded":"2023-10-06T03:09:49.178500+0000","last_fullsized":"2023-10-06T03:09:49.178500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:07.697782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'118","reported_seq":130,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.168177+0000","last_change":"2023-10-06T02:59:53.301158+0000","last_active":"2023-10-06T03:08:41.168177+0000","last_peered":"2023-10-06T03:08:41.168177+0000","last_clean":"2023-10-06T03:08:41.168177+0000","last_became_active":"2023-10-06T02:59:53.300797+0000","last_became_peered":"2023-10-06T02:59:53.300797+0000","last_unstale":"2023-10-06T03:08:41.168177+0000","last_undegraded":"2023-10-06T03:08:41.168177+0000","last_fullsized":"2023-10-06T03:08:41.168177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"26'77","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203877+0000","last_change":"2023-10-06T02:59:53.683576+0000","last_active":"2023-10-06T03:09:49.203877+0000","last_peered":"2023-10-06T03:09:49.203877+0000","last_clean":"2023-10-06T03:09:49.203877+0000","last_became_active":"2023-10-06T02:59:53.683301+0000","last_became_peered":"2023-10-06T02:59:53.683301+0000","last_unstale":"2023-10-06T03:09:49.203877+0000","last_undegraded":"2023-10-06T03:09:49.203877+0000","last_fullsized":"2023-10-06T03:09:49.203877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:05.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'489","reported_seq":501,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.504119+0000","last_change":"2023-10-06T02:59:53.297975+0000","last_active":"2023-10-06T03:09:37.504119+0000","last_peered":"2023-10-06T03:09:37.504119+0000","last_clean":"2023-10-06T03:09:37.504119+0000","last_became_active":"2023-10-06T02:59:53.297724+0000","last_became_peered":"2023-10-06T02:59:53.297724+0000","last_unstale":"2023-10-06T03:09:37.504119+0000","last_undegraded":"2023-10-06T03:09:37.504119+0000","last_fullsized":"2023-10-06T03:09:37.504119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:21.317777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":4283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'74","reported_seq":85,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.201472+0000","last_change":"2023-10-06T02:59:53.684667+0000","last_active":"2023-10-06T03:09:49.201472+0000","last_peered":"2023-10-06T03:09:49.201472+0000","last_clean":"2023-10-06T03:09:49.201472+0000","last_became_active":"2023-10-06T02:59:53.684378+0000","last_became_peered":"2023-10-06T02:59:53.684378+0000","last_unstale":"2023-10-06T03:09:49.201472+0000","last_undegraded":"2023-10-06T03:09:49.201472+0000","last_fullsized":"2023-10-06T03:09:49.201472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:40.914600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"26'935","reported_seq":947,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.503096+0000","last_change":"2023-10-06T02:59:53.298276+0000","last_active":"2023-10-06T03:09:37.503096+0000","last_peered":"2023-10-06T03:09:37.503096+0000","last_clean":"2023-10-06T03:09:37.503096+0000","last_became_active":"2023-10-06T02:59:53.297471+0000","last_became_peered":"2023-10-06T02:59:53.297471+0000","last_unstale":"2023-10-06T03:09:37.503096+0000","last_undegraded":"2023-10-06T03:09:37.503096+0000","last_fullsized":"2023-10-06T03:09:37.503096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:45.293145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":4592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'78","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204791+0000","last_change":"2023-10-06T02:59:53.679138+0000","last_active":"2023-10-06T03:09:49.204791+0000","last_peered":"2023-10-06T03:09:49.204791+0000","last_clean":"2023-10-06T03:09:49.204791+0000","last_became_active":"2023-10-06T02:59:53.678831+0000","last_became_peered":"2023-10-06T02:59:53.678831+0000","last_unstale":"2023-10-06T03:09:49.204791+0000","last_undegraded":"2023-10-06T03:09:49.204791+0000","last_fullsized":"2023-10-06T03:09:49.204791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:25.273960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"26'113","reported_seq":125,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.505705+0000","last_change":"2023-10-06T02:59:53.295949+0000","last_active":"2023-10-06T03:09:37.505705+0000","last_peered":"2023-10-06T03:09:37.505705+0000","last_clean":"2023-10-06T03:09:37.505705+0000","last_became_active":"2023-10-06T02:59:53.295697+0000","last_became_peered":"2023-10-06T02:59:53.295697+0000","last_unstale":"2023-10-06T03:09:37.505705+0000","last_undegraded":"2023-10-06T03:09:37.505705+0000","last_fullsized":"2023-10-06T03:09:37.505705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:01.833174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'99","reported_seq":110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203834+0000","last_change":"2023-10-06T02:59:53.673079+0000","last_active":"2023-10-06T03:09:49.203834+0000","last_peered":"2023-10-06T03:09:49.203834+0000","last_clean":"2023-10-06T03:09:49.203834+0000","last_became_active":"2023-10-06T02:59:53.672629+0000","last_became_peered":"2023-10-06T02:59:53.672629+0000","last_unstale":"2023-10-06T03:09:49.203834+0000","last_undegraded":"2023-10-06T03:09:49.203834+0000","last_fullsized":"2023-10-06T03:09:49.203834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:26.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'1071","reported_seq":1083,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506322+0000","last_change":"2023-10-06T02:59:53.297170+0000","last_active":"2023-10-06T03:09:37.506322+0000","last_peered":"2023-10-06T03:09:37.506322+0000","last_clean":"2023-10-06T03:09:37.506322+0000","last_became_active":"2023-10-06T02:59:53.296843+0000","last_became_peered":"2023-10-06T02:59:53.296843+0000","last_unstale":"2023-10-06T03:09:37.506322+0000","last_undegraded":"2023-10-06T03:09:37.506322+0000","last_fullsized":"2023-10-06T03:09:37.506322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:18.614416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":8534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"26'89","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206154+0000","last_change":"2023-10-06T02:59:53.675030+0000","last_active":"2023-10-06T03:09:49.206154+0000","last_peered":"2023-10-06T03:09:49.206154+0000","last_clean":"2023-10-06T03:09:49.206154+0000","last_became_active":"2023-10-06T02:59:53.673662+0000","last_became_peered":"2023-10-06T02:59:53.673662+0000","last_unstale":"2023-10-06T03:09:49.206154+0000","last_undegraded":"2023-10-06T03:09:49.206154+0000","last_fullsized":"2023-10-06T03:09:49.206154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:49.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"26'537","reported_seq":549,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.501976+0000","last_change":"2023-10-06T02:59:53.299596+0000","last_active":"2023-10-06T03:09:37.501976+0000","last_peered":"2023-10-06T03:09:37.501976+0000","last_clean":"2023-10-06T03:09:37.501976+0000","last_became_active":"2023-10-06T02:59:53.298881+0000","last_became_peered":"2023-10-06T02:59:53.298881+0000","last_unstale":"2023-10-06T03:09:37.501976+0000","last_undegraded":"2023-10-06T03:09:37.501976+0000","last_fullsized":"2023-10-06T03:09:37.501976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:55.850634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'87","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.190231+0000","last_change":"2023-10-06T02:59:53.675391+0000","last_active":"2023-10-06T03:09:49.190231+0000","last_peered":"2023-10-06T03:09:49.190231+0000","last_clean":"2023-10-06T03:09:49.190231+0000","last_became_active":"2023-10-06T02:59:53.675092+0000","last_became_peered":"2023-10-06T02:59:53.675092+0000","last_unstale":"2023-10-06T03:09:49.190231+0000","last_undegraded":"2023-10-06T03:09:49.190231+0000","last_fullsized":"2023-10-06T03:09:49.190231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:33.728417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"26'552","reported_seq":564,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.173190+0000","last_change":"2023-10-06T02:59:53.294074+0000","last_active":"2023-10-06T03:08:41.173190+0000","last_peered":"2023-10-06T03:08:41.173190+0000","last_clean":"2023-10-06T03:08:41.173190+0000","last_became_active":"2023-10-06T02:59:53.293752+0000","last_became_peered":"2023-10-06T02:59:53.293752+0000","last_unstale":"2023-10-06T03:08:41.173190+0000","last_undegraded":"2023-10-06T03:08:41.173190+0000","last_fullsized":"2023-10-06T03:08:41.173190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:39.902588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":438,"num_write_kb":4309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":75513604,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":11546,"num_write_kb":80285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151085056,"data_stored":151027208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15189,"ondisk_log_size":15189,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314548,"kb_used_data":17260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057292,"statfs":{"total":96636764160,"available":96314667008,"internally_reserved":0,"allocated":17674240,"data_stored":17475112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.90600000000000003,"15min":0.85699999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.41099999999999998},"max":{"1min":1.2789999999999999,"5min":1.893,"15min":1.893},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0029999999999999,"15min":0.98899999999999999},"min":{"1min":0.61699999999999999,"5min":0.54500000000000004,"15min":0.48099999999999998},"max":{"1min":1.2370000000000001,"5min":1.8,"15min":1.8},"last":1.1599999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.91500000000000004,"15min":0.92800000000000005},"min":{"1min":0.54600000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.266,"5min":1.349,"15min":1.389},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81499999999999995,"15min":0.82499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.38500000000000001},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.92500000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.91400000000000003,"15min":0.95499999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.55800000000000005},"max":{"1min":1.0469999999999999,"5min":1.333,"15min":1.4199999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.0700000000000001,"15min":1.1299999999999999},"min":{"1min":0.77100000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3160000000000001,"5min":1.3779999999999999,"15min":1.6359999999999999},"last":1.056}]},{"osd":3,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.93400000000000005,"15min":0.95099999999999996},"min":{"1min":0.56599999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.609,"5min":3.609,"15min":3.609},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0669999999999999,"15min":1.0900000000000001},"min":{"1min":0.75800000000000001,"5min":0.68200000000000005,"15min":0.66900000000000004},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.2410000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.89200000000000002,"15min":0.91300000000000003},"min":{"1min":0.67900000000000005,"5min":0.624,"15min":0.50600000000000001},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0049999999999999,"15min":1.044},"min":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.57499999999999996},"max":{"1min":1.3919999999999999,"5min":1.395,"15min":1.4590000000000001},"last":1.022}]},{"osd":5,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0640000000000001,"15min":1.1459999999999999},"min":{"1min":0.90600000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.425,"5min":1.51,"15min":1.833},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.0229999999999999,"15min":1.0529999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.59199999999999997},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.996}]},{"osd":6,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.093,"15min":1.1180000000000001},"min":{"1min":0.92200000000000004,"5min":0.73799999999999999,"15min":0.71399999999999997},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.117},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1499999999999999,"15min":1.1850000000000001},"min":{"1min":0.90700000000000003,"5min":0.78100000000000003,"15min":0.76100000000000001},"max":{"1min":1.5660000000000001,"5min":1.5669999999999999,"15min":1.5860000000000001},"last":1.196}]}]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309848,"kb_used_data":4368,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94061992,"statfs":{"total":96636764160,"available":96319479808,"internally_reserved":0,"allocated":4472832,"data_stored":4300972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94199999999999995,"15min":1.026},"min":{"1min":0.54300000000000004,"5min":0.505,"15min":0.49099999999999999},"max":{"1min":1.1950000000000001,"5min":1.343,"15min":6.6989999999999998},"last":1.286},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98199999999999998,"15min":1.087},"min":{"1min":0.628,"5min":0.54900000000000004,"15min":0.53200000000000003},"max":{"1min":1.302,"5min":1.302,"15min":6.9199999999999999},"last":1.3100000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.60999999999999999,"5min":0.56100000000000005,"15min":0.434},"max":{"1min":1.202,"5min":1.282,"15min":1.464},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.88800000000000001,"15min":0.89100000000000001},"min":{"1min":0.57099999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0980000000000001,"5min":1.2849999999999999,"15min":1.2949999999999999},"last":1.2010000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.89400000000000002,"15min":0.88300000000000001},"min":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.51700000000000002},"max":{"1min":1.0840000000000001,"5min":1.3009999999999999,"15min":1.498},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.91500000000000004,"15min":0.94099999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.171,"5min":1.248,"15min":1.294},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95199999999999996,"15min":0.94099999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.99299999999999999,"15min":1.012},"min":{"1min":0.69099999999999995,"5min":0.64800000000000002,"15min":0.52500000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.611},"last":1.157}]},{"osd":4,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90000000000000002,"15min":1.3149999999999999},"min":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.56000000000000005},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":17.757000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.099,"15min":1.498},"min":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.536,"5min":1.536,"15min":17.382999999999999},"last":1.069}]},{"osd":5,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1,"15min":1.133},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.61599999999999999},"max":{"1min":1.3919999999999999,"5min":1.411,"15min":4.3090000000000002},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.2490000000000001},"min":{"1min":0.91700000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":4.5709999999999997},"last":1.357}]},{"osd":7,"last update":"Fri Oct 6 03:08:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.1419999999999999},"min":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.625,"5min":1.625,"15min":1.6990000000000001},"last":1.234},{"interface":"front","average":{"1min":1.093,"5min":1.1180000000000001,"15min":1.175},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4590000000000001,"5min":1.5169999999999999,"15min":1.6639999999999999},"last":0.99399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326240,"kb_used_data":24856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94045600,"statfs":{"total":96636764160,"available":96302694400,"internally_reserved":0,"allocated":25452544,"data_stored":25273116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.876,"15min":0.88400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.40799999999999997},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2849999999999999},"last":0.879},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.96799999999999997,"15min":1.0009999999999999},"min":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.54800000000000004},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0209999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.874,"15min":0.88600000000000001},"min":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.321,"5min":1.321,"15min":1.363},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.90600000000000003,"15min":0.90500000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2230000000000001,"5min":1.2669999999999999,"15min":1.2689999999999999},"last":0.97899999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.879,"15min":0.89900000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.53400000000000003},"max":{"1min":1.2030000000000001,"5min":1.27,"15min":1.405},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.98099999999999998,"15min":0.98599999999999999},"min":{"1min":0.72599999999999998,"5min":0.59399999999999997,"15min":0.44500000000000001},"max":{"1min":1.2230000000000001,"5min":1.4610000000000001,"15min":1.6220000000000001},"last":1.087}]},{"osd":3,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.95799999999999996,"15min":0.95399999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"max":{"1min":1.298,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.179},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0529999999999999,"15min":1.0449999999999999},"min":{"1min":0.80100000000000005,"5min":0.72199999999999998,"15min":0.68999999999999995},"max":{"1min":1.278,"5min":1.3720000000000001,"15min":1.53},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.94299999999999995,"15min":0.92900000000000005},"min":{"1min":0.71499999999999997,"5min":0.61399999999999999,"15min":0.46999999999999997},"max":{"1min":1.3340000000000001,"5min":1.446,"15min":1.446},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.0920000000000001,"15min":1.075},"min":{"1min":0.89900000000000002,"5min":0.68400000000000005,"15min":0.60599999999999998},"max":{"1min":1.577,"5min":1.577,"15min":1.657},"last":1.2529999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0800000000000001,"15min":1.05},"min":{"1min":0.80700000000000005,"5min":0.68600000000000005,"15min":0.58399999999999996},"max":{"1min":1.3069999999999999,"5min":1.546,"15min":1.546},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.1080000000000001,"15min":1.083},"min":{"1min":0.878,"5min":0.77200000000000002,"15min":0.441},"max":{"1min":1.4119999999999999,"5min":1.538,"15min":1.538},"last":1.3169999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.155,"15min":1.1659999999999999},"min":{"1min":0.82799999999999996,"5min":0.748,"15min":0.748},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.542},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.95399999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.401,"5min":1.637,"15min":2.048},"last":1.3460000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335192,"kb_used_data":29712,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94036648,"statfs":{"total":96636764160,"available":96293527552,"internally_reserved":0,"allocated":30425088,"data_stored":30237520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.85399999999999998,"15min":0.83299999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0960000000000001,"5min":1.3080000000000001,"15min":1.4830000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.88600000000000001,"15min":0.92100000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.296,"5min":1.341,"15min":1.5289999999999999},"last":0.879}]},{"osd":1,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.85799999999999998,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.238,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.873,"15min":0.89300000000000002},"min":{"1min":0.58299999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.321,"5min":1.387,"15min":1.387},"last":1.026}]},{"osd":2,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96299999999999997,"15min":0.96699999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2589999999999999,"5min":1.3129999999999999,"15min":1.4159999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0249999999999999,"15min":1.016},"min":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.53700000000000003},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.93000000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94699999999999995,"15min":0.97199999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3859999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96999999999999997,"15min":1.0029999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.56200000000000006},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93400000000000005,"15min":0.95799999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.2529999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.046,"5min":1.02,"15min":1.077},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.2609999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0129999999999999,"15min":1.0609999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.61299999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.008},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0509999999999999,"15min":1.0860000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3759999999999999,"5min":1.454,"15min":1.454},"last":1.121}]},{"osd":7,"last update":"Fri Oct 6 03:09:08 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1080000000000001,"15min":1.1739999999999999},"min":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4570000000000001,"5min":1.5629999999999999,"15min":1.7629999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.151,"15min":1.21},"min":{"1min":0.753,"5min":0.753,"15min":0.56299999999999994},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.054}]}]},{"osd":3,"up_from":13,"seq":55834574975,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333692,"kb_used_data":28212,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94038148,"statfs":{"total":96636764160,"available":96295063552,"internally_reserved":0,"allocated":28889088,"data_stored":28711580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.244,"5min":1.2729999999999999,"15min":1.464},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76100000000000001,"15min":0.72399999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.212,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.80500000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.745,"15min":0.999},"min":{"1min":0.47799999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.222,"5min":1.3049999999999999,"15min":10.970000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.85299999999999998,"15min":0.83899999999999997},"min":{"1min":0.51200000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.387,"5min":1.694,"15min":1.694},"last":0.66800000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":0.872},"min":{"1min":0.49299999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.107,"5min":1.224,"15min":1.6419999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.90800000000000003,"15min":0.93700000000000006},"min":{"1min":0.60599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.333},"last":0.93000000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98599999999999999,"15min":1.02},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3540000000000001,"5min":1.855,"15min":1.855},"last":1.012},{"interface":"front","average":{"1min":1.101,"5min":1.1000000000000001,"15min":1.1499999999999999},"min":{"1min":0.80000000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.397,"5min":1.792,"15min":2.3570000000000002},"last":1.038}]},{"osd":5,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0549999999999999,"15min":1.121},"min":{"1min":0.73499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5069999999999999,"5min":1.7410000000000001,"15min":2.218},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1279999999999999,"15min":1.29},"min":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4550000000000001,"5min":1.5649999999999999,"15min":5.585},"last":1.3600000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1040000000000001,"15min":1.23},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.77000000000000002},"max":{"1min":1.431,"5min":1.9490000000000001,"15min":5.0860000000000003},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1819999999999999,"15min":1.23},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.591,"5min":1.6679999999999999,"15min":2.3069999999999999},"last":1.1000000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:08:56 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2250000000000001,"15min":1.3600000000000001},"min":{"1min":0.84599999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":5.6239999999999997},"last":1.296},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1930000000000001,"15min":1.2909999999999999},"min":{"1min":0.73699999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.482,"5min":2.0950000000000002,"15min":5.1310000000000002},"last":1.083}]}]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313944,"kb_used_data":8464,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94057896,"statfs":{"total":96636764160,"available":96315285504,"internally_reserved":0,"allocated":8667136,"data_stored":8495276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64700000000000002,"15min":0.69899999999999995},"min":{"1min":0.33300000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.99099999999999999,"5min":1.038,"15min":1.4019999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.70599999999999996,"15min":0.749},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82099999999999995,"5min":1.323,"15min":1.8799999999999999},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.52000000000000002,"5min":0.375,"15min":0.33300000000000002},"max":{"1min":1.0920000000000001,"5min":1.224,"15min":1.224},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84299999999999997,"15min":0.83999999999999997},"min":{"1min":0.37,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1180000000000001,"5min":1.252,"15min":1.341},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85199999999999998,"15min":0.86599999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.145,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.105},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.91200000000000003,"15min":0.96999999999999997},"min":{"1min":0.57899999999999996,"5min":0.46999999999999997,"15min":0.46000000000000002},"max":{"1min":1.2130000000000001,"5min":1.329,"15min":1.587},"last":0.73899999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.96899999999999997,"15min":1.0229999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6779999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.077,"15min":1.105},"min":{"1min":0.82799999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.611,"5min":1.6419999999999999,"15min":1.9350000000000001},"last":0.95699999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.119,"15min":1.1439999999999999},"min":{"1min":0.75900000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.0700000000000001,"15min":1.111},"min":{"1min":0.63,"5min":0.63,"15min":0.60499999999999998},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":2.048},"last":0.85199999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.149,"15min":1.1950000000000001},"min":{"1min":0.81399999999999995,"5min":0.70499999999999996,"15min":0.68600000000000005},"max":{"1min":1.548,"5min":1.6379999999999999,"15min":2.7040000000000002},"last":1.24},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.198,"15min":1.2410000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.677,"5min":1.677,"15min":2.2000000000000002},"last":1.2789999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.1399999999999999,"15min":1.2150000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":2.286},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2350000000000001,"15min":1.29},"min":{"1min":1.008,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4770000000000001,"5min":1.669,"15min":2.3940000000000001},"last":1.1859999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313944,"kb_used_data":16656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057896,"statfs":{"total":96636764160,"available":96315285504,"internally_reserved":0,"allocated":17055744,"data_stored":16883884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.70099999999999996,"15min":0.68600000000000005},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.23599999999999999},"max":{"1min":1.016,"5min":1.179,"15min":1.179},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.82099999999999995,"15min":0.79800000000000004},"min":{"1min":0.52900000000000003,"5min":0.42299999999999999,"15min":0.39300000000000002},"max":{"1min":1.077,"5min":1.218,"15min":1.3089999999999999},"last":0.94499999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84199999999999997,"15min":0.85999999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36599999999999999},"max":{"1min":1.246,"5min":1.3109999999999999,"15min":1.3169999999999999},"last":1}]},{"osd":3,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.875},"min":{"1min":0.5,"5min":0.5,"15min":0.42299999999999999},"max":{"1min":1.1399999999999999,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":1.129},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83199999999999996,"15min":0.85099999999999998},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.133,"5min":1.2270000000000001,"15min":1.337},"last":1.0609999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.95899999999999996,"15min":0.97999999999999998},"min":{"1min":0.66900000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.212,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.101},{"interface":"front","average":{"1min":1.099,"5min":1.115,"15min":1.0980000000000001},"min":{"1min":0.67200000000000004,"5min":0.63800000000000001,"15min":0.437},"max":{"1min":1.556,"5min":1.556,"15min":1.6060000000000001},"last":1.2849999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.075,"15min":1.075},"min":{"1min":0.70399999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4410000000000001,"5min":1.587,"15min":1.587},"last":1.258},{"interface":"front","average":{"1min":1.034,"5min":1.0760000000000001,"15min":1.073},"min":{"1min":0.80500000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.569,"5min":1.911,"15min":1.911},"last":1.4359999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1479999999999999,"15min":1.1499999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.70499999999999996},"max":{"1min":1.5049999999999999,"5min":2.081,"15min":2.081},"last":1.591},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1479999999999999,"15min":1.1639999999999999},"min":{"1min":0.72799999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4710000000000001,"5min":1.996,"15min":1.996},"last":1.375}]},{"osd":7,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2050000000000001,"15min":1.1970000000000001},"min":{"1min":0.81000000000000005,"5min":0.71499999999999997,"15min":0.498},"max":{"1min":1.5009999999999999,"5min":1.6879999999999999,"15min":1.8999999999999999},"last":1.232},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.218,"15min":1.2250000000000001},"min":{"1min":0.78900000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.536,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.5009999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322736,"kb_used_data":21352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94049104,"statfs":{"total":96636764160,"available":96306282496,"internally_reserved":0,"allocated":21864448,"data_stored":21683828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70399999999999996,"15min":0.67600000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26900000000000002},"max":{"1min":1.224,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.34899999999999998},"max":{"1min":1.1659999999999999,"5min":1.2709999999999999,"15min":1.2849999999999999},"last":1.0429999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.177,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.40200000000000002},"max":{"1min":0.93700000000000006,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.871}]},{"osd":3,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82899999999999996,"15min":0.80900000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4019999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.91600000000000004,"15min":0.93000000000000005},"min":{"1min":0.55500000000000005,"5min":0.46800000000000003,"15min":0.34599999999999997},"max":{"1min":1.327,"5min":1.3580000000000001,"15min":1.599},"last":1.133}]},{"osd":4,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.94099999999999995,"15min":0.95499999999999996},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.52},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.117,"15min":1.105},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.8280000000000001,"5min":1.859,"15min":1.859},"last":1.159}]},{"osd":5,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.135,"15min":1.141},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.165,"15min":1.159},"min":{"1min":0.872,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.542,"5min":1.573,"15min":1.573},"last":1.3859999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1759999999999999,"15min":1.1739999999999999},"min":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4930000000000001,"5min":1.6359999999999999,"15min":1.7050000000000001},"last":1.466},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1080000000000001,"15min":1.111},"min":{"1min":0.68500000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.274,"5min":1.579,"15min":2.1579999999999999},"last":1.353}]},{"osd":7,"last update":"Fri Oct 6 03:08:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1579999999999999,"15min":1.1599999999999999},"min":{"1min":0.72699999999999998,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.413,"5min":1.7090000000000001,"15min":2.2480000000000002},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.0049999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.284}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20992000,"data_stored":20986792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28610560,"data_stored":28604912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30146560,"data_stored":30130852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16801792,"data_stored":16778076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:10:02.591 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.591 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.591 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.591 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.591 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.592 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.592 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.592 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.592 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.592 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.592 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.592 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.592 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.593 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.593 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.593 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.593 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.593 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.593 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.593 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.593 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.594 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.594 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.594 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.594 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.594 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.594 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.594 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.594 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.595 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.595 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.595 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.595 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.595 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.595 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.595 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.595 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.596 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.596 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.596 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.596 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.596 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.596 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.596 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.596 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.597 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.597 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.597 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.597 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.597 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.597 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.597 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.597 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.598 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.598 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.598 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.598 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T02:59:43.039151+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.598 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-06T02:59:48.080036+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=48, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.598 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.598 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.598 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T02:59:48.080036+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=48, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.599 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.599 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.599 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-06T02:59:48.080036+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=48, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.599 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.599 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.599 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-06T02:59:48.080036+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=48, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.599 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.599 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.600 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.600 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-06T02:59:48.080036+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=48, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.600 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.600 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.600 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-06T02:59:48.080036+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=48, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.600 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.600 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.600 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-06T02:59:48.080036+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=48, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.601 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.601 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.601 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-06T02:59:48.080036+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=48, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.601 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.601 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.601 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.601 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.601 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.601 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.602 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.602 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.602 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.602 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.602 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.602 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.602 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.602 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.603 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.603 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.603 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.603 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.603 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.603 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.604 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.604 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.604 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.604 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.604 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:02.604 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T03:10:22.596 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:10:22.598 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:10:22.601 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:10:22.603 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:10:22.605 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:10:22.606 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:10:22.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.752+0000 7f3160876700 1 Processor -- start 2023-10-06T03:10:22.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.752+0000 7f3160876700 1 -- start start 2023-10-06T03:10:22.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.752+0000 7f3160876700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f315c14aed0 0x7f315c14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:22.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.752+0000 7f3160876700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c0a18e0 con 0x7f315c0a4760 2023-10-06T03:10:22.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.752+0000 7f3160876700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c14f970 con 0x7f315c0b7f40 2023-10-06T03:10:22.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.752+0000 7f3160876700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c0bdbb0 con 0x7f315c14aed0 2023-10-06T03:10:22.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f315a59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f315c0a4760 0x7f315c06b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57622/0 (socket says 172.21.15.27:57622) 2023-10-06T03:10:22.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f315a59c700 1 -- 172.21.15.27:0/2331141981 learned_addr learned my addr 172.21.15.27:0/2331141981 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:10:22.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f315ad9d700 1 --2- 172.21.15.27:0/2331141981 >> v2:172.21.15.27:3300/0 conn(0x7f315c14aed0 0x7f315c14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:22.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f3159d9b700 1 -- 172.21.15.27:0/2331141981 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311960795 0 0) 0x7f315c0a18e0 con 0x7f315c0a4760 2023-10-06T03:10:22.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f3159d9b700 1 -- 172.21.15.27:0/2331141981 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3144003570 con 0x7f315c0a4760 2023-10-06T03:10:22.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f315ad9d700 1 -- 172.21.15.27:0/2331141981 >> v1:172.21.15.123:6789/0 conn(0x7f315c0b7f40 legacy=0x7f315c14c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:22.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f315ad9d700 1 -- 172.21.15.27:0/2331141981 >> v1:172.21.15.27:6789/0 conn(0x7f315c0a4760 legacy=0x7f315c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:22.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f315ad9d700 1 -- 172.21.15.27:0/2331141981 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c14c950 con 0x7f315c14aed0 2023-10-06T03:10:22.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f315ad9d700 1 --2- 172.21.15.27:0/2331141981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f315c14aed0 0x7f315c14b2a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f31500098e0 tx=0x7f31500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1a51c7c376c14e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:22.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f3159d9b700 1 -- 172.21.15.27:0/2331141981 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000b640 con 0x7f315c14aed0 2023-10-06T03:10:22.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f3159d9b700 1 -- 172.21.15.27:0/2331141981 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315000b7a0 con 0x7f315c14aed0 2023-10-06T03:10:22.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f3159d9b700 1 -- 172.21.15.27:0/2331141981 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000bb40 con 0x7f315c14aed0 2023-10-06T03:10:22.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f3160876700 1 -- 172.21.15.27:0/2331141981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f315c14aed0 msgr2=0x7f315c14b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:22.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f3160876700 1 --2- 172.21.15.27:0/2331141981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f315c14aed0 0x7f315c14b2a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f31500098e0 tx=0x7f31500091a0 comp rx=0 tx=0).stop 2023-10-06T03:10:22.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f3160876700 1 -- 172.21.15.27:0/2331141981 shutdown_connections 2023-10-06T03:10:22.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f3160876700 1 --2- 172.21.15.27:0/2331141981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f315c14aed0 0x7f315c14b2a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:22.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f3160876700 1 -- 172.21.15.27:0/2331141981 >> 172.21.15.27:0/2331141981 conn(0x7f315c0beae0 msgr2=0x7f315c0beee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:22.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f3160876700 1 -- 172.21.15.27:0/2331141981 shutdown_connections 2023-10-06T03:10:22.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f3160876700 1 -- 172.21.15.27:0/2331141981 wait complete. 2023-10-06T03:10:22.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.756+0000 7f3160876700 1 Processor -- start 2023-10-06T03:10:22.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f3160876700 1 -- start start 2023-10-06T03:10:22.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f3160876700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f315c0a4760 0x7f315c149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:22.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f3160876700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315c0b7f40 0x7f315c0b9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:22.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f3160876700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f315c14aed0 0x7f315c15ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:22.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f3160876700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0b8830 con 0x7f315c0a4760 2023-10-06T03:10:22.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f3160876700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c097270 con 0x7f315c0b7f40 2023-10-06T03:10:22.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f3160876700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0a5fb0 con 0x7f315c14aed0 2023-10-06T03:10:22.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f315ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f315c0a4760 0x7f315c149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:22.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f315ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f315c0a4760 0x7f315c149ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56618/0 (socket says 172.21.15.27:56618) 2023-10-06T03:10:22.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f315ad9d700 1 -- 172.21.15.27:0/359417888 learned_addr learned my addr 172.21.15.27:0/359417888 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:22.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f315a59c700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315c0b7f40 0x7f315c0b9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:22.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f315b59e700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f315c14aed0 0x7f315c15ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:22.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f315ad9d700 1 -- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f315c14aed0 msgr2=0x7f315c15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:22.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f315ad9d700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f315c14aed0 0x7f315c15ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:22.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f315ad9d700 1 -- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315c0b7f40 msgr2=0x7f315c0b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:22.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f315ad9d700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315c0b7f40 0x7f315c0b9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:22.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f315ad9d700 1 -- 172.21.15.27:0/359417888 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150009420 con 0x7f315c0a4760 2023-10-06T03:10:22.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f315b59e700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f315c14aed0 0x7f315c15ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:10:22.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f315ad9d700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f315c0a4760 0x7f315c149ec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f315c0bf820 tx=0x7f3150017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:22.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f3142ffd700 1 -- 172.21.15.27:0/359417888 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150000d10 con 0x7f315c0a4760 2023-10-06T03:10:22.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f3142ffd700 1 -- 172.21.15.27:0/359417888 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315000bb20 con 0x7f315c0a4760 2023-10-06T03:10:22.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f3160876700 1 -- 172.21.15.27:0/359417888 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c0bc0e0 con 0x7f315c0a4760 2023-10-06T03:10:22.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f3142ffd700 1 -- 172.21.15.27:0/359417888 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150011630 con 0x7f315c0a4760 2023-10-06T03:10:22.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.760+0000 7f3160876700 1 -- 172.21.15.27:0/359417888 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c0a0cd0 con 0x7f315c0a4760 2023-10-06T03:10:22.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.764+0000 7f3160876700 1 -- 172.21.15.27:0/359417888 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c087a70 con 0x7f315c0a4760 2023-10-06T03:10:22.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.764+0000 7f3142ffd700 1 -- 172.21.15.27:0/359417888 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f31500119a0 con 0x7f315c0a4760 2023-10-06T03:10:22.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.764+0000 7f3142ffd700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3148060550 0x7f3148062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:22.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.764+0000 7f3142ffd700 1 -- 172.21.15.27:0/359417888 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f315007dff0 con 0x7f315c0a4760 2023-10-06T03:10:22.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.764+0000 7f315a59c700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3148060550 0x7f3148062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:22.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.764+0000 7f315a59c700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3148060550 0x7f3148062a00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f315c14aea0 tx=0x7f314c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:22.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.772+0000 7f3142ffd700 1 -- 172.21.15.27:0/359417888 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f315004e440 con 0x7f315c0a4760 2023-10-06T03:10:22.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.936+0000 7f3160876700 1 -- 172.21.15.27:0/359417888 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f315c04b600 con 0x7f3148060550 2023-10-06T03:10:22.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.952+0000 7f3142ffd700 1 -- 172.21.15.27:0/359417888 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308592 (secure 0 0 0) 0x7f315c04b600 con 0x7f3148060550 2023-10-06T03:10:22.960 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:10:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.960+0000 7f3160876700 1 -- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3148060550 msgr2=0x7f3148062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.960+0000 7f3160876700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3148060550 0x7f3148062a00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f315c14aea0 tx=0x7f314c009040 comp rx=0 tx=0).stop 2023-10-06T03:10:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.960+0000 7f3160876700 1 -- 172.21.15.27:0/359417888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f315c0a4760 msgr2=0x7f315c149ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.960+0000 7f3160876700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f315c0a4760 0x7f315c149ec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f315c0bf820 tx=0x7f3150017000 comp rx=0 tx=0).stop 2023-10-06T03:10:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.960+0000 7f3160876700 1 -- 172.21.15.27:0/359417888 shutdown_connections 2023-10-06T03:10:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.960+0000 7f3160876700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f3148060550 0x7f3148062a00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.960+0000 7f3160876700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f315c14aed0 0x7f315c15ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.960+0000 7f3160876700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315c0b7f40 0x7f315c0b9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.960+0000 7f3160876700 1 --2- 172.21.15.27:0/359417888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f315c0a4760 0x7f315c149ec0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.960+0000 7f3160876700 1 -- 172.21.15.27:0/359417888 >> 172.21.15.27:0/359417888 conn(0x7f315c0beae0 msgr2=0x7f315c0bff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.960+0000 7f3160876700 1 -- 172.21.15.27:0/359417888 shutdown_connections 2023-10-06T03:10:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:22.960+0000 7f3160876700 1 -- 172.21.15.27:0/359417888 wait complete. 2023-10-06T03:10:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-10-06T03:10:22.976 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2023-10-06T03:10:21.193097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76103972,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":599,"num_read_kb":1179,"num_write":11705,"num_write_kb":82701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20608,"ondisk_log_size":20608,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2574240,"kb_used_data":150880,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752400480,"statfs":{"total":773094113280,"available":770458091520,"internally_reserved":0,"allocated":154501120,"data_stored":153061288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004336"},"pg_stats":[{"pgid":"4.3f","version":"26'91","reported_seq":113,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:07.709957+0000","last_change":"2023-10-06T03:10:07.709876+0000","last_active":"2023-10-06T03:10:07.709957+0000","last_peered":"2023-10-06T03:10:07.709957+0000","last_clean":"2023-10-06T03:10:07.709957+0000","last_became_active":"2023-10-06T02:59:53.681495+0000","last_became_peered":"2023-10-06T02:59:53.681495+0000","last_unstale":"2023-10-06T03:10:07.709957+0000","last_undegraded":"2023-10-06T03:10:07.709957+0000","last_fullsized":"2023-10-06T03:10:07.709957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'91","last_scrub_stamp":"2023-10-06T03:10:07.709583+0000","last_deep_scrub":"26'91","last_deep_scrub_stamp":"2023-10-06T03:10:07.709583+0000","last_clean_scrub_stamp":"2023-10-06T03:10:07.709583+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:21.963561+0000","scrub_duration":0.0038659110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"26'80","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195794+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T03:09:49.195794+0000","last_peered":"2023-10-06T03:09:49.195794+0000","last_clean":"2023-10-06T03:09:49.195794+0000","last_became_active":"2023-10-06T02:59:53.681849+0000","last_became_peered":"2023-10-06T02:59:53.681849+0000","last_unstale":"2023-10-06T03:09:49.195794+0000","last_undegraded":"2023-10-06T03:09:49.195794+0000","last_fullsized":"2023-10-06T03:09:49.195794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"26'65","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.197418+0000","last_change":"2023-10-06T02:59:53.679536+0000","last_active":"2023-10-06T03:09:49.197418+0000","last_peered":"2023-10-06T03:09:49.197418+0000","last_clean":"2023-10-06T03:09:49.197418+0000","last_became_active":"2023-10-06T02:59:53.678264+0000","last_became_peered":"2023-10-06T02:59:53.678264+0000","last_unstale":"2023-10-06T03:09:49.197418+0000","last_undegraded":"2023-10-06T03:09:49.197418+0000","last_fullsized":"2023-10-06T03:09:49.197418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"26'76","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:05.009567+0000","last_change":"2023-10-06T03:10:05.009488+0000","last_active":"2023-10-06T03:10:05.009567+0000","last_peered":"2023-10-06T03:10:05.009567+0000","last_clean":"2023-10-06T03:10:05.009567+0000","last_became_active":"2023-10-06T02:59:53.671555+0000","last_became_peered":"2023-10-06T02:59:53.671555+0000","last_unstale":"2023-10-06T03:10:05.009567+0000","last_undegraded":"2023-10-06T03:10:05.009567+0000","last_fullsized":"2023-10-06T03:10:05.009567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'76","last_scrub_stamp":"2023-10-06T03:10:05.009230+0000","last_deep_scrub":"26'76","last_deep_scrub_stamp":"2023-10-06T03:10:05.009230+0000","last_clean_scrub_stamp":"2023-10-06T03:10:05.009230+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:16.812988+0000","scrub_duration":0.0043911949999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"26'85","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205840+0000","last_change":"2023-10-06T02:59:53.682691+0000","last_active":"2023-10-06T03:09:49.205840+0000","last_peered":"2023-10-06T03:09:49.205840+0000","last_clean":"2023-10-06T03:09:49.205840+0000","last_became_active":"2023-10-06T02:59:53.682399+0000","last_became_peered":"2023-10-06T02:59:53.682399+0000","last_unstale":"2023-10-06T03:09:49.205840+0000","last_undegraded":"2023-10-06T03:09:49.205840+0000","last_fullsized":"2023-10-06T03:09:49.205840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"26'80","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.197433+0000","last_change":"2023-10-06T02:59:53.678208+0000","last_active":"2023-10-06T03:09:49.197433+0000","last_peered":"2023-10-06T03:09:49.197433+0000","last_clean":"2023-10-06T03:09:49.197433+0000","last_became_active":"2023-10-06T02:59:53.676481+0000","last_became_peered":"2023-10-06T02:59:53.676481+0000","last_unstale":"2023-10-06T03:09:49.197433+0000","last_undegraded":"2023-10-06T03:09:49.197433+0000","last_fullsized":"2023-10-06T03:09:49.197433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"26'93","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195034+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T03:09:49.195034+0000","last_peered":"2023-10-06T03:09:49.195034+0000","last_clean":"2023-10-06T03:09:49.195034+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:09:49.195034+0000","last_undegraded":"2023-10-06T03:09:49.195034+0000","last_fullsized":"2023-10-06T03:09:49.195034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"26'77","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196114+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T03:09:49.196114+0000","last_peered":"2023-10-06T03:09:49.196114+0000","last_clean":"2023-10-06T03:09:49.196114+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:09:49.196114+0000","last_undegraded":"2023-10-06T03:09:49.196114+0000","last_fullsized":"2023-10-06T03:09:49.196114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"26'89","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205833+0000","last_change":"2023-10-06T02:59:53.680395+0000","last_active":"2023-10-06T03:09:49.205833+0000","last_peered":"2023-10-06T03:09:49.205833+0000","last_clean":"2023-10-06T03:09:49.205833+0000","last_became_active":"2023-10-06T02:59:53.680086+0000","last_became_peered":"2023-10-06T02:59:53.680086+0000","last_unstale":"2023-10-06T03:09:49.205833+0000","last_undegraded":"2023-10-06T03:09:49.205833+0000","last_fullsized":"2023-10-06T03:09:49.205833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"26'73","reported_seq":85,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.189689+0000","last_change":"2023-10-06T02:59:53.675582+0000","last_active":"2023-10-06T03:09:49.189689+0000","last_peered":"2023-10-06T03:09:49.189689+0000","last_clean":"2023-10-06T03:09:49.189689+0000","last_became_active":"2023-10-06T02:59:53.675243+0000","last_became_peered":"2023-10-06T02:59:53.675243+0000","last_unstale":"2023-10-06T03:09:49.189689+0000","last_undegraded":"2023-10-06T03:09:49.189689+0000","last_fullsized":"2023-10-06T03:09:49.189689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"26'79","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.198875+0000","last_change":"2023-10-06T02:59:53.679489+0000","last_active":"2023-10-06T03:09:49.198875+0000","last_peered":"2023-10-06T03:09:49.198875+0000","last_clean":"2023-10-06T03:09:49.198875+0000","last_became_active":"2023-10-06T02:59:53.678985+0000","last_became_peered":"2023-10-06T02:59:53.678985+0000","last_unstale":"2023-10-06T03:09:49.198875+0000","last_undegraded":"2023-10-06T03:09:49.198875+0000","last_fullsized":"2023-10-06T03:09:49.198875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"26'79","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:08.683966+0000","last_change":"2023-10-06T03:10:08.683851+0000","last_active":"2023-10-06T03:10:08.683966+0000","last_peered":"2023-10-06T03:10:08.683966+0000","last_clean":"2023-10-06T03:10:08.683966+0000","last_became_active":"2023-10-06T02:59:53.682464+0000","last_became_peered":"2023-10-06T02:59:53.682464+0000","last_unstale":"2023-10-06T03:10:08.683966+0000","last_undegraded":"2023-10-06T03:10:08.683966+0000","last_fullsized":"2023-10-06T03:10:08.683966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2023-10-06T03:10:08.683416+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2023-10-06T03:10:08.683416+0000","last_clean_scrub_stamp":"2023-10-06T03:10:08.683416+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:47.380038+0000","scrub_duration":0.0046938989999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"26'84","reported_seq":115,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:06.733722+0000","last_change":"2023-10-06T03:10:06.733648+0000","last_active":"2023-10-06T03:10:06.733722+0000","last_peered":"2023-10-06T03:10:06.733722+0000","last_clean":"2023-10-06T03:10:06.733722+0000","last_became_active":"2023-10-06T03:00:34.741173+0000","last_became_peered":"2023-10-06T03:00:34.741173+0000","last_unstale":"2023-10-06T03:10:06.733722+0000","last_undegraded":"2023-10-06T03:10:06.733722+0000","last_fullsized":"2023-10-06T03:10:06.733722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'84","last_scrub_stamp":"2023-10-06T03:10:06.733358+0000","last_deep_scrub":"26'84","last_deep_scrub_stamp":"2023-10-06T03:10:06.733358+0000","last_clean_scrub_stamp":"2023-10-06T03:10:06.733358+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:54.642666+0000","scrub_duration":0.0043106860000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"26'74","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191972+0000","last_change":"2023-10-06T02:59:53.673321+0000","last_active":"2023-10-06T03:09:49.191972+0000","last_peered":"2023-10-06T03:09:49.191972+0000","last_clean":"2023-10-06T03:09:49.191972+0000","last_became_active":"2023-10-06T02:59:53.672957+0000","last_became_peered":"2023-10-06T02:59:53.672957+0000","last_unstale":"2023-10-06T03:09:49.191972+0000","last_undegraded":"2023-10-06T03:09:49.191972+0000","last_fullsized":"2023-10-06T03:09:49.191972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"26'78","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195197+0000","last_change":"2023-10-06T02:59:53.686669+0000","last_active":"2023-10-06T03:09:49.195197+0000","last_peered":"2023-10-06T03:09:49.195197+0000","last_clean":"2023-10-06T03:09:49.195197+0000","last_became_active":"2023-10-06T02:59:53.686352+0000","last_became_peered":"2023-10-06T02:59:53.686352+0000","last_unstale":"2023-10-06T03:09:49.195197+0000","last_undegraded":"2023-10-06T03:09:49.195197+0000","last_fullsized":"2023-10-06T03:09:49.195197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"26'88","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.197488+0000","last_change":"2023-10-06T02:59:53.680975+0000","last_active":"2023-10-06T03:09:49.197488+0000","last_peered":"2023-10-06T03:09:49.197488+0000","last_clean":"2023-10-06T03:09:49.197488+0000","last_became_active":"2023-10-06T02:59:53.678449+0000","last_became_peered":"2023-10-06T02:59:53.678449+0000","last_unstale":"2023-10-06T03:09:49.197488+0000","last_undegraded":"2023-10-06T03:09:49.197488+0000","last_fullsized":"2023-10-06T03:09:49.197488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"26'80","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205478+0000","last_change":"2023-10-06T02:59:53.680344+0000","last_active":"2023-10-06T03:09:49.205478+0000","last_peered":"2023-10-06T03:09:49.205478+0000","last_clean":"2023-10-06T03:09:49.205478+0000","last_became_active":"2023-10-06T02:59:53.680028+0000","last_became_peered":"2023-10-06T02:59:53.680028+0000","last_unstale":"2023-10-06T03:09:49.205478+0000","last_undegraded":"2023-10-06T03:09:49.205478+0000","last_fullsized":"2023-10-06T03:09:49.205478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"26'76","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192798+0000","last_change":"2023-10-06T02:59:53.678143+0000","last_active":"2023-10-06T03:09:49.192798+0000","last_peered":"2023-10-06T03:09:49.192798+0000","last_clean":"2023-10-06T03:09:49.192798+0000","last_became_active":"2023-10-06T02:59:53.676602+0000","last_became_peered":"2023-10-06T02:59:53.676602+0000","last_unstale":"2023-10-06T03:09:49.192798+0000","last_undegraded":"2023-10-06T03:09:49.192798+0000","last_fullsized":"2023-10-06T03:09:49.192798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"26'75","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:02.765983+0000","last_change":"2023-10-06T03:10:02.765921+0000","last_active":"2023-10-06T03:10:02.765983+0000","last_peered":"2023-10-06T03:10:02.765983+0000","last_clean":"2023-10-06T03:10:02.765983+0000","last_became_active":"2023-10-06T02:59:53.675657+0000","last_became_peered":"2023-10-06T02:59:53.675657+0000","last_unstale":"2023-10-06T03:10:02.765983+0000","last_undegraded":"2023-10-06T03:10:02.765983+0000","last_fullsized":"2023-10-06T03:10:02.765983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'75","last_scrub_stamp":"2023-10-06T03:10:02.765676+0000","last_deep_scrub":"26'75","last_deep_scrub_stamp":"2023-10-06T03:10:02.765676+0000","last_clean_scrub_stamp":"2023-10-06T03:10:02.765676+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.141625+0000","scrub_duration":0.004252451,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"26'82","reported_seq":94,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191755+0000","last_change":"2023-10-06T02:59:53.673043+0000","last_active":"2023-10-06T03:09:49.191755+0000","last_peered":"2023-10-06T03:09:49.191755+0000","last_clean":"2023-10-06T03:09:49.191755+0000","last_became_active":"2023-10-06T02:59:53.672690+0000","last_became_peered":"2023-10-06T02:59:53.672690+0000","last_unstale":"2023-10-06T03:09:49.191755+0000","last_undegraded":"2023-10-06T03:09:49.191755+0000","last_fullsized":"2023-10-06T03:09:49.191755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"26'83","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194854+0000","last_change":"2023-10-06T02:59:53.684492+0000","last_active":"2023-10-06T03:09:49.194854+0000","last_peered":"2023-10-06T03:09:49.194854+0000","last_clean":"2023-10-06T03:09:49.194854+0000","last_became_active":"2023-10-06T02:59:53.684145+0000","last_became_peered":"2023-10-06T02:59:53.684145+0000","last_unstale":"2023-10-06T03:09:49.194854+0000","last_undegraded":"2023-10-06T03:09:49.194854+0000","last_fullsized":"2023-10-06T03:09:49.194854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"26'88","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200947+0000","last_change":"2023-10-06T02:59:53.683256+0000","last_active":"2023-10-06T03:09:49.200947+0000","last_peered":"2023-10-06T03:09:49.200947+0000","last_clean":"2023-10-06T03:09:49.200947+0000","last_became_active":"2023-10-06T02:59:53.682948+0000","last_became_peered":"2023-10-06T02:59:53.682948+0000","last_unstale":"2023-10-06T03:09:49.200947+0000","last_undegraded":"2023-10-06T03:09:49.200947+0000","last_fullsized":"2023-10-06T03:09:49.200947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"26'69","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206477+0000","last_change":"2023-10-06T02:59:53.675936+0000","last_active":"2023-10-06T03:09:49.206477+0000","last_peered":"2023-10-06T03:09:49.206477+0000","last_clean":"2023-10-06T03:09:49.206477+0000","last_became_active":"2023-10-06T02:59:53.675319+0000","last_became_peered":"2023-10-06T02:59:53.675319+0000","last_unstale":"2023-10-06T03:09:49.206477+0000","last_undegraded":"2023-10-06T03:09:49.206477+0000","last_fullsized":"2023-10-06T03:09:49.206477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"26'87","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.202550+0000","last_change":"2023-10-06T02:59:53.686758+0000","last_active":"2023-10-06T03:09:49.202550+0000","last_peered":"2023-10-06T03:09:49.202550+0000","last_clean":"2023-10-06T03:09:49.202550+0000","last_became_active":"2023-10-06T02:59:53.686007+0000","last_became_peered":"2023-10-06T02:59:53.686007+0000","last_unstale":"2023-10-06T03:09:49.202550+0000","last_undegraded":"2023-10-06T03:09:49.202550+0000","last_fullsized":"2023-10-06T03:09:49.202550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"26'91","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200731+0000","last_change":"2023-10-06T02:59:53.682853+0000","last_active":"2023-10-06T03:09:49.200731+0000","last_peered":"2023-10-06T03:09:49.200731+0000","last_clean":"2023-10-06T03:09:49.200731+0000","last_became_active":"2023-10-06T02:59:53.682511+0000","last_became_peered":"2023-10-06T02:59:53.682511+0000","last_unstale":"2023-10-06T03:09:49.200731+0000","last_undegraded":"2023-10-06T03:09:49.200731+0000","last_fullsized":"2023-10-06T03:09:49.200731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"26'98","reported_seq":110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196534+0000","last_change":"2023-10-06T02:59:53.682001+0000","last_active":"2023-10-06T03:09:49.196534+0000","last_peered":"2023-10-06T03:09:49.196534+0000","last_clean":"2023-10-06T03:09:49.196534+0000","last_became_active":"2023-10-06T02:59:53.681732+0000","last_became_peered":"2023-10-06T02:59:53.681732+0000","last_unstale":"2023-10-06T03:09:49.196534+0000","last_undegraded":"2023-10-06T03:09:49.196534+0000","last_fullsized":"2023-10-06T03:09:49.196534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"26'80","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.175327+0000","last_change":"2023-10-06T02:59:53.676598+0000","last_active":"2023-10-06T03:09:49.175327+0000","last_peered":"2023-10-06T03:09:49.175327+0000","last_clean":"2023-10-06T03:09:49.175327+0000","last_became_active":"2023-10-06T02:59:53.676284+0000","last_became_peered":"2023-10-06T02:59:53.676284+0000","last_unstale":"2023-10-06T03:09:49.175327+0000","last_undegraded":"2023-10-06T03:09:49.175327+0000","last_fullsized":"2023-10-06T03:09:49.175327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"26'61","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195537+0000","last_change":"2023-10-06T02:59:53.687275+0000","last_active":"2023-10-06T03:09:49.195537+0000","last_peered":"2023-10-06T03:09:49.195537+0000","last_clean":"2023-10-06T03:09:49.195537+0000","last_became_active":"2023-10-06T02:59:53.686912+0000","last_became_peered":"2023-10-06T02:59:53.686912+0000","last_unstale":"2023-10-06T03:09:49.195537+0000","last_undegraded":"2023-10-06T03:09:49.195537+0000","last_fullsized":"2023-10-06T03:09:49.195537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"26'87","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203767+0000","last_change":"2023-10-06T02:59:53.685421+0000","last_active":"2023-10-06T03:09:49.203767+0000","last_peered":"2023-10-06T03:09:49.203767+0000","last_clean":"2023-10-06T03:09:49.203767+0000","last_became_active":"2023-10-06T02:59:53.684806+0000","last_became_peered":"2023-10-06T02:59:53.684806+0000","last_unstale":"2023-10-06T03:09:49.203767+0000","last_undegraded":"2023-10-06T03:09:49.203767+0000","last_fullsized":"2023-10-06T03:09:49.203767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"26'82","reported_seq":94,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191802+0000","last_change":"2023-10-06T02:59:53.676085+0000","last_active":"2023-10-06T03:09:49.191802+0000","last_peered":"2023-10-06T03:09:49.191802+0000","last_clean":"2023-10-06T03:09:49.191802+0000","last_became_active":"2023-10-06T02:59:53.675718+0000","last_became_peered":"2023-10-06T02:59:53.675718+0000","last_unstale":"2023-10-06T03:09:49.191802+0000","last_undegraded":"2023-10-06T03:09:49.191802+0000","last_fullsized":"2023-10-06T03:09:49.191802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"26'92","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206382+0000","last_change":"2023-10-06T02:59:53.676118+0000","last_active":"2023-10-06T03:09:49.206382+0000","last_peered":"2023-10-06T03:09:49.206382+0000","last_clean":"2023-10-06T03:09:49.206382+0000","last_became_active":"2023-10-06T02:59:53.675682+0000","last_became_peered":"2023-10-06T02:59:53.675682+0000","last_unstale":"2023-10-06T03:09:49.206382+0000","last_undegraded":"2023-10-06T03:09:49.206382+0000","last_fullsized":"2023-10-06T03:09:49.206382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"26'82","reported_seq":94,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.193045+0000","last_change":"2023-10-06T02:59:53.673225+0000","last_active":"2023-10-06T03:09:49.193045+0000","last_peered":"2023-10-06T03:09:49.193045+0000","last_clean":"2023-10-06T03:09:49.193045+0000","last_became_active":"2023-10-06T02:59:53.672930+0000","last_became_peered":"2023-10-06T02:59:53.672930+0000","last_unstale":"2023-10-06T03:09:49.193045+0000","last_undegraded":"2023-10-06T03:09:49.193045+0000","last_fullsized":"2023-10-06T03:09:49.193045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"26'79","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203334+0000","last_change":"2023-10-06T02:59:53.678742+0000","last_active":"2023-10-06T03:09:49.203334+0000","last_peered":"2023-10-06T03:09:49.203334+0000","last_clean":"2023-10-06T03:09:49.203334+0000","last_became_active":"2023-10-06T02:59:53.678471+0000","last_became_peered":"2023-10-06T02:59:53.678471+0000","last_unstale":"2023-10-06T03:09:49.203334+0000","last_undegraded":"2023-10-06T03:09:49.203334+0000","last_fullsized":"2023-10-06T03:09:49.203334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'1517","reported_seq":1530,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.504420+0000","last_change":"2023-10-06T02:59:53.297136+0000","last_active":"2023-10-06T03:09:37.504420+0000","last_peered":"2023-10-06T03:09:37.504420+0000","last_clean":"2023-10-06T03:09:37.504420+0000","last_became_active":"2023-10-06T02:59:53.296816+0000","last_became_peered":"2023-10-06T02:59:53.296816+0000","last_unstale":"2023-10-06T03:09:37.504420+0000","last_undegraded":"2023-10-06T03:09:37.504420+0000","last_fullsized":"2023-10-06T03:09:37.504420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1406,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'65","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.175346+0000","last_change":"2023-10-06T02:59:53.684876+0000","last_active":"2023-10-06T03:09:49.175346+0000","last_peered":"2023-10-06T03:09:49.175346+0000","last_clean":"2023-10-06T03:09:49.175346+0000","last_became_active":"2023-10-06T02:59:53.684522+0000","last_became_peered":"2023-10-06T02:59:53.684522+0000","last_unstale":"2023-10-06T03:09:49.175346+0000","last_undegraded":"2023-10-06T03:09:49.175346+0000","last_fullsized":"2023-10-06T03:09:49.175346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"26'125","reported_seq":148,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:07.090031+0000","last_change":"2023-10-06T03:10:07.089961+0000","last_active":"2023-10-06T03:10:07.090031+0000","last_peered":"2023-10-06T03:10:07.090031+0000","last_clean":"2023-10-06T03:10:07.090031+0000","last_became_active":"2023-10-06T02:59:53.292378+0000","last_became_peered":"2023-10-06T02:59:53.292378+0000","last_unstale":"2023-10-06T03:10:07.090031+0000","last_undegraded":"2023-10-06T03:10:07.090031+0000","last_fullsized":"2023-10-06T03:10:07.090031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'125","last_scrub_stamp":"2023-10-06T03:10:07.089660+0000","last_deep_scrub":"26'125","last_deep_scrub_stamp":"2023-10-06T03:10:07.089660+0000","last_clean_scrub_stamp":"2023-10-06T03:10:07.089660+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:33.076065+0000","scrub_duration":0.0042091079999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"26'92","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205685+0000","last_change":"2023-10-06T02:59:53.675542+0000","last_active":"2023-10-06T03:09:49.205685+0000","last_peered":"2023-10-06T03:09:49.205685+0000","last_clean":"2023-10-06T03:09:49.205685+0000","last_became_active":"2023-10-06T02:59:53.675219+0000","last_became_peered":"2023-10-06T02:59:53.675219+0000","last_unstale":"2023-10-06T03:09:49.205685+0000","last_undegraded":"2023-10-06T03:09:49.205685+0000","last_fullsized":"2023-10-06T03:09:49.205685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"26'124","reported_seq":147,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:15.125161+0000","last_change":"2023-10-06T03:10:15.125056+0000","last_active":"2023-10-06T03:10:15.125161+0000","last_peered":"2023-10-06T03:10:15.125161+0000","last_clean":"2023-10-06T03:10:15.125161+0000","last_became_active":"2023-10-06T02:59:53.301737+0000","last_became_peered":"2023-10-06T02:59:53.301737+0000","last_unstale":"2023-10-06T03:10:15.125161+0000","last_undegraded":"2023-10-06T03:10:15.125161+0000","last_fullsized":"2023-10-06T03:10:15.125161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'124","last_scrub_stamp":"2023-10-06T03:10:15.124658+0000","last_deep_scrub":"26'124","last_deep_scrub_stamp":"2023-10-06T03:10:15.124658+0000","last_clean_scrub_stamp":"2023-10-06T03:10:15.124658+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:43.006174+0000","scrub_duration":0.0049652760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'80","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203563+0000","last_change":"2023-10-06T02:59:53.684854+0000","last_active":"2023-10-06T03:09:49.203563+0000","last_peered":"2023-10-06T03:09:49.203563+0000","last_clean":"2023-10-06T03:09:49.203563+0000","last_became_active":"2023-10-06T02:59:53.684527+0000","last_became_peered":"2023-10-06T02:59:53.684527+0000","last_unstale":"2023-10-06T03:09:49.203563+0000","last_undegraded":"2023-10-06T03:09:49.203563+0000","last_fullsized":"2023-10-06T03:09:49.203563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"26'139","reported_seq":162,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:03.006058+0000","last_change":"2023-10-06T03:10:03.005991+0000","last_active":"2023-10-06T03:10:03.006058+0000","last_peered":"2023-10-06T03:10:03.006058+0000","last_clean":"2023-10-06T03:10:03.006058+0000","last_became_active":"2023-10-06T02:59:53.293707+0000","last_became_peered":"2023-10-06T02:59:53.293707+0000","last_unstale":"2023-10-06T03:10:03.006058+0000","last_undegraded":"2023-10-06T03:10:03.006058+0000","last_fullsized":"2023-10-06T03:10:03.006058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'139","last_scrub_stamp":"2023-10-06T03:10:03.005737+0000","last_deep_scrub":"26'139","last_deep_scrub_stamp":"2023-10-06T03:10:03.005737+0000","last_clean_scrub_stamp":"2023-10-06T03:10:03.005737+0000","objects_scrubbed":4,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:41.702358+0000","scrub_duration":0.011013787000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"26'118","reported_seq":131,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.499236+0000","last_change":"2023-10-06T02:59:53.296507+0000","last_active":"2023-10-06T03:09:38.499236+0000","last_peered":"2023-10-06T03:09:38.499236+0000","last_clean":"2023-10-06T03:09:38.499236+0000","last_became_active":"2023-10-06T02:59:53.296230+0000","last_became_peered":"2023-10-06T02:59:53.296230+0000","last_unstale":"2023-10-06T03:09:38.499236+0000","last_undegraded":"2023-10-06T03:09:38.499236+0000","last_fullsized":"2023-10-06T03:09:38.499236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"26'90","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.176702+0000","last_change":"2023-10-06T02:59:53.684046+0000","last_active":"2023-10-06T03:09:49.176702+0000","last_peered":"2023-10-06T03:09:49.176702+0000","last_clean":"2023-10-06T03:09:49.176702+0000","last_became_active":"2023-10-06T02:59:53.683705+0000","last_became_peered":"2023-10-06T02:59:53.683705+0000","last_unstale":"2023-10-06T03:09:49.176702+0000","last_undegraded":"2023-10-06T03:09:49.176702+0000","last_fullsized":"2023-10-06T03:09:49.176702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'106","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:09.150560+0000","last_change":"2023-10-06T02:59:53.296465+0000","last_active":"2023-10-06T03:09:09.150560+0000","last_peered":"2023-10-06T03:09:09.150560+0000","last_clean":"2023-10-06T03:09:09.150560+0000","last_became_active":"2023-10-06T02:59:53.296225+0000","last_became_peered":"2023-10-06T02:59:53.296225+0000","last_unstale":"2023-10-06T03:09:09.150560+0000","last_undegraded":"2023-10-06T03:09:09.150560+0000","last_fullsized":"2023-10-06T03:09:09.150560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'81","reported_seq":93,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.199824+0000","last_change":"2023-10-06T02:59:53.683216+0000","last_active":"2023-10-06T03:09:49.199824+0000","last_peered":"2023-10-06T03:09:49.199824+0000","last_clean":"2023-10-06T03:09:49.199824+0000","last_became_active":"2023-10-06T02:59:53.682938+0000","last_became_peered":"2023-10-06T02:59:53.682938+0000","last_unstale":"2023-10-06T03:09:49.199824+0000","last_undegraded":"2023-10-06T03:09:49.199824+0000","last_fullsized":"2023-10-06T03:09:49.199824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"26'620","reported_seq":633,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506235+0000","last_change":"2023-10-06T02:59:53.293929+0000","last_active":"2023-10-06T03:09:37.506235+0000","last_peered":"2023-10-06T03:09:37.506235+0000","last_clean":"2023-10-06T03:09:37.506235+0000","last_became_active":"2023-10-06T02:59:53.293602+0000","last_became_peered":"2023-10-06T02:59:53.293602+0000","last_unstale":"2023-10-06T03:09:37.506235+0000","last_undegraded":"2023-10-06T03:09:37.506235+0000","last_fullsized":"2023-10-06T03:09:37.506235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"26'75","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:10.010261+0000","last_change":"2023-10-06T03:10:10.010194+0000","last_active":"2023-10-06T03:10:10.010261+0000","last_peered":"2023-10-06T03:10:10.010261+0000","last_clean":"2023-10-06T03:10:10.010261+0000","last_became_active":"2023-10-06T02:59:53.671511+0000","last_became_peered":"2023-10-06T02:59:53.671511+0000","last_unstale":"2023-10-06T03:10:10.010261+0000","last_undegraded":"2023-10-06T03:10:10.010261+0000","last_fullsized":"2023-10-06T03:10:10.010261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'75","last_scrub_stamp":"2023-10-06T03:10:10.009944+0000","last_deep_scrub":"26'75","last_deep_scrub_stamp":"2023-10-06T03:10:10.009944+0000","last_clean_scrub_stamp":"2023-10-06T03:10:10.009944+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:35.996349+0000","scrub_duration":0.0048294820000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'134","reported_seq":157,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:16.293257+0000","last_change":"2023-10-06T03:10:16.293195+0000","last_active":"2023-10-06T03:10:16.293257+0000","last_peered":"2023-10-06T03:10:16.293257+0000","last_clean":"2023-10-06T03:10:16.293257+0000","last_became_active":"2023-10-06T02:59:53.299715+0000","last_became_peered":"2023-10-06T02:59:53.299715+0000","last_unstale":"2023-10-06T03:10:16.293257+0000","last_undegraded":"2023-10-06T03:10:16.293257+0000","last_fullsized":"2023-10-06T03:10:16.293257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'134","last_scrub_stamp":"2023-10-06T03:10:16.292913+0000","last_deep_scrub":"26'134","last_deep_scrub_stamp":"2023-10-06T03:10:16.292913+0000","last_clean_scrub_stamp":"2023-10-06T03:10:16.292913+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:22.469009+0000","scrub_duration":0.0043004039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"26'94","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.201134+0000","last_change":"2023-10-06T02:59:53.683331+0000","last_active":"2023-10-06T03:09:49.201134+0000","last_peered":"2023-10-06T03:09:49.201134+0000","last_clean":"2023-10-06T03:09:49.201134+0000","last_became_active":"2023-10-06T02:59:53.682994+0000","last_became_peered":"2023-10-06T02:59:53.682994+0000","last_unstale":"2023-10-06T03:09:49.201134+0000","last_undegraded":"2023-10-06T03:09:49.201134+0000","last_fullsized":"2023-10-06T03:09:49.201134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'620","reported_seq":643,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:02.130329+0000","last_change":"2023-10-06T03:10:02.130249+0000","last_active":"2023-10-06T03:10:02.130329+0000","last_peered":"2023-10-06T03:10:02.130329+0000","last_clean":"2023-10-06T03:10:02.130329+0000","last_became_active":"2023-10-06T02:59:53.300850+0000","last_became_peered":"2023-10-06T02:59:53.300850+0000","last_unstale":"2023-10-06T03:10:02.130329+0000","last_undegraded":"2023-10-06T03:10:02.130329+0000","last_fullsized":"2023-10-06T03:10:02.130329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'620","last_scrub_stamp":"2023-10-06T03:10:02.129953+0000","last_deep_scrub":"26'620","last_deep_scrub_stamp":"2023-10-06T03:10:02.129953+0000","last_clean_scrub_stamp":"2023-10-06T03:10:02.129953+0000","objects_scrubbed":2,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:16.383931+0000","scrub_duration":0.023249453,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'92","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:04.418253+0000","last_change":"2023-10-06T03:10:04.418128+0000","last_active":"2023-10-06T03:10:04.418253+0000","last_peered":"2023-10-06T03:10:04.418253+0000","last_clean":"2023-10-06T03:10:04.418253+0000","last_became_active":"2023-10-06T02:59:53.678630+0000","last_became_peered":"2023-10-06T02:59:53.678630+0000","last_unstale":"2023-10-06T03:10:04.418253+0000","last_undegraded":"2023-10-06T03:10:04.418253+0000","last_fullsized":"2023-10-06T03:10:04.418253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2023-10-06T03:10:04.417805+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2023-10-06T03:10:04.417805+0000","last_clean_scrub_stamp":"2023-10-06T03:10:04.417805+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:30.404211+0000","scrub_duration":0.004364588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'128","reported_seq":151,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:03.994004+0000","last_change":"2023-10-06T03:10:03.993933+0000","last_active":"2023-10-06T03:10:03.994004+0000","last_peered":"2023-10-06T03:10:03.994004+0000","last_clean":"2023-10-06T03:10:03.994004+0000","last_became_active":"2023-10-06T02:59:53.290773+0000","last_became_peered":"2023-10-06T02:59:53.290773+0000","last_unstale":"2023-10-06T03:10:03.994004+0000","last_undegraded":"2023-10-06T03:10:03.994004+0000","last_fullsized":"2023-10-06T03:10:03.994004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'128","last_scrub_stamp":"2023-10-06T03:10:03.993644+0000","last_deep_scrub":"26'128","last_deep_scrub_stamp":"2023-10-06T03:10:03.993644+0000","last_clean_scrub_stamp":"2023-10-06T03:10:03.993644+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:04.037931+0000","scrub_duration":0.0040760750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"26'92","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.198885+0000","last_change":"2023-10-06T02:59:53.678188+0000","last_active":"2023-10-06T03:09:49.198885+0000","last_peered":"2023-10-06T03:09:49.198885+0000","last_clean":"2023-10-06T03:09:49.198885+0000","last_became_active":"2023-10-06T02:59:53.676507+0000","last_became_peered":"2023-10-06T02:59:53.676507+0000","last_unstale":"2023-10-06T03:09:49.198885+0000","last_undegraded":"2023-10-06T03:09:49.198885+0000","last_fullsized":"2023-10-06T03:09:49.198885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"26'126","reported_seq":139,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.500755+0000","last_change":"2023-10-06T02:59:53.289980+0000","last_active":"2023-10-06T03:09:37.500755+0000","last_peered":"2023-10-06T03:09:37.500755+0000","last_clean":"2023-10-06T03:09:37.500755+0000","last_became_active":"2023-10-06T02:59:53.288601+0000","last_became_peered":"2023-10-06T02:59:53.288601+0000","last_unstale":"2023-10-06T03:09:37.500755+0000","last_undegraded":"2023-10-06T03:09:37.500755+0000","last_fullsized":"2023-10-06T03:09:37.500755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"26'87","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191656+0000","last_change":"2023-10-06T02:59:53.675456+0000","last_active":"2023-10-06T03:09:49.191656+0000","last_peered":"2023-10-06T03:09:49.191656+0000","last_clean":"2023-10-06T03:09:49.191656+0000","last_became_active":"2023-10-06T02:59:53.673268+0000","last_became_peered":"2023-10-06T02:59:53.673268+0000","last_unstale":"2023-10-06T03:09:49.191656+0000","last_undegraded":"2023-10-06T03:09:49.191656+0000","last_fullsized":"2023-10-06T03:09:49.191656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'688","reported_seq":711,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:01.095525+0000","last_change":"2023-10-06T03:10:01.095463+0000","last_active":"2023-10-06T03:10:01.095525+0000","last_peered":"2023-10-06T03:10:01.095525+0000","last_clean":"2023-10-06T03:10:01.095525+0000","last_became_active":"2023-10-06T02:59:53.297896+0000","last_became_peered":"2023-10-06T02:59:53.297896+0000","last_unstale":"2023-10-06T03:10:01.095525+0000","last_undegraded":"2023-10-06T03:10:01.095525+0000","last_fullsized":"2023-10-06T03:10:01.095525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'688","last_scrub_stamp":"2023-10-06T03:10:01.095265+0000","last_deep_scrub":"26'688","last_deep_scrub_stamp":"2023-10-06T03:10:01.095265+0000","last_clean_scrub_stamp":"2023-10-06T03:10:01.095265+0000","objects_scrubbed":1,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:29.509465+0000","scrub_duration":0.023556345999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"26'75","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205232+0000","last_change":"2023-10-06T02:59:53.679712+0000","last_active":"2023-10-06T03:09:49.205232+0000","last_peered":"2023-10-06T03:09:49.205232+0000","last_clean":"2023-10-06T03:09:49.205232+0000","last_became_active":"2023-10-06T02:59:53.679390+0000","last_became_peered":"2023-10-06T02:59:53.679390+0000","last_unstale":"2023-10-06T03:09:49.205232+0000","last_undegraded":"2023-10-06T03:09:49.205232+0000","last_fullsized":"2023-10-06T03:09:49.205232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":181,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:05.097662+0000","last_change":"2023-10-06T03:10:05.097603+0000","last_active":"2023-10-06T03:10:05.097662+0000","last_peered":"2023-10-06T03:10:05.097662+0000","last_clean":"2023-10-06T03:10:05.097662+0000","last_became_active":"2023-10-06T02:59:44.072854+0000","last_became_peered":"2023-10-06T02:59:44.072854+0000","last_unstale":"2023-10-06T03:10:05.097662+0000","last_undegraded":"2023-10-06T03:10:05.097662+0000","last_fullsized":"2023-10-06T03:10:05.097662+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2023-10-06T03:10:05.097351+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2023-10-06T03:10:05.097351+0000","last_clean_scrub_stamp":"2023-10-06T03:10:05.097351+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:05.141638+0000","scrub_duration":0.013871631000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:09.346769+0000","last_change":"2023-10-06T03:10:09.346668+0000","last_active":"2023-10-06T03:10:09.346769+0000","last_peered":"2023-10-06T03:10:09.346769+0000","last_clean":"2023-10-06T03:10:09.346769+0000","last_became_active":"2023-10-06T02:59:49.106619+0000","last_became_peered":"2023-10-06T02:59:49.106619+0000","last_unstale":"2023-10-06T03:10:09.346769+0000","last_undegraded":"2023-10-06T03:10:09.346769+0000","last_fullsized":"2023-10-06T03:10:09.346769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:09.346351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:09.346351+0000","last_clean_scrub_stamp":"2023-10-06T03:10:09.346351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:35.332756+0000","scrub_duration":0.0039630009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"26'1463","reported_seq":1486,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:05.133084+0000","last_change":"2023-10-06T03:10:05.133006+0000","last_active":"2023-10-06T03:10:05.133084+0000","last_peered":"2023-10-06T03:10:05.133084+0000","last_clean":"2023-10-06T03:10:05.133084+0000","last_became_active":"2023-10-06T02:59:53.298012+0000","last_became_peered":"2023-10-06T02:59:53.298012+0000","last_unstale":"2023-10-06T03:10:05.133084+0000","last_undegraded":"2023-10-06T03:10:05.133084+0000","last_fullsized":"2023-10-06T03:10:05.133084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1463","last_scrub_stamp":"2023-10-06T03:10:05.132728+0000","last_deep_scrub":"26'1463","last_deep_scrub_stamp":"2023-10-06T03:10:05.132728+0000","last_clean_scrub_stamp":"2023-10-06T03:10:05.132728+0000","objects_scrubbed":2,"log_size":1463,"log_dups_size":0,"ondisk_log_size":1463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:16.936485+0000","scrub_duration":0.042468087000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1329,"num_write_kb":8969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"26'92","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:15.979132+0000","last_change":"2023-10-06T03:10:15.979001+0000","last_active":"2023-10-06T03:10:15.979132+0000","last_peered":"2023-10-06T03:10:15.979132+0000","last_clean":"2023-10-06T03:10:15.979132+0000","last_became_active":"2023-10-06T02:59:53.679200+0000","last_became_peered":"2023-10-06T02:59:53.679200+0000","last_unstale":"2023-10-06T03:10:15.979132+0000","last_undegraded":"2023-10-06T03:10:15.979132+0000","last_fullsized":"2023-10-06T03:10:15.979132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2023-10-06T03:10:15.978591+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2023-10-06T03:10:15.978591+0000","last_clean_scrub_stamp":"2023-10-06T03:10:15.978591+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:22.154687+0000","scrub_duration":0.0043756020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:06.062344+0000","last_change":"2023-10-06T03:10:06.062274+0000","last_active":"2023-10-06T03:10:06.062344+0000","last_peered":"2023-10-06T03:10:06.062344+0000","last_clean":"2023-10-06T03:10:06.062344+0000","last_became_active":"2023-10-06T02:59:49.106878+0000","last_became_peered":"2023-10-06T02:59:49.106878+0000","last_unstale":"2023-10-06T03:10:06.062344+0000","last_undegraded":"2023-10-06T03:10:06.062344+0000","last_fullsized":"2023-10-06T03:10:06.062344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:06.062015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:06.062015+0000","last_clean_scrub_stamp":"2023-10-06T03:10:06.062015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:17.865773+0000","scrub_duration":0.0058099720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"26'604","reported_seq":1110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:11.111104+0000","last_change":"2023-10-06T03:10:11.111027+0000","last_active":"2023-10-06T03:10:11.111104+0000","last_peered":"2023-10-06T03:10:11.111104+0000","last_clean":"2023-10-06T03:10:11.111104+0000","last_became_active":"2023-10-06T02:59:53.296171+0000","last_became_peered":"2023-10-06T02:59:53.296171+0000","last_unstale":"2023-10-06T03:10:11.111104+0000","last_undegraded":"2023-10-06T03:10:11.111104+0000","last_fullsized":"2023-10-06T03:10:11.111104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'604","last_scrub_stamp":"2023-10-06T03:10:11.110731+0000","last_deep_scrub":"26'604","last_deep_scrub_stamp":"2023-10-06T03:10:11.110731+0000","last_clean_scrub_stamp":"2023-10-06T03:10:11.110731+0000","objects_scrubbed":1,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:38.992246+0000","scrub_duration":0.012150444999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770024,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":483,"num_write_kb":1079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"26'88","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.201071+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T03:09:49.201071+0000","last_peered":"2023-10-06T03:09:49.201071+0000","last_clean":"2023-10-06T03:09:49.201071+0000","last_became_active":"2023-10-06T02:59:53.681786+0000","last_became_peered":"2023-10-06T02:59:53.681786+0000","last_unstale":"2023-10-06T03:09:49.201071+0000","last_undegraded":"2023-10-06T03:09:49.201071+0000","last_fullsized":"2023-10-06T03:09:49.201071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:00.752920+0000","last_change":"2023-10-06T03:10:00.752834+0000","last_active":"2023-10-06T03:10:00.752920+0000","last_peered":"2023-10-06T03:10:00.752920+0000","last_clean":"2023-10-06T03:10:00.752920+0000","last_became_active":"2023-10-06T02:59:49.114769+0000","last_became_peered":"2023-10-06T02:59:49.114769+0000","last_unstale":"2023-10-06T03:10:00.752920+0000","last_undegraded":"2023-10-06T03:10:00.752920+0000","last_fullsized":"2023-10-06T03:10:00.752920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:00.752583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:00.752583+0000","last_clean_scrub_stamp":"2023-10-06T03:10:00.752583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:30.133142+0000","scrub_duration":0.0033960230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'1470","reported_seq":1493,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:04.020034+0000","last_change":"2023-10-06T03:10:04.019981+0000","last_active":"2023-10-06T03:10:04.020034+0000","last_peered":"2023-10-06T03:10:04.020034+0000","last_clean":"2023-10-06T03:10:04.020034+0000","last_became_active":"2023-10-06T02:59:53.298054+0000","last_became_peered":"2023-10-06T02:59:53.298054+0000","last_unstale":"2023-10-06T03:10:04.020034+0000","last_undegraded":"2023-10-06T03:10:04.020034+0000","last_fullsized":"2023-10-06T03:10:04.020034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1470","last_scrub_stamp":"2023-10-06T03:10:04.019787+0000","last_deep_scrub":"26'1470","last_deep_scrub_stamp":"2023-10-06T03:10:04.019787+0000","last_clean_scrub_stamp":"2023-10-06T03:10:04.019787+0000","objects_scrubbed":2,"log_size":1470,"log_dups_size":0,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:51.929095+0000","scrub_duration":0.048117597999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1335,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"26'79","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:07.879509+0000","last_change":"2023-10-06T03:10:07.879434+0000","last_active":"2023-10-06T03:10:07.879509+0000","last_peered":"2023-10-06T03:10:07.879509+0000","last_clean":"2023-10-06T03:10:07.879509+0000","last_became_active":"2023-10-06T02:59:53.673677+0000","last_became_peered":"2023-10-06T02:59:53.673677+0000","last_unstale":"2023-10-06T03:10:07.879509+0000","last_undegraded":"2023-10-06T03:10:07.879509+0000","last_fullsized":"2023-10-06T03:10:07.879509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2023-10-06T03:10:07.879169+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2023-10-06T03:10:07.879169+0000","last_clean_scrub_stamp":"2023-10-06T03:10:07.879169+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:07.923455+0000","scrub_duration":0.0046089219999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:14.264128+0000","last_change":"2023-10-06T03:10:14.264062+0000","last_active":"2023-10-06T03:10:14.264128+0000","last_peered":"2023-10-06T03:10:14.264128+0000","last_clean":"2023-10-06T03:10:14.264128+0000","last_became_active":"2023-10-06T02:59:49.107560+0000","last_became_peered":"2023-10-06T02:59:49.107560+0000","last_unstale":"2023-10-06T03:10:14.264128+0000","last_undegraded":"2023-10-06T03:10:14.264128+0000","last_fullsized":"2023-10-06T03:10:14.264128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:14.263786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:14.263786+0000","last_clean_scrub_stamp":"2023-10-06T03:10:14.263786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:42.145301+0000","scrub_duration":0.003869969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'122","reported_seq":135,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506324+0000","last_change":"2023-10-06T02:59:53.300945+0000","last_active":"2023-10-06T03:09:37.506324+0000","last_peered":"2023-10-06T03:09:37.506324+0000","last_clean":"2023-10-06T03:09:37.506324+0000","last_became_active":"2023-10-06T02:59:53.300609+0000","last_became_peered":"2023-10-06T02:59:53.300609+0000","last_unstale":"2023-10-06T03:09:37.506324+0000","last_undegraded":"2023-10-06T03:09:37.506324+0000","last_fullsized":"2023-10-06T03:09:37.506324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"26'78","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192797+0000","last_change":"2023-10-06T03:00:34.740673+0000","last_active":"2023-10-06T03:09:49.192797+0000","last_peered":"2023-10-06T03:09:49.192797+0000","last_clean":"2023-10-06T03:09:49.192797+0000","last_became_active":"2023-10-06T03:00:34.740140+0000","last_became_peered":"2023-10-06T03:00:34.740140+0000","last_unstale":"2023-10-06T03:09:49.192797+0000","last_undegraded":"2023-10-06T03:09:49.192797+0000","last_fullsized":"2023-10-06T03:09:49.192797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'105","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506464+0000","last_change":"2023-10-06T02:59:53.301191+0000","last_active":"2023-10-06T03:09:37.506464+0000","last_peered":"2023-10-06T03:09:37.506464+0000","last_clean":"2023-10-06T03:09:37.506464+0000","last_became_active":"2023-10-06T02:59:53.300919+0000","last_became_peered":"2023-10-06T02:59:53.300919+0000","last_unstale":"2023-10-06T03:09:37.506464+0000","last_undegraded":"2023-10-06T03:09:37.506464+0000","last_fullsized":"2023-10-06T03:09:37.506464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:59.902097+0000","last_change":"2023-10-06T03:09:59.902052+0000","last_active":"2023-10-06T03:09:59.902097+0000","last_peered":"2023-10-06T03:09:59.902097+0000","last_clean":"2023-10-06T03:09:59.902097+0000","last_became_active":"2023-10-06T02:59:49.107967+0000","last_became_peered":"2023-10-06T02:59:49.107967+0000","last_unstale":"2023-10-06T03:09:59.902097+0000","last_undegraded":"2023-10-06T03:09:59.902097+0000","last_fullsized":"2023-10-06T03:09:59.902097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:09:59.901857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:09:59.901857+0000","last_clean_scrub_stamp":"2023-10-06T03:09:59.901857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:05.160444+0000","scrub_duration":0.003240022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'75","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196552+0000","last_change":"2023-10-06T02:59:53.676753+0000","last_active":"2023-10-06T03:09:49.196552+0000","last_peered":"2023-10-06T03:09:49.196552+0000","last_clean":"2023-10-06T03:09:49.196552+0000","last_became_active":"2023-10-06T02:59:53.676385+0000","last_became_peered":"2023-10-06T02:59:53.676385+0000","last_unstale":"2023-10-06T03:09:49.196552+0000","last_undegraded":"2023-10-06T03:09:49.196552+0000","last_fullsized":"2023-10-06T03:09:49.196552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"26'115","reported_seq":138,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:04.938136+0000","last_change":"2023-10-06T03:10:04.938068+0000","last_active":"2023-10-06T03:10:04.938136+0000","last_peered":"2023-10-06T03:10:04.938136+0000","last_clean":"2023-10-06T03:10:04.938136+0000","last_became_active":"2023-10-06T02:59:53.302890+0000","last_became_peered":"2023-10-06T02:59:53.302890+0000","last_unstale":"2023-10-06T03:10:04.938136+0000","last_undegraded":"2023-10-06T03:10:04.938136+0000","last_fullsized":"2023-10-06T03:10:04.938136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'115","last_scrub_stamp":"2023-10-06T03:10:04.937798+0000","last_deep_scrub":"26'115","last_deep_scrub_stamp":"2023-10-06T03:10:04.937798+0000","last_clean_scrub_stamp":"2023-10-06T03:10:04.937798+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:19.191776+0000","scrub_duration":0.0040328159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:11.154639+0000","last_change":"2023-10-06T03:10:11.154566+0000","last_active":"2023-10-06T03:10:11.154639+0000","last_peered":"2023-10-06T03:10:11.154639+0000","last_clean":"2023-10-06T03:10:11.154639+0000","last_became_active":"2023-10-06T02:59:49.101530+0000","last_became_peered":"2023-10-06T02:59:49.101530+0000","last_unstale":"2023-10-06T03:10:11.154639+0000","last_undegraded":"2023-10-06T03:10:11.154639+0000","last_fullsized":"2023-10-06T03:10:11.154639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:11.154299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:11.154299+0000","last_clean_scrub_stamp":"2023-10-06T03:10:11.154299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:37.140705+0000","scrub_duration":0.0041325099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'79","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.187079+0000","last_change":"2023-10-06T02:59:53.672581+0000","last_active":"2023-10-06T03:09:49.187079+0000","last_peered":"2023-10-06T03:09:49.187079+0000","last_clean":"2023-10-06T03:09:49.187079+0000","last_became_active":"2023-10-06T02:59:53.672299+0000","last_became_peered":"2023-10-06T02:59:53.672299+0000","last_unstale":"2023-10-06T03:09:49.187079+0000","last_undegraded":"2023-10-06T03:09:49.187079+0000","last_fullsized":"2023-10-06T03:09:49.187079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"26'121","reported_seq":144,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:10.175123+0000","last_change":"2023-10-06T03:10:10.175047+0000","last_active":"2023-10-06T03:10:10.175123+0000","last_peered":"2023-10-06T03:10:10.175123+0000","last_clean":"2023-10-06T03:10:10.175123+0000","last_became_active":"2023-10-06T02:59:53.299271+0000","last_became_peered":"2023-10-06T02:59:53.299271+0000","last_unstale":"2023-10-06T03:10:10.175123+0000","last_undegraded":"2023-10-06T03:10:10.175123+0000","last_fullsized":"2023-10-06T03:10:10.175123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'121","last_scrub_stamp":"2023-10-06T03:10:10.174733+0000","last_deep_scrub":"26'121","last_deep_scrub_stamp":"2023-10-06T03:10:10.174733+0000","last_clean_scrub_stamp":"2023-10-06T03:10:10.174733+0000","objects_scrubbed":1,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:36.161138+0000","scrub_duration":0.0074238999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:00.939734+0000","last_change":"2023-10-06T03:10:00.939709+0000","last_active":"2023-10-06T03:10:00.939734+0000","last_peered":"2023-10-06T03:10:00.939734+0000","last_clean":"2023-10-06T03:10:00.939734+0000","last_became_active":"2023-10-06T02:59:49.099689+0000","last_became_peered":"2023-10-06T02:59:49.099689+0000","last_unstale":"2023-10-06T03:10:00.939734+0000","last_undegraded":"2023-10-06T03:10:00.939734+0000","last_fullsized":"2023-10-06T03:10:00.939734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:00.939619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:00.939619+0000","last_clean_scrub_stamp":"2023-10-06T03:10:00.939619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:52.791469+0000","scrub_duration":0.0037315680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'94","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204106+0000","last_change":"2023-10-06T02:59:53.685270+0000","last_active":"2023-10-06T03:09:49.204106+0000","last_peered":"2023-10-06T03:09:49.204106+0000","last_clean":"2023-10-06T03:09:49.204106+0000","last_became_active":"2023-10-06T02:59:53.684983+0000","last_became_peered":"2023-10-06T02:59:53.684983+0000","last_unstale":"2023-10-06T03:09:49.204106+0000","last_undegraded":"2023-10-06T03:09:49.204106+0000","last_fullsized":"2023-10-06T03:09:49.204106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'245","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:14.182077+0000","last_change":"2023-10-06T03:10:14.182047+0000","last_active":"2023-10-06T03:10:14.182077+0000","last_peered":"2023-10-06T03:10:14.182077+0000","last_clean":"2023-10-06T03:10:14.182077+0000","last_became_active":"2023-10-06T02:59:53.300086+0000","last_became_peered":"2023-10-06T02:59:53.300086+0000","last_unstale":"2023-10-06T03:10:14.182077+0000","last_undegraded":"2023-10-06T03:10:14.182077+0000","last_fullsized":"2023-10-06T03:10:14.182077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'245","last_scrub_stamp":"2023-10-06T03:10:14.181904+0000","last_deep_scrub":"26'245","last_deep_scrub_stamp":"2023-10-06T03:10:14.181904+0000","last_clean_scrub_stamp":"2023-10-06T03:10:14.181904+0000","objects_scrubbed":1,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:20.358000+0000","scrub_duration":0.017879721000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:02.012539+0000","last_change":"2023-10-06T03:10:02.012475+0000","last_active":"2023-10-06T03:10:02.012539+0000","last_peered":"2023-10-06T03:10:02.012539+0000","last_clean":"2023-10-06T03:10:02.012539+0000","last_became_active":"2023-10-06T02:59:49.102397+0000","last_became_peered":"2023-10-06T02:59:49.102397+0000","last_unstale":"2023-10-06T03:10:02.012539+0000","last_undegraded":"2023-10-06T03:10:02.012539+0000","last_fullsized":"2023-10-06T03:10:02.012539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:02.012201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:02.012201+0000","last_clean_scrub_stamp":"2023-10-06T03:10:02.012201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:16.266178+0000","scrub_duration":0.0038301799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'77","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192575+0000","last_change":"2023-10-06T02:59:53.676229+0000","last_active":"2023-10-06T03:09:49.192575+0000","last_peered":"2023-10-06T03:09:49.192575+0000","last_clean":"2023-10-06T03:09:49.192575+0000","last_became_active":"2023-10-06T02:59:53.675895+0000","last_became_peered":"2023-10-06T02:59:53.675895+0000","last_unstale":"2023-10-06T03:09:49.192575+0000","last_undegraded":"2023-10-06T03:09:49.192575+0000","last_fullsized":"2023-10-06T03:09:49.192575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"26'85","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:11.453952+0000","last_change":"2023-10-06T03:10:11.453859+0000","last_active":"2023-10-06T03:10:11.453952+0000","last_peered":"2023-10-06T03:10:11.453952+0000","last_clean":"2023-10-06T03:10:11.453952+0000","last_became_active":"2023-10-06T02:59:53.676528+0000","last_became_peered":"2023-10-06T02:59:53.676528+0000","last_unstale":"2023-10-06T03:10:11.453952+0000","last_undegraded":"2023-10-06T03:10:11.453952+0000","last_fullsized":"2023-10-06T03:10:11.453952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'85","last_scrub_stamp":"2023-10-06T03:10:11.453577+0000","last_deep_scrub":"26'85","last_deep_scrub_stamp":"2023-10-06T03:10:11.453577+0000","last_clean_scrub_stamp":"2023-10-06T03:10:11.453577+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:17.629673+0000","scrub_duration":0.0039029749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'532","reported_seq":555,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:16.383715+0000","last_change":"2023-10-06T03:10:16.383643+0000","last_active":"2023-10-06T03:10:16.383715+0000","last_peered":"2023-10-06T03:10:16.383715+0000","last_clean":"2023-10-06T03:10:16.383715+0000","last_became_active":"2023-10-06T02:59:53.291434+0000","last_became_peered":"2023-10-06T02:59:53.291434+0000","last_unstale":"2023-10-06T03:10:16.383715+0000","last_undegraded":"2023-10-06T03:10:16.383715+0000","last_fullsized":"2023-10-06T03:10:16.383715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'532","last_scrub_stamp":"2023-10-06T03:10:16.383436+0000","last_deep_scrub":"26'532","last_deep_scrub_stamp":"2023-10-06T03:10:16.383436+0000","last_clean_scrub_stamp":"2023-10-06T03:10:16.383436+0000","objects_scrubbed":4,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:22.523431+0000","scrub_duration":0.025598717999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'80","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196930+0000","last_change":"2023-10-06T02:59:53.678204+0000","last_active":"2023-10-06T03:09:49.196930+0000","last_peered":"2023-10-06T03:09:49.196930+0000","last_clean":"2023-10-06T03:09:49.196930+0000","last_became_active":"2023-10-06T02:59:53.677924+0000","last_became_peered":"2023-10-06T02:59:53.677924+0000","last_unstale":"2023-10-06T03:09:49.196930+0000","last_undegraded":"2023-10-06T03:09:49.196930+0000","last_fullsized":"2023-10-06T03:09:49.196930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"26'336","reported_seq":349,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:39.502552+0000","last_change":"2023-10-06T02:59:53.301253+0000","last_active":"2023-10-06T03:09:39.502552+0000","last_peered":"2023-10-06T03:09:39.502552+0000","last_clean":"2023-10-06T03:09:39.502552+0000","last_became_active":"2023-10-06T02:59:53.300926+0000","last_became_peered":"2023-10-06T02:59:53.300926+0000","last_unstale":"2023-10-06T03:09:39.502552+0000","last_undegraded":"2023-10-06T03:09:39.502552+0000","last_fullsized":"2023-10-06T03:09:39.502552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'135","reported_seq":148,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.503236+0000","last_change":"2023-10-06T02:59:53.292844+0000","last_active":"2023-10-06T03:09:37.503236+0000","last_peered":"2023-10-06T03:09:37.503236+0000","last_clean":"2023-10-06T03:09:37.503236+0000","last_became_active":"2023-10-06T02:59:53.292493+0000","last_became_peered":"2023-10-06T02:59:53.292493+0000","last_unstale":"2023-10-06T03:09:37.503236+0000","last_undegraded":"2023-10-06T03:09:37.503236+0000","last_fullsized":"2023-10-06T03:09:37.503236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"26'94","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206509+0000","last_change":"2023-10-06T02:59:53.676684+0000","last_active":"2023-10-06T03:09:49.206509+0000","last_peered":"2023-10-06T03:09:49.206509+0000","last_clean":"2023-10-06T03:09:49.206509+0000","last_became_active":"2023-10-06T02:59:53.676410+0000","last_became_peered":"2023-10-06T02:59:53.676410+0000","last_unstale":"2023-10-06T03:09:49.206509+0000","last_undegraded":"2023-10-06T03:09:49.206509+0000","last_fullsized":"2023-10-06T03:09:49.206509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"26'122","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:02.171081+0000","last_change":"2023-10-06T03:10:02.171020+0000","last_active":"2023-10-06T03:10:02.171081+0000","last_peered":"2023-10-06T03:10:02.171081+0000","last_clean":"2023-10-06T03:10:02.171081+0000","last_became_active":"2023-10-06T02:59:53.293596+0000","last_became_peered":"2023-10-06T02:59:53.293596+0000","last_unstale":"2023-10-06T03:10:02.171081+0000","last_undegraded":"2023-10-06T03:10:02.171081+0000","last_fullsized":"2023-10-06T03:10:02.171081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'122","last_scrub_stamp":"2023-10-06T03:10:02.170789+0000","last_deep_scrub":"26'122","last_deep_scrub_stamp":"2023-10-06T03:10:02.170789+0000","last_clean_scrub_stamp":"2023-10-06T03:10:02.170789+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:13.974546+0000","scrub_duration":0.004002299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"26'91","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204188+0000","last_change":"2023-10-06T02:59:53.673847+0000","last_active":"2023-10-06T03:09:49.204188+0000","last_peered":"2023-10-06T03:09:49.204188+0000","last_clean":"2023-10-06T03:09:49.204188+0000","last_became_active":"2023-10-06T02:59:53.673559+0000","last_became_peered":"2023-10-06T02:59:53.673559+0000","last_unstale":"2023-10-06T03:09:49.204188+0000","last_undegraded":"2023-10-06T03:09:49.204188+0000","last_fullsized":"2023-10-06T03:09:49.204188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"26'76","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:14.006345+0000","last_change":"2023-10-06T03:10:14.006299+0000","last_active":"2023-10-06T03:10:14.006345+0000","last_peered":"2023-10-06T03:10:14.006345+0000","last_clean":"2023-10-06T03:10:14.006345+0000","last_became_active":"2023-10-06T02:59:53.674086+0000","last_became_peered":"2023-10-06T02:59:53.674086+0000","last_unstale":"2023-10-06T03:10:14.006345+0000","last_undegraded":"2023-10-06T03:10:14.006345+0000","last_fullsized":"2023-10-06T03:10:14.006345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'76","last_scrub_stamp":"2023-10-06T03:10:14.006109+0000","last_deep_scrub":"26'76","last_deep_scrub_stamp":"2023-10-06T03:10:14.006109+0000","last_clean_scrub_stamp":"2023-10-06T03:10:14.006109+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:41.887624+0000","scrub_duration":0.0031022850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'1577","reported_seq":1600,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:14.100221+0000","last_change":"2023-10-06T03:10:14.100176+0000","last_active":"2023-10-06T03:10:14.100221+0000","last_peered":"2023-10-06T03:10:14.100221+0000","last_clean":"2023-10-06T03:10:14.100221+0000","last_became_active":"2023-10-06T02:59:53.296550+0000","last_became_peered":"2023-10-06T02:59:53.296550+0000","last_unstale":"2023-10-06T03:10:14.100221+0000","last_undegraded":"2023-10-06T03:10:14.100221+0000","last_fullsized":"2023-10-06T03:10:14.100221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1577","last_scrub_stamp":"2023-10-06T03:10:14.100012+0000","last_deep_scrub":"26'1577","last_deep_scrub_stamp":"2023-10-06T03:10:14.100012+0000","last_clean_scrub_stamp":"2023-10-06T03:10:14.100012+0000","objects_scrubbed":2,"log_size":1577,"log_dups_size":0,"ondisk_log_size":1577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:41.981527+0000","scrub_duration":0.036199587999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7633302,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1449,"num_write_kb":8304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'82","reported_seq":94,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.186317+0000","last_change":"2023-10-06T02:59:53.683771+0000","last_active":"2023-10-06T03:09:49.186317+0000","last_peered":"2023-10-06T03:09:49.186317+0000","last_clean":"2023-10-06T03:09:49.186317+0000","last_became_active":"2023-10-06T02:59:53.683458+0000","last_became_peered":"2023-10-06T02:59:53.683458+0000","last_unstale":"2023-10-06T03:09:49.186317+0000","last_undegraded":"2023-10-06T03:09:49.186317+0000","last_fullsized":"2023-10-06T03:09:49.186317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'118","reported_seq":141,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:05.967468+0000","last_change":"2023-10-06T03:10:05.967386+0000","last_active":"2023-10-06T03:10:05.967468+0000","last_peered":"2023-10-06T03:10:05.967468+0000","last_clean":"2023-10-06T03:10:05.967468+0000","last_became_active":"2023-10-06T02:59:53.300797+0000","last_became_peered":"2023-10-06T02:59:53.300797+0000","last_unstale":"2023-10-06T03:10:05.967468+0000","last_undegraded":"2023-10-06T03:10:05.967468+0000","last_fullsized":"2023-10-06T03:10:05.967468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'118","last_scrub_stamp":"2023-10-06T03:10:05.967098+0000","last_deep_scrub":"26'118","last_deep_scrub_stamp":"2023-10-06T03:10:05.967098+0000","last_clean_scrub_stamp":"2023-10-06T03:10:05.967098+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:44.663720+0000","scrub_duration":0.0045722510000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"26'77","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203952+0000","last_change":"2023-10-06T02:59:53.683576+0000","last_active":"2023-10-06T03:09:49.203952+0000","last_peered":"2023-10-06T03:09:49.203952+0000","last_clean":"2023-10-06T03:09:49.203952+0000","last_became_active":"2023-10-06T02:59:53.683301+0000","last_became_peered":"2023-10-06T02:59:53.683301+0000","last_unstale":"2023-10-06T03:09:49.203952+0000","last_undegraded":"2023-10-06T03:09:49.203952+0000","last_fullsized":"2023-10-06T03:09:49.203952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'489","reported_seq":502,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.504233+0000","last_change":"2023-10-06T02:59:53.297975+0000","last_active":"2023-10-06T03:09:37.504233+0000","last_peered":"2023-10-06T03:09:37.504233+0000","last_clean":"2023-10-06T03:09:37.504233+0000","last_became_active":"2023-10-06T02:59:53.297724+0000","last_became_peered":"2023-10-06T02:59:53.297724+0000","last_unstale":"2023-10-06T03:09:37.504233+0000","last_undegraded":"2023-10-06T03:09:37.504233+0000","last_fullsized":"2023-10-06T03:09:37.504233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":4283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'74","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:01.727031+0000","last_change":"2023-10-06T03:10:01.726976+0000","last_active":"2023-10-06T03:10:01.727031+0000","last_peered":"2023-10-06T03:10:01.727031+0000","last_clean":"2023-10-06T03:10:01.727031+0000","last_became_active":"2023-10-06T02:59:53.684378+0000","last_became_peered":"2023-10-06T02:59:53.684378+0000","last_unstale":"2023-10-06T03:10:01.727031+0000","last_undegraded":"2023-10-06T03:10:01.727031+0000","last_fullsized":"2023-10-06T03:10:01.727031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'74","last_scrub_stamp":"2023-10-06T03:10:01.726739+0000","last_deep_scrub":"26'74","last_deep_scrub_stamp":"2023-10-06T03:10:01.726739+0000","last_clean_scrub_stamp":"2023-10-06T03:10:01.726739+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:19.568134+0000","scrub_duration":0.0023701149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"26'936","reported_seq":959,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:01.195525+0000","last_change":"2023-10-06T03:10:01.195483+0000","last_active":"2023-10-06T03:10:01.195525+0000","last_peered":"2023-10-06T03:10:01.195525+0000","last_clean":"2023-10-06T03:10:01.195525+0000","last_became_active":"2023-10-06T02:59:53.297471+0000","last_became_peered":"2023-10-06T02:59:53.297471+0000","last_unstale":"2023-10-06T03:10:01.195525+0000","last_undegraded":"2023-10-06T03:10:01.195525+0000","last_fullsized":"2023-10-06T03:10:01.195525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'936","last_scrub_stamp":"2023-10-06T03:10:01.195322+0000","last_deep_scrub":"26'936","last_deep_scrub_stamp":"2023-10-06T03:10:01.195322+0000","last_clean_scrub_stamp":"2023-10-06T03:10:01.195322+0000","objects_scrubbed":1,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:01.239609+0000","scrub_duration":0.024228012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":4592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'78","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204888+0000","last_change":"2023-10-06T02:59:53.679138+0000","last_active":"2023-10-06T03:09:49.204888+0000","last_peered":"2023-10-06T03:09:49.204888+0000","last_clean":"2023-10-06T03:09:49.204888+0000","last_became_active":"2023-10-06T02:59:53.678831+0000","last_became_peered":"2023-10-06T02:59:53.678831+0000","last_unstale":"2023-10-06T03:09:49.204888+0000","last_undegraded":"2023-10-06T03:09:49.204888+0000","last_fullsized":"2023-10-06T03:09:49.204888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"26'113","reported_seq":126,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:38.504122+0000","last_change":"2023-10-06T02:59:53.295949+0000","last_active":"2023-10-06T03:09:38.504122+0000","last_peered":"2023-10-06T03:09:38.504122+0000","last_clean":"2023-10-06T03:09:38.504122+0000","last_became_active":"2023-10-06T02:59:53.295697+0000","last_became_peered":"2023-10-06T02:59:53.295697+0000","last_unstale":"2023-10-06T03:09:38.504122+0000","last_undegraded":"2023-10-06T03:09:38.504122+0000","last_fullsized":"2023-10-06T03:09:38.504122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'99","reported_seq":121,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:09.384832+0000","last_change":"2023-10-06T03:10:09.384741+0000","last_active":"2023-10-06T03:10:09.384832+0000","last_peered":"2023-10-06T03:10:09.384832+0000","last_clean":"2023-10-06T03:10:09.384832+0000","last_became_active":"2023-10-06T02:59:53.672629+0000","last_became_peered":"2023-10-06T02:59:53.672629+0000","last_unstale":"2023-10-06T03:10:09.384832+0000","last_undegraded":"2023-10-06T03:10:09.384832+0000","last_fullsized":"2023-10-06T03:10:09.384832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2023-10-06T03:10:09.384456+0000","last_deep_scrub":"26'99","last_deep_scrub_stamp":"2023-10-06T03:10:09.384456+0000","last_clean_scrub_stamp":"2023-10-06T03:10:09.384456+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:37.265971+0000","scrub_duration":0.0040951579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'1071","reported_seq":1084,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:37.506854+0000","last_change":"2023-10-06T02:59:53.297170+0000","last_active":"2023-10-06T03:09:37.506854+0000","last_peered":"2023-10-06T03:09:37.506854+0000","last_clean":"2023-10-06T03:09:37.506854+0000","last_became_active":"2023-10-06T02:59:53.296843+0000","last_became_peered":"2023-10-06T02:59:53.296843+0000","last_unstale":"2023-10-06T03:09:37.506854+0000","last_undegraded":"2023-10-06T03:09:37.506854+0000","last_fullsized":"2023-10-06T03:09:37.506854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":8534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"26'89","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206188+0000","last_change":"2023-10-06T02:59:53.675030+0000","last_active":"2023-10-06T03:09:49.206188+0000","last_peered":"2023-10-06T03:09:49.206188+0000","last_clean":"2023-10-06T03:09:49.206188+0000","last_became_active":"2023-10-06T02:59:53.673662+0000","last_became_peered":"2023-10-06T02:59:53.673662+0000","last_unstale":"2023-10-06T03:09:49.206188+0000","last_undegraded":"2023-10-06T03:09:49.206188+0000","last_fullsized":"2023-10-06T03:09:49.206188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"26'538","reported_seq":561,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:04.152442+0000","last_change":"2023-10-06T03:10:04.152368+0000","last_active":"2023-10-06T03:10:04.152442+0000","last_peered":"2023-10-06T03:10:04.152442+0000","last_clean":"2023-10-06T03:10:04.152442+0000","last_became_active":"2023-10-06T02:59:53.298881+0000","last_became_peered":"2023-10-06T02:59:53.298881+0000","last_unstale":"2023-10-06T03:10:04.152442+0000","last_undegraded":"2023-10-06T03:10:04.152442+0000","last_fullsized":"2023-10-06T03:10:04.152442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'538","last_scrub_stamp":"2023-10-06T03:10:04.152201+0000","last_deep_scrub":"26'538","last_deep_scrub_stamp":"2023-10-06T03:10:04.152201+0000","last_clean_scrub_stamp":"2023-10-06T03:10:04.152201+0000","objects_scrubbed":1,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:04.196488+0000","scrub_duration":0.023718249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'87","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:15.347106+0000","last_change":"2023-10-06T03:10:15.347035+0000","last_active":"2023-10-06T03:10:15.347106+0000","last_peered":"2023-10-06T03:10:15.347106+0000","last_clean":"2023-10-06T03:10:15.347106+0000","last_became_active":"2023-10-06T02:59:53.675092+0000","last_became_peered":"2023-10-06T02:59:53.675092+0000","last_unstale":"2023-10-06T03:10:15.347106+0000","last_undegraded":"2023-10-06T03:10:15.347106+0000","last_fullsized":"2023-10-06T03:10:15.347106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'87","last_scrub_stamp":"2023-10-06T03:10:15.346771+0000","last_deep_scrub":"26'87","last_deep_scrub_stamp":"2023-10-06T03:10:15.346771+0000","last_clean_scrub_stamp":"2023-10-06T03:10:15.346771+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:42.790125+0000","scrub_duration":0.0041187369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"26'552","reported_seq":565,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:08:41.178584+0000","last_change":"2023-10-06T02:59:53.294074+0000","last_active":"2023-10-06T03:08:41.178584+0000","last_peered":"2023-10-06T03:08:41.178584+0000","last_clean":"2023-10-06T03:08:41.178584+0000","last_became_active":"2023-10-06T02:59:53.293752+0000","last_became_peered":"2023-10-06T02:59:53.293752+0000","last_unstale":"2023-10-06T03:08:41.178584+0000","last_undegraded":"2023-10-06T03:08:41.178584+0000","last_fullsized":"2023-10-06T03:08:41.178584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:52.245051+0000","last_clean_scrub_stamp":"2023-10-06T02:59:52.245051+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":438,"num_write_kb":4309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":75513604,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":11546,"num_write_kb":80285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151085056,"data_stored":151027208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15209,"ondisk_log_size":15209,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574979,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314548,"kb_used_data":17260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057292,"statfs":{"total":96636764160,"available":96314667008,"internally_reserved":0,"allocated":17674240,"data_stored":17475112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.90600000000000003,"15min":0.85699999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.41099999999999998},"max":{"1min":1.2789999999999999,"5min":1.893,"15min":1.893},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0029999999999999,"15min":0.98899999999999999},"min":{"1min":0.61699999999999999,"5min":0.54500000000000004,"15min":0.48099999999999998},"max":{"1min":1.2370000000000001,"5min":1.8,"15min":1.8},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.91500000000000004,"15min":0.92800000000000005},"min":{"1min":0.54600000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.266,"5min":1.349,"15min":1.389},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81499999999999995,"15min":0.82499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.38500000000000001},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.006}]},{"osd":2,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.91400000000000003,"15min":0.95499999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.55800000000000005},"max":{"1min":1.0469999999999999,"5min":1.333,"15min":1.4199999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.012,"5min":1.0700000000000001,"15min":1.1299999999999999},"min":{"1min":0.77100000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3160000000000001,"5min":1.3779999999999999,"15min":1.6359999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.93400000000000005,"15min":0.95099999999999996},"min":{"1min":0.56599999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.609,"5min":3.609,"15min":3.609},"last":1.121},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0669999999999999,"15min":1.0900000000000001},"min":{"1min":0.75800000000000001,"5min":0.68200000000000005,"15min":0.66900000000000004},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":0.83799999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.89200000000000002,"15min":0.91300000000000003},"min":{"1min":0.67900000000000005,"5min":0.624,"15min":0.50600000000000001},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0049999999999999,"15min":1.044},"min":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.57499999999999996},"max":{"1min":1.3919999999999999,"5min":1.395,"15min":1.4590000000000001},"last":1.075}]},{"osd":5,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0640000000000001,"15min":1.1459999999999999},"min":{"1min":0.90600000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.425,"5min":1.51,"15min":1.833},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.0229999999999999,"15min":1.0529999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.59199999999999997},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.23}]},{"osd":6,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.093,"15min":1.1180000000000001},"min":{"1min":0.92200000000000004,"5min":0.73799999999999999,"15min":0.71399999999999997},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1499999999999999,"15min":1.1850000000000001},"min":{"1min":0.90700000000000003,"5min":0.78100000000000003,"15min":0.76100000000000001},"max":{"1min":1.5660000000000001,"5min":1.5669999999999999,"15min":1.5860000000000001},"last":0.96299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309848,"kb_used_data":4368,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94061992,"statfs":{"total":96636764160,"available":96319479808,"internally_reserved":0,"allocated":4472832,"data_stored":4300972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.92900000000000005,"15min":1.012},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.548,"5min":1.548,"15min":6.6989999999999998},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.98999999999999999,"15min":1.0780000000000001},"min":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.53200000000000003},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":6.9199999999999999},"last":1.002}]},{"osd":1,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86799999999999999,"15min":0.879},"min":{"1min":0.60599999999999998,"5min":0.56100000000000005,"15min":0.434},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.879,"15min":0.89000000000000001},"min":{"1min":0.55100000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.65600000000000003,"5min":0.55700000000000005,"15min":0.51700000000000002},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90700000000000003,"15min":0.93700000000000006},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.95899999999999996,"15min":0.94399999999999995},"min":{"1min":0.71399999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5820000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.141,"5min":1.0069999999999999,"15min":1.018},"min":{"1min":0.79200000000000004,"5min":0.65300000000000002,"15min":0.52500000000000002},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":0.71299999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.91500000000000004,"15min":1.266},"min":{"1min":0.64000000000000001,"5min":0.57499999999999996,"15min":0.56000000000000005},"max":{"1min":1.5449999999999999,"5min":1.7609999999999999,"15min":17.757000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.1180000000000001,"15min":1.4550000000000001},"min":{"1min":0.92700000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.734,"5min":2.734,"15min":17.382999999999999},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.016,"15min":1.121},"min":{"1min":0.72599999999999998,"5min":0.64800000000000002,"15min":0.61599999999999999},"max":{"1min":2.548,"5min":2.548,"15min":4.3090000000000002},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.1639999999999999,"15min":1.2430000000000001},"min":{"1min":0.876,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":3.3500000000000001,"5min":3.3500000000000001,"15min":4.5709999999999997},"last":1.0269999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.1000000000000001,"15min":1.147},"min":{"1min":0.97899999999999998,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.476,"5min":2.476,"15min":2.476},"last":0.874},{"interface":"front","average":{"1min":1.232,"5min":1.141,"15min":1.1739999999999999},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":3.919,"5min":3.919,"15min":3.919},"last":0.97399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574979,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326240,"kb_used_data":24856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94045600,"statfs":{"total":96636764160,"available":96302694400,"internally_reserved":0,"allocated":25452544,"data_stored":25273116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.876,"15min":0.88400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.40799999999999997},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2849999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.96799999999999997,"15min":1.0009999999999999},"min":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.54800000000000004},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0589999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.874,"15min":0.88600000000000001},"min":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.321,"5min":1.321,"15min":1.363},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.90600000000000003,"15min":0.90500000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2230000000000001,"5min":1.2669999999999999,"15min":1.2689999999999999},"last":1.103}]},{"osd":2,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.879,"15min":0.89900000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.53400000000000003},"max":{"1min":1.2030000000000001,"5min":1.27,"15min":1.405},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.98099999999999998,"15min":0.98599999999999999},"min":{"1min":0.72599999999999998,"5min":0.59399999999999997,"15min":0.44500000000000001},"max":{"1min":1.2230000000000001,"5min":1.4610000000000001,"15min":1.6220000000000001},"last":1.012}]},{"osd":3,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.95799999999999996,"15min":0.95399999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"max":{"1min":1.298,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0529999999999999,"15min":1.0449999999999999},"min":{"1min":0.80100000000000005,"5min":0.72199999999999998,"15min":0.68999999999999995},"max":{"1min":1.278,"5min":1.3720000000000001,"15min":1.53},"last":1.153}]},{"osd":4,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.94299999999999995,"15min":0.92900000000000005},"min":{"1min":0.71499999999999997,"5min":0.61399999999999999,"15min":0.46999999999999997},"max":{"1min":1.3340000000000001,"5min":1.446,"15min":1.446},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.0920000000000001,"15min":1.075},"min":{"1min":0.89900000000000002,"5min":0.68400000000000005,"15min":0.60599999999999998},"max":{"1min":1.577,"5min":1.577,"15min":1.657},"last":1.3500000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0800000000000001,"15min":1.05},"min":{"1min":0.80700000000000005,"5min":0.68600000000000005,"15min":0.58399999999999996},"max":{"1min":1.3069999999999999,"5min":1.546,"15min":1.546},"last":1.278},{"interface":"front","average":{"1min":1.165,"5min":1.1080000000000001,"15min":1.083},"min":{"1min":0.878,"5min":0.77200000000000002,"15min":0.441},"max":{"1min":1.4119999999999999,"5min":1.538,"15min":1.538},"last":1.387}]},{"osd":7,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.155,"15min":1.1659999999999999},"min":{"1min":0.82799999999999996,"5min":0.748,"15min":0.748},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.542},"last":1.423},{"interface":"front","average":{"1min":1.22,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.95399999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.401,"5min":1.637,"15min":2.048},"last":1.4399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335192,"kb_used_data":29712,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94036648,"statfs":{"total":96636764160,"available":96293527552,"internally_reserved":0,"allocated":30425088,"data_stored":30237520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.55200000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0629999999999999,"5min":1.302,"15min":1.4830000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.89200000000000002,"15min":0.92300000000000004},"min":{"1min":0.56499999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.5289999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86199999999999999,"15min":0.86799999999999999},"min":{"1min":0.52200000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.879,"15min":0.88900000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.49199999999999999},"max":{"1min":1.091,"5min":1.387,"15min":1.387},"last":1.1319999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94699999999999995,"15min":0.96499999999999997},"min":{"1min":0.59299999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.4159999999999999},"last":1.054},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.75600000000000001,"5min":0.63900000000000001,"15min":0.53700000000000003},"max":{"1min":1.3049999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.1899999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.94899999999999995,"15min":0.97099999999999997},"min":{"1min":0.66300000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3759999999999999,"5min":1.3839999999999999,"15min":1.3859999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97299999999999998,"15min":0.999},"min":{"1min":0.61899999999999999,"5min":0.57399999999999995,"15min":0.56200000000000006},"max":{"1min":1.351,"5min":1.625,"15min":1.625},"last":1.083}]},{"osd":5,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92000000000000004,"15min":0.95399999999999996},"min":{"1min":0.53400000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.216},{"interface":"front","average":{"1min":1.109,"5min":1.0309999999999999,"15min":1.075},"min":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4610000000000001,"5min":1.526,"15min":1.526},"last":1.163}]},{"osd":6,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.018,"15min":1.0549999999999999},"min":{"1min":0.71399999999999997,"5min":0.629,"15min":0.61299999999999999},"max":{"1min":1.3839999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.046,"15min":1.083},"min":{"1min":0.71399999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0109999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.1160000000000001,"15min":1.1699999999999999},"min":{"1min":0.82099999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4970000000000001,"5min":1.5629999999999999,"15min":1.7629999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.208,"5min":1.1619999999999999,"15min":1.2050000000000001},"min":{"1min":0.84599999999999997,"5min":0.753,"15min":0.56299999999999994},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.93700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574979,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333692,"kb_used_data":28212,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94038148,"statfs":{"total":96636764160,"available":96295063552,"internally_reserved":0,"allocated":28889088,"data_stored":28711580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1899999999999999,"5min":1.27,"15min":1.464},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.746,"15min":0.72299999999999998},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.252,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.66300000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.71599999999999997,"15min":0.95299999999999996},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.96299999999999997,"5min":1.3049999999999999,"15min":10.970000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.143,"5min":1.694,"15min":1.694},"last":0.81299999999999994}]},{"osd":2,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81100000000000005,"15min":0.85899999999999999},"min":{"1min":0.48599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.999,"5min":1.2110000000000001,"15min":1.6419999999999999},"last":0.745},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.89000000000000001,"15min":0.92400000000000004},"min":{"1min":0.52100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.212,"5min":1.323,"15min":1.333},"last":0.95199999999999996}]},{"osd":4,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.96699999999999997,"15min":1.01},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4099999999999999,"5min":1.855,"15min":1.855},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0760000000000001,"15min":1.1379999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.421,"5min":1.421,"15min":2.3570000000000002},"last":0.997}]},{"osd":5,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0349999999999999,"15min":1.1080000000000001},"min":{"1min":0.76300000000000001,"5min":0.621,"15min":0.61099999999999999},"max":{"1min":1.357,"5min":1.518,"15min":2.218},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.109,"15min":1.2609999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.4850000000000001,"5min":1.5649999999999999,"15min":5.585},"last":1.2410000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":1.071,"15min":1.2050000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4510000000000001,"5min":1.9490000000000001,"15min":5.0860000000000003},"last":1.181},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.163,"15min":1.218},"min":{"1min":0.81599999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.468,"5min":1.6679999999999999,"15min":2.3069999999999999},"last":1.1040000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.196,"15min":1.3300000000000001},"min":{"1min":0.81100000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4299999999999999,"5min":1.8500000000000001,"15min":5.6239999999999997},"last":1.131},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.157,"15min":1.262},"min":{"1min":0.69899999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.353,"5min":2.0950000000000002,"15min":5.1310000000000002},"last":1.2829999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574980,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318040,"kb_used_data":8464,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94053800,"statfs":{"total":96636764160,"available":96311091200,"internally_reserved":0,"allocated":8667136,"data_stored":8495276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64700000000000002,"15min":0.69899999999999995},"min":{"1min":0.33300000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.99099999999999999,"5min":1.038,"15min":1.4019999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.70599999999999996,"15min":0.749},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82099999999999995,"5min":1.323,"15min":1.8799999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.52000000000000002,"5min":0.375,"15min":0.33300000000000002},"max":{"1min":1.0920000000000001,"5min":1.224,"15min":1.224},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84299999999999997,"15min":0.83999999999999997},"min":{"1min":0.37,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1180000000000001,"5min":1.252,"15min":1.341},"last":0.92600000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85199999999999998,"15min":0.86599999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.145,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.91200000000000003,"15min":0.96999999999999997},"min":{"1min":0.57899999999999996,"5min":0.46999999999999997,"15min":0.46000000000000002},"max":{"1min":1.2130000000000001,"5min":1.329,"15min":1.587},"last":1.1200000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.96899999999999997,"15min":1.0229999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6779999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.077,"15min":1.105},"min":{"1min":0.82799999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.611,"5min":1.6419999999999999,"15min":1.9350000000000001},"last":0.875}]},{"osd":5,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.119,"15min":1.1439999999999999},"min":{"1min":0.75900000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.335},{"interface":"front","average":{"1min":1.036,"5min":1.0700000000000001,"15min":1.111},"min":{"1min":0.63,"5min":0.63,"15min":0.60499999999999998},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":2.048},"last":1.288}]},{"osd":6,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.149,"15min":1.1950000000000001},"min":{"1min":0.81399999999999995,"5min":0.70499999999999996,"15min":0.68600000000000005},"max":{"1min":1.548,"5min":1.6379999999999999,"15min":2.7040000000000002},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.198,"15min":1.2410000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.677,"5min":1.677,"15min":2.2000000000000002},"last":1.248}]},{"osd":7,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.1399999999999999,"15min":1.2150000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":2.286},"last":1.179},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2350000000000001,"15min":1.29},"min":{"1min":1.008,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4770000000000001,"5min":1.669,"15min":2.3940000000000001},"last":1.202}]}]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313944,"kb_used_data":16656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057896,"statfs":{"total":96636764160,"available":96315285504,"internally_reserved":0,"allocated":17055744,"data_stored":16883884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.69199999999999995,"15min":0.68300000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.23599999999999999},"max":{"1min":0.873,"5min":1.179,"15min":1.179},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79900000000000004,"15min":0.79600000000000004},"min":{"1min":0.434,"5min":0.42299999999999999,"15min":0.39300000000000002},"max":{"1min":0.99399999999999999,"5min":1.218,"15min":1.3089999999999999},"last":0.95799999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69699999999999995,"15min":0.70099999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.264,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.83499999999999996,"15min":0.85799999999999998},"min":{"1min":0.54600000000000004,"5min":0.42299999999999999,"15min":0.36599999999999999},"max":{"1min":1.222,"5min":1.3109999999999999,"15min":1.3169999999999999},"last":1.1160000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91900000000000004,"15min":0.88300000000000001},"min":{"1min":0.63100000000000001,"5min":0.5,"15min":0.42299999999999999},"max":{"1min":1.226,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.54000000000000004,"5min":0.503,"15min":0.49199999999999999},"max":{"1min":1.119,"5min":1.2270000000000001,"15min":1.337},"last":1.1579999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.95299999999999996,"15min":0.97699999999999998},"min":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.51300000000000001},"max":{"1min":1.3540000000000001,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.085},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.129,"15min":1.1040000000000001},"min":{"1min":0.68600000000000005,"5min":0.65800000000000003,"15min":0.437},"max":{"1min":1.4299999999999999,"5min":1.556,"15min":1.6060000000000001},"last":1.236}]},{"osd":5,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0680000000000001,"15min":1.0760000000000001},"min":{"1min":0.76300000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4239999999999999,"5min":1.587,"15min":1.587},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.081,"15min":1.075},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.61199999999999999},"max":{"1min":1.496,"5min":1.911,"15min":1.911},"last":1.3600000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.155,"15min":1.1519999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.70499999999999996},"max":{"1min":1.591,"5min":2.081,"15min":2.081},"last":1.331},{"interface":"front","average":{"1min":1.159,"5min":1.1359999999999999,"15min":1.163},"min":{"1min":0.79000000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4950000000000001,"5min":1.996,"15min":1.996},"last":1.452}]},{"osd":7,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.206,"15min":1.1990000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.498},"max":{"1min":1.472,"5min":1.6879999999999999,"15min":1.8999999999999999},"last":1.3},{"interface":"front","average":{"1min":1.181,"5min":1.2090000000000001,"15min":1.2230000000000001},"min":{"1min":0.82499999999999996,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.5009999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.4259999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574980,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322736,"kb_used_data":21352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94049104,"statfs":{"total":96636764160,"available":96306282496,"internally_reserved":0,"allocated":21864448,"data_stored":21683828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.68500000000000005,"15min":0.66900000000000004},"min":{"1min":0.38200000000000001,"5min":0.30199999999999999,"15min":0.26900000000000002},"max":{"1min":0.72799999999999998,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.755,"15min":0.747},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.34899999999999998},"max":{"1min":1.0429999999999999,"5min":1.2290000000000001,"15min":1.2849999999999999},"last":0.84599999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.504,"5min":0.40600000000000003,"15min":0.33900000000000002},"max":{"1min":1.04,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.69599999999999995,"15min":0.71099999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.871,"5min":1.0720000000000001,"15min":1.2669999999999999},"last":0.66200000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83199999999999996,"15min":0.81200000000000006},"min":{"1min":0.59399999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0940000000000001,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.89200000000000002,"15min":0.92000000000000004},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.34599999999999997},"max":{"1min":1.159,"5min":1.3580000000000001,"15min":1.599},"last":0.99399999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.92100000000000004,"15min":0.94799999999999995},"min":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.179,"5min":1.5129999999999999,"15min":1.52},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.091,"15min":1.0960000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.248,"5min":1.859,"15min":1.859},"last":0.88400000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.1100000000000001,"15min":1.1299999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3779999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.151,"15min":1.153},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.411,"5min":1.573,"15min":1.573},"last":1.2330000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.155,"15min":1.165},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.466,"5min":1.6359999999999999,"15min":1.7050000000000001},"last":1.135},{"interface":"front","average":{"1min":1.014,"5min":1.0880000000000001,"15min":1.105},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3759999999999999,"5min":1.579,"15min":2.1579999999999999},"last":1.1160000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1479999999999999,"15min":1.1539999999999999},"min":{"1min":0.78500000000000003,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.4359999999999999,"5min":1.7090000000000001,"15min":2.2480000000000002},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.2190000000000001,"15min":1.2370000000000001},"min":{"1min":0.64700000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.329,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.0920000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20992000,"data_stored":20986792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28610560,"data_stored":28604912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30146560,"data_stored":30130852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16801792,"data_stored":16778076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:10:22.984 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.984 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.984 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.984 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.984 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.984 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.985 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.985 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.985 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.985 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.985 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.985 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.985 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.986 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.986 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.986 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.986 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.986 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.986 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.986 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.987 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.987 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.987 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.987 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.987 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.987 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.987 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.987 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.988 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.988 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.988 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.988 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.988 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.989 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.989 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.989 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.989 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.989 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.990 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.990 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.990 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.990 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.990 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.990 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.991 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.991 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.991 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.991 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.991 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.991 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.991 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.992 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.992 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.992 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.992 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.992 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.992 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.993 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.993 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.993 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.993 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.993 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.993 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-06T02:59:52.245051+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=52, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:22.993 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T03:10:42.994 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:10:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.108+0000 7f11d7fff700 1 Processor -- start 2023-10-06T03:10:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d7fff700 1 -- start start 2023-10-06T03:10:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d7fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f11d806d3d0 0x7f11d81450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d7fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11d806b900 0x7f11d81455e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d7fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d814bf90 con 0x7f11d80bbcd0 2023-10-06T03:10:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d7fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d80b4900 con 0x7f11d806d3d0 2023-10-06T03:10:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d7fff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d814c270 con 0x7f11d806b900 2023-10-06T03:10:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11ce7fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11d806b900 0x7f11d81455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11ce7fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11d806b900 0x7f11d81455e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.27:58178/0 (socket says 172.21.15.27:58178) 2023-10-06T03:10:43.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11ce7fc700 1 -- 172.21.15.27:0/494317944 learned_addr learned my addr 172.21.15.27:0/494317944 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:43.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d6ffd700 1 --2- 172.21.15.27:0/494317944 >> v2:172.21.15.123:3300/0 conn(0x7f11d806d3d0 0x7f11d81450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:43.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d67fc700 1 -- 172.21.15.27:0/494317944 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544415245 0 0) 0x7f11d814bf90 con 0x7f11d80bbcd0 2023-10-06T03:10:43.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d67fc700 1 -- 172.21.15.27:0/494317944 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11c4003570 con 0x7f11d80bbcd0 2023-10-06T03:10:43.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11ce7fc700 1 -- 172.21.15.27:0/494317944 >> v2:172.21.15.123:3300/0 conn(0x7f11d806d3d0 msgr2=0x7f11d81450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:10:43.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11ce7fc700 1 --2- 172.21.15.27:0/494317944 >> v2:172.21.15.123:3300/0 conn(0x7f11d806d3d0 0x7f11d81450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:43.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11ce7fc700 1 -- 172.21.15.27:0/494317944 >> v1:172.21.15.123:6789/0 conn(0x7f11d80bbcd0 legacy=0x7f11d814eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:43.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11ce7fc700 1 -- 172.21.15.27:0/494317944 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d8069970 con 0x7f11d806b900 2023-10-06T03:10:43.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d6ffd700 1 --2- 172.21.15.27:0/494317944 >> v2:172.21.15.123:3300/0 conn(0x7f11d806d3d0 0x7f11d81450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:10:43.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11ce7fc700 1 --2- 172.21.15.27:0/494317944 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11d806b900 0x7f11d81455e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f11c00099b0 tx=0x7f11c0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d606905739c5ebd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:43.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d67fc700 1 -- 172.21.15.27:0/494317944 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c000b680 con 0x7f11d806b900 2023-10-06T03:10:43.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d67fc700 1 -- 172.21.15.27:0/494317944 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c000b7e0 con 0x7f11d806b900 2023-10-06T03:10:43.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d67fc700 1 -- 172.21.15.27:0/494317944 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c000bb60 con 0x7f11d806b900 2023-10-06T03:10:43.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d7fff700 1 -- 172.21.15.27:0/494317944 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11d806b900 msgr2=0x7f11d81455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:43.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.112+0000 7f11d7fff700 1 --2- 172.21.15.27:0/494317944 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11d806b900 0x7f11d81455e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f11c00099b0 tx=0x7f11c0009250 comp rx=0 tx=0).stop 2023-10-06T03:10:43.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.116+0000 7f11d7fff700 1 -- 172.21.15.27:0/494317944 shutdown_connections 2023-10-06T03:10:43.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.116+0000 7f11d7fff700 1 --2- 172.21.15.27:0/494317944 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11d806b900 0x7f11d81455e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:43.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.116+0000 7f11d7fff700 1 --2- 172.21.15.27:0/494317944 >> v2:172.21.15.123:3300/0 conn(0x7f11d806d3d0 0x7f11d81450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:43.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.116+0000 7f11d7fff700 1 -- 172.21.15.27:0/494317944 >> 172.21.15.27:0/494317944 conn(0x7f11d80bae20 msgr2=0x7f11d80bb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:43.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.116+0000 7f11d7fff700 1 -- 172.21.15.27:0/494317944 shutdown_connections 2023-10-06T03:10:43.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.116+0000 7f11d7fff700 1 -- 172.21.15.27:0/494317944 wait complete. 2023-10-06T03:10:43.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.116+0000 7f11d7fff700 1 Processor -- start 2023-10-06T03:10:43.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.116+0000 7f11d7fff700 1 -- start start 2023-10-06T03:10:43.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11d806b900 0x7f11d815bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:43.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d806d3d0 0x7f11d80bd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:43.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d7fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11d80bbcd0 0x7f11d8140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:43.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d7fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d813e730 con 0x7f11d806b900 2023-10-06T03:10:43.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d7fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d815c280 con 0x7f11d806d3d0 2023-10-06T03:10:43.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d7fff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d815b8b0 con 0x7f11d80bbcd0 2023-10-06T03:10:43.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11d806b900 0x7f11d815bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:43.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11d806b900 0x7f11d815bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59694/0 (socket says 172.21.15.27:59694) 2023-10-06T03:10:43.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d6ffd700 1 -- 172.21.15.27:0/2802013514 learned_addr learned my addr 172.21.15.27:0/2802013514 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:10:43.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11ce7fc700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d806d3d0 0x7f11d80bd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:43.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d77fe700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11d80bbcd0 0x7f11d8140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:43.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d6ffd700 1 -- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11d80bbcd0 msgr2=0x7f11d8140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:43.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d6ffd700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11d80bbcd0 0x7f11d8140670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:43.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d6ffd700 1 -- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d806d3d0 msgr2=0x7f11d80bd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:43.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d6ffd700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d806d3d0 0x7f11d80bd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:43.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d6ffd700 1 -- 172.21.15.27:0/2802013514 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c8009420 con 0x7f11d806b900 2023-10-06T03:10:43.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d6ffd700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11d806b900 0x7f11d815bd40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f11c800ec80 tx=0x7f11c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:43.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11cf7fe700 1 -- 172.21.15.27:0/2802013514 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c800c920 con 0x7f11d806b900 2023-10-06T03:10:43.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11cf7fe700 1 -- 172.21.15.27:0/2802013514 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c800ca80 con 0x7f11d806b900 2023-10-06T03:10:43.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d7fff700 1 -- 172.21.15.27:0/2802013514 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c00094f0 con 0x7f11d806b900 2023-10-06T03:10:43.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11cf7fe700 1 -- 172.21.15.27:0/2802013514 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c800ce00 con 0x7f11d806b900 2023-10-06T03:10:43.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.120+0000 7f11d7fff700 1 -- 172.21.15.27:0/2802013514 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d815b540 con 0x7f11d806b900 2023-10-06T03:10:43.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.124+0000 7f11d7fff700 1 -- 172.21.15.27:0/2802013514 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d80700e0 con 0x7f11d806b900 2023-10-06T03:10:43.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.124+0000 7f11cf7fe700 1 -- 172.21.15.27:0/2802013514 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f11c8013680 con 0x7f11d806b900 2023-10-06T03:10:43.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.124+0000 7f11cf7fe700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f11b8060580 0x7f11b8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:10:43.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.124+0000 7f11cf7fe700 1 -- 172.21.15.27:0/2802013514 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f11c807cd30 con 0x7f11d806b900 2023-10-06T03:10:43.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.124+0000 7f11ce7fc700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f11b8060580 0x7f11b8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:10:43.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.124+0000 7f11ce7fc700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f11b8060580 0x7f11b8062a30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f11c00099b0 tx=0x7f11c0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:10:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.128+0000 7f11cf7fe700 1 -- 172.21.15.27:0/2802013514 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f11c804d180 con 0x7f11d806b900 2023-10-06T03:10:43.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.292+0000 7f11d7fff700 1 -- 172.21.15.27:0/2802013514 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11d815b1b0 con 0x7f11b8060580 2023-10-06T03:10:43.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.312+0000 7f11cf7fe700 1 -- 172.21.15.27:0/2802013514 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311099 (secure 0 0 0) 0x7f11d815b1b0 con 0x7f11b8060580 2023-10-06T03:10:43.319 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:10:43.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.316+0000 7f11d7fff700 1 -- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f11b8060580 msgr2=0x7f11b8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:43.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.316+0000 7f11d7fff700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f11b8060580 0x7f11b8062a30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f11c00099b0 tx=0x7f11c0017000 comp rx=0 tx=0).stop 2023-10-06T03:10:43.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.316+0000 7f11d7fff700 1 -- 172.21.15.27:0/2802013514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11d806b900 msgr2=0x7f11d815bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:10:43.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.316+0000 7f11d7fff700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11d806b900 0x7f11d815bd40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f11c800ec80 tx=0x7f11c80091a0 comp rx=0 tx=0).stop 2023-10-06T03:10:43.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.316+0000 7f11d7fff700 1 -- 172.21.15.27:0/2802013514 shutdown_connections 2023-10-06T03:10:43.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.316+0000 7f11d7fff700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f11b8060580 0x7f11b8062a30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:43.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.316+0000 7f11d7fff700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f11d80bbcd0 0x7f11d8140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:43.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.316+0000 7f11d7fff700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d806d3d0 0x7f11d80bd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:43.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.316+0000 7f11d7fff700 1 --2- 172.21.15.27:0/2802013514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11d806b900 0x7f11d815bd40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:10:43.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.316+0000 7f11d7fff700 1 -- 172.21.15.27:0/2802013514 >> 172.21.15.27:0/2802013514 conn(0x7f11d80bae20 msgr2=0x7f11d81451f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:10:43.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.316+0000 7f11d7fff700 1 -- 172.21.15.27:0/2802013514 shutdown_connections 2023-10-06T03:10:43.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:10:43.316+0000 7f11d7fff700 1 -- 172.21.15.27:0/2802013514 wait complete. 2023-10-06T03:10:43.323 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-10-06T03:10:43.331 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2023-10-06T03:10:43.201247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76103972,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":599,"num_read_kb":1179,"num_write":11705,"num_write_kb":82701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20626,"ondisk_log_size":20626,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2574240,"kb_used_data":150880,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752400480,"statfs":{"total":773094113280,"available":770458091520,"internally_reserved":0,"allocated":154501120,"data_stored":153061288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004504"},"pg_stats":[{"pgid":"4.3f","version":"26'91","reported_seq":113,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:07.709957+0000","last_change":"2023-10-06T03:10:07.709876+0000","last_active":"2023-10-06T03:10:07.709957+0000","last_peered":"2023-10-06T03:10:07.709957+0000","last_clean":"2023-10-06T03:10:07.709957+0000","last_became_active":"2023-10-06T02:59:53.681495+0000","last_became_peered":"2023-10-06T02:59:53.681495+0000","last_unstale":"2023-10-06T03:10:07.709957+0000","last_undegraded":"2023-10-06T03:10:07.709957+0000","last_fullsized":"2023-10-06T03:10:07.709957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'91","last_scrub_stamp":"2023-10-06T03:10:07.709583+0000","last_deep_scrub":"26'91","last_deep_scrub_stamp":"2023-10-06T03:10:07.709583+0000","last_clean_scrub_stamp":"2023-10-06T03:10:07.709583+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:21.963561+0000","scrub_duration":0.0038659110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"26'80","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195794+0000","last_change":"2023-10-06T02:59:53.682170+0000","last_active":"2023-10-06T03:09:49.195794+0000","last_peered":"2023-10-06T03:09:49.195794+0000","last_clean":"2023-10-06T03:09:49.195794+0000","last_became_active":"2023-10-06T02:59:53.681849+0000","last_became_peered":"2023-10-06T02:59:53.681849+0000","last_unstale":"2023-10-06T03:09:49.195794+0000","last_undegraded":"2023-10-06T03:09:49.195794+0000","last_fullsized":"2023-10-06T03:09:49.195794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"26'65","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.197418+0000","last_change":"2023-10-06T02:59:53.679536+0000","last_active":"2023-10-06T03:09:49.197418+0000","last_peered":"2023-10-06T03:09:49.197418+0000","last_clean":"2023-10-06T03:09:49.197418+0000","last_became_active":"2023-10-06T02:59:53.678264+0000","last_became_peered":"2023-10-06T02:59:53.678264+0000","last_unstale":"2023-10-06T03:09:49.197418+0000","last_undegraded":"2023-10-06T03:09:49.197418+0000","last_fullsized":"2023-10-06T03:09:49.197418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"26'76","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:05.009567+0000","last_change":"2023-10-06T03:10:05.009488+0000","last_active":"2023-10-06T03:10:05.009567+0000","last_peered":"2023-10-06T03:10:05.009567+0000","last_clean":"2023-10-06T03:10:05.009567+0000","last_became_active":"2023-10-06T02:59:53.671555+0000","last_became_peered":"2023-10-06T02:59:53.671555+0000","last_unstale":"2023-10-06T03:10:05.009567+0000","last_undegraded":"2023-10-06T03:10:05.009567+0000","last_fullsized":"2023-10-06T03:10:05.009567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'76","last_scrub_stamp":"2023-10-06T03:10:05.009230+0000","last_deep_scrub":"26'76","last_deep_scrub_stamp":"2023-10-06T03:10:05.009230+0000","last_clean_scrub_stamp":"2023-10-06T03:10:05.009230+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:16.812988+0000","scrub_duration":0.0043911949999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"26'85","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205840+0000","last_change":"2023-10-06T02:59:53.682691+0000","last_active":"2023-10-06T03:09:49.205840+0000","last_peered":"2023-10-06T03:09:49.205840+0000","last_clean":"2023-10-06T03:09:49.205840+0000","last_became_active":"2023-10-06T02:59:53.682399+0000","last_became_peered":"2023-10-06T02:59:53.682399+0000","last_unstale":"2023-10-06T03:09:49.205840+0000","last_undegraded":"2023-10-06T03:09:49.205840+0000","last_fullsized":"2023-10-06T03:09:49.205840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"26'80","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.197433+0000","last_change":"2023-10-06T02:59:53.678208+0000","last_active":"2023-10-06T03:09:49.197433+0000","last_peered":"2023-10-06T03:09:49.197433+0000","last_clean":"2023-10-06T03:09:49.197433+0000","last_became_active":"2023-10-06T02:59:53.676481+0000","last_became_peered":"2023-10-06T02:59:53.676481+0000","last_unstale":"2023-10-06T03:09:49.197433+0000","last_undegraded":"2023-10-06T03:09:49.197433+0000","last_fullsized":"2023-10-06T03:09:49.197433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"26'93","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.195034+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T03:09:49.195034+0000","last_peered":"2023-10-06T03:09:49.195034+0000","last_clean":"2023-10-06T03:09:49.195034+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:09:49.195034+0000","last_undegraded":"2023-10-06T03:09:49.195034+0000","last_fullsized":"2023-10-06T03:09:49.195034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"26'77","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.196114+0000","last_change":"2023-10-06T02:59:53.683816+0000","last_active":"2023-10-06T03:09:49.196114+0000","last_peered":"2023-10-06T03:09:49.196114+0000","last_clean":"2023-10-06T03:09:49.196114+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:09:49.196114+0000","last_undegraded":"2023-10-06T03:09:49.196114+0000","last_fullsized":"2023-10-06T03:09:49.196114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"26'89","reported_seq":111,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:41.033923+0000","last_change":"2023-10-06T03:10:41.033789+0000","last_active":"2023-10-06T03:10:41.033923+0000","last_peered":"2023-10-06T03:10:41.033923+0000","last_clean":"2023-10-06T03:10:41.033923+0000","last_became_active":"2023-10-06T02:59:53.680086+0000","last_became_peered":"2023-10-06T02:59:53.680086+0000","last_unstale":"2023-10-06T03:10:41.033923+0000","last_undegraded":"2023-10-06T03:10:41.033923+0000","last_fullsized":"2023-10-06T03:10:41.033923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'89","last_scrub_stamp":"2023-10-06T03:10:41.033478+0000","last_deep_scrub":"26'89","last_deep_scrub_stamp":"2023-10-06T03:10:41.033478+0000","last_clean_scrub_stamp":"2023-10-06T03:10:41.033478+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:46.314040+0000","scrub_duration":0.0042084009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"26'73","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:38.588274+0000","last_change":"2023-10-06T03:10:38.588170+0000","last_active":"2023-10-06T03:10:38.588274+0000","last_peered":"2023-10-06T03:10:38.588274+0000","last_clean":"2023-10-06T03:10:38.588274+0000","last_became_active":"2023-10-06T02:59:53.675243+0000","last_became_peered":"2023-10-06T02:59:53.675243+0000","last_unstale":"2023-10-06T03:10:38.588274+0000","last_undegraded":"2023-10-06T03:10:38.588274+0000","last_fullsized":"2023-10-06T03:10:38.588274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'73","last_scrub_stamp":"2023-10-06T03:10:38.587913+0000","last_deep_scrub":"26'73","last_deep_scrub_stamp":"2023-10-06T03:10:38.587913+0000","last_clean_scrub_stamp":"2023-10-06T03:10:38.587913+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:24.915221+0000","scrub_duration":0.0046023369999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"26'79","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.198875+0000","last_change":"2023-10-06T02:59:53.679489+0000","last_active":"2023-10-06T03:09:49.198875+0000","last_peered":"2023-10-06T03:09:49.198875+0000","last_clean":"2023-10-06T03:09:49.198875+0000","last_became_active":"2023-10-06T02:59:53.678985+0000","last_became_peered":"2023-10-06T02:59:53.678985+0000","last_unstale":"2023-10-06T03:09:49.198875+0000","last_undegraded":"2023-10-06T03:09:49.198875+0000","last_fullsized":"2023-10-06T03:09:49.198875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"26'79","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:08.683966+0000","last_change":"2023-10-06T03:10:08.683851+0000","last_active":"2023-10-06T03:10:08.683966+0000","last_peered":"2023-10-06T03:10:08.683966+0000","last_clean":"2023-10-06T03:10:08.683966+0000","last_became_active":"2023-10-06T02:59:53.682464+0000","last_became_peered":"2023-10-06T02:59:53.682464+0000","last_unstale":"2023-10-06T03:10:08.683966+0000","last_undegraded":"2023-10-06T03:10:08.683966+0000","last_fullsized":"2023-10-06T03:10:08.683966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2023-10-06T03:10:08.683416+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2023-10-06T03:10:08.683416+0000","last_clean_scrub_stamp":"2023-10-06T03:10:08.683416+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:47.380038+0000","scrub_duration":0.0046938989999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"26'84","reported_seq":115,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:06.733722+0000","last_change":"2023-10-06T03:10:06.733648+0000","last_active":"2023-10-06T03:10:06.733722+0000","last_peered":"2023-10-06T03:10:06.733722+0000","last_clean":"2023-10-06T03:10:06.733722+0000","last_became_active":"2023-10-06T03:00:34.741173+0000","last_became_peered":"2023-10-06T03:00:34.741173+0000","last_unstale":"2023-10-06T03:10:06.733722+0000","last_undegraded":"2023-10-06T03:10:06.733722+0000","last_fullsized":"2023-10-06T03:10:06.733722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'84","last_scrub_stamp":"2023-10-06T03:10:06.733358+0000","last_deep_scrub":"26'84","last_deep_scrub_stamp":"2023-10-06T03:10:06.733358+0000","last_clean_scrub_stamp":"2023-10-06T03:10:06.733358+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:54.642666+0000","scrub_duration":0.0043106860000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"26'74","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:35.510642+0000","last_change":"2023-10-06T03:10:35.510575+0000","last_active":"2023-10-06T03:10:35.510642+0000","last_peered":"2023-10-06T03:10:35.510642+0000","last_clean":"2023-10-06T03:10:35.510642+0000","last_became_active":"2023-10-06T02:59:53.672957+0000","last_became_peered":"2023-10-06T02:59:53.672957+0000","last_unstale":"2023-10-06T03:10:35.510642+0000","last_undegraded":"2023-10-06T03:10:35.510642+0000","last_fullsized":"2023-10-06T03:10:35.510642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'74","last_scrub_stamp":"2023-10-06T03:10:35.510297+0000","last_deep_scrub":"26'74","last_deep_scrub_stamp":"2023-10-06T03:10:35.510297+0000","last_clean_scrub_stamp":"2023-10-06T03:10:35.510297+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:34.568658+0000","scrub_duration":0.0045798820000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"26'78","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:36.284084+0000","last_change":"2023-10-06T03:10:36.283994+0000","last_active":"2023-10-06T03:10:36.284084+0000","last_peered":"2023-10-06T03:10:36.284084+0000","last_clean":"2023-10-06T03:10:36.284084+0000","last_became_active":"2023-10-06T02:59:53.686352+0000","last_became_peered":"2023-10-06T02:59:53.686352+0000","last_unstale":"2023-10-06T03:10:36.284084+0000","last_undegraded":"2023-10-06T03:10:36.284084+0000","last_fullsized":"2023-10-06T03:10:36.284084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'78","last_scrub_stamp":"2023-10-06T03:10:36.283722+0000","last_deep_scrub":"26'78","last_deep_scrub_stamp":"2023-10-06T03:10:36.283722+0000","last_clean_scrub_stamp":"2023-10-06T03:10:36.283722+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:35.342083+0000","scrub_duration":0.0042887849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"26'88","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.197488+0000","last_change":"2023-10-06T02:59:53.680975+0000","last_active":"2023-10-06T03:09:49.197488+0000","last_peered":"2023-10-06T03:09:49.197488+0000","last_clean":"2023-10-06T03:09:49.197488+0000","last_became_active":"2023-10-06T02:59:53.678449+0000","last_became_peered":"2023-10-06T02:59:53.678449+0000","last_unstale":"2023-10-06T03:09:49.197488+0000","last_undegraded":"2023-10-06T03:09:49.197488+0000","last_fullsized":"2023-10-06T03:09:49.197488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"26'80","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:32.112002+0000","last_change":"2023-10-06T03:10:32.111930+0000","last_active":"2023-10-06T03:10:32.112002+0000","last_peered":"2023-10-06T03:10:32.112002+0000","last_clean":"2023-10-06T03:10:32.112002+0000","last_became_active":"2023-10-06T02:59:53.680028+0000","last_became_peered":"2023-10-06T02:59:53.680028+0000","last_unstale":"2023-10-06T03:10:32.112002+0000","last_undegraded":"2023-10-06T03:10:32.112002+0000","last_fullsized":"2023-10-06T03:10:32.112002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'80","last_scrub_stamp":"2023-10-06T03:10:32.111623+0000","last_deep_scrub":"26'80","last_deep_scrub_stamp":"2023-10-06T03:10:32.111623+0000","last_clean_scrub_stamp":"2023-10-06T03:10:32.111623+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:31.169984+0000","scrub_duration":0.0044276089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"26'76","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192798+0000","last_change":"2023-10-06T02:59:53.678143+0000","last_active":"2023-10-06T03:09:49.192798+0000","last_peered":"2023-10-06T03:09:49.192798+0000","last_clean":"2023-10-06T03:09:49.192798+0000","last_became_active":"2023-10-06T02:59:53.676602+0000","last_became_peered":"2023-10-06T02:59:53.676602+0000","last_unstale":"2023-10-06T03:09:49.192798+0000","last_undegraded":"2023-10-06T03:09:49.192798+0000","last_fullsized":"2023-10-06T03:09:49.192798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"26'75","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:02.765983+0000","last_change":"2023-10-06T03:10:02.765921+0000","last_active":"2023-10-06T03:10:02.765983+0000","last_peered":"2023-10-06T03:10:02.765983+0000","last_clean":"2023-10-06T03:10:02.765983+0000","last_became_active":"2023-10-06T02:59:53.675657+0000","last_became_peered":"2023-10-06T02:59:53.675657+0000","last_unstale":"2023-10-06T03:10:02.765983+0000","last_undegraded":"2023-10-06T03:10:02.765983+0000","last_fullsized":"2023-10-06T03:10:02.765983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'75","last_scrub_stamp":"2023-10-06T03:10:02.765676+0000","last_deep_scrub":"26'75","last_deep_scrub_stamp":"2023-10-06T03:10:02.765676+0000","last_clean_scrub_stamp":"2023-10-06T03:10:02.765676+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.141625+0000","scrub_duration":0.004252451,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"26'82","reported_seq":94,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191755+0000","last_change":"2023-10-06T02:59:53.673043+0000","last_active":"2023-10-06T03:09:49.191755+0000","last_peered":"2023-10-06T03:09:49.191755+0000","last_clean":"2023-10-06T03:09:49.191755+0000","last_became_active":"2023-10-06T02:59:53.672690+0000","last_became_peered":"2023-10-06T02:59:53.672690+0000","last_unstale":"2023-10-06T03:09:49.191755+0000","last_undegraded":"2023-10-06T03:09:49.191755+0000","last_fullsized":"2023-10-06T03:09:49.191755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"26'83","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.194854+0000","last_change":"2023-10-06T02:59:53.684492+0000","last_active":"2023-10-06T03:09:49.194854+0000","last_peered":"2023-10-06T03:09:49.194854+0000","last_clean":"2023-10-06T03:09:49.194854+0000","last_became_active":"2023-10-06T02:59:53.684145+0000","last_became_peered":"2023-10-06T02:59:53.684145+0000","last_unstale":"2023-10-06T03:09:49.194854+0000","last_undegraded":"2023-10-06T03:09:49.194854+0000","last_fullsized":"2023-10-06T03:09:49.194854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"26'88","reported_seq":110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:23.116215+0000","last_change":"2023-10-06T03:10:23.116148+0000","last_active":"2023-10-06T03:10:23.116215+0000","last_peered":"2023-10-06T03:10:23.116215+0000","last_clean":"2023-10-06T03:10:23.116215+0000","last_became_active":"2023-10-06T02:59:53.682948+0000","last_became_peered":"2023-10-06T02:59:53.682948+0000","last_unstale":"2023-10-06T03:10:23.116215+0000","last_undegraded":"2023-10-06T03:10:23.116215+0000","last_fullsized":"2023-10-06T03:10:23.116215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'88","last_scrub_stamp":"2023-10-06T03:10:23.115868+0000","last_deep_scrub":"26'88","last_deep_scrub_stamp":"2023-10-06T03:10:23.115868+0000","last_clean_scrub_stamp":"2023-10-06T03:10:23.115868+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:51.237852+0000","scrub_duration":0.0041091720000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"26'69","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.206477+0000","last_change":"2023-10-06T02:59:53.675936+0000","last_active":"2023-10-06T03:09:49.206477+0000","last_peered":"2023-10-06T03:09:49.206477+0000","last_clean":"2023-10-06T03:09:49.206477+0000","last_became_active":"2023-10-06T02:59:53.675319+0000","last_became_peered":"2023-10-06T02:59:53.675319+0000","last_unstale":"2023-10-06T03:09:49.206477+0000","last_undegraded":"2023-10-06T03:09:49.206477+0000","last_fullsized":"2023-10-06T03:09:49.206477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"26'87","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:39.327345+0000","last_change":"2023-10-06T03:10:39.327243+0000","last_active":"2023-10-06T03:10:39.327345+0000","last_peered":"2023-10-06T03:10:39.327345+0000","last_clean":"2023-10-06T03:10:39.327345+0000","last_became_active":"2023-10-06T02:59:53.686007+0000","last_became_peered":"2023-10-06T02:59:53.686007+0000","last_unstale":"2023-10-06T03:10:39.327345+0000","last_undegraded":"2023-10-06T03:10:39.327345+0000","last_fullsized":"2023-10-06T03:10:39.327345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'87","last_scrub_stamp":"2023-10-06T03:10:39.326988+0000","last_deep_scrub":"26'87","last_deep_scrub_stamp":"2023-10-06T03:10:39.326988+0000","last_clean_scrub_stamp":"2023-10-06T03:10:39.326988+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:49.949628+0000","scrub_duration":0.004449967,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"26'91","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.200731+0000","last_change":"2023-10-06T02:59:53.682853+0000","last_active":"2023-10-06T03:09:49.200731+0000","last_peered":"2023-10-06T03:09:49.200731+0000","last_clean":"2023-10-06T03:09:49.200731+0000","last_became_active":"2023-10-06T02:59:53.682511+0000","last_became_peered":"2023-10-06T02:59:53.682511+0000","last_unstale":"2023-10-06T03:09:49.200731+0000","last_undegraded":"2023-10-06T03:09:49.200731+0000","last_fullsized":"2023-10-06T03:09:49.200731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"26'98","reported_seq":120,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:26.039280+0000","last_change":"2023-10-06T03:10:26.039202+0000","last_active":"2023-10-06T03:10:26.039280+0000","last_peered":"2023-10-06T03:10:26.039280+0000","last_clean":"2023-10-06T03:10:26.039280+0000","last_became_active":"2023-10-06T02:59:53.681732+0000","last_became_peered":"2023-10-06T02:59:53.681732+0000","last_unstale":"2023-10-06T03:10:26.039280+0000","last_undegraded":"2023-10-06T03:10:26.039280+0000","last_fullsized":"2023-10-06T03:10:26.039280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'98","last_scrub_stamp":"2023-10-06T03:10:26.038889+0000","last_deep_scrub":"26'98","last_deep_scrub_stamp":"2023-10-06T03:10:26.038889+0000","last_clean_scrub_stamp":"2023-10-06T03:10:26.038889+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:03.880462+0000","scrub_duration":0.004522608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"26'80","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.175327+0000","last_change":"2023-10-06T02:59:53.676598+0000","last_active":"2023-10-06T03:09:49.175327+0000","last_peered":"2023-10-06T03:09:49.175327+0000","last_clean":"2023-10-06T03:09:49.175327+0000","last_became_active":"2023-10-06T02:59:53.676284+0000","last_became_peered":"2023-10-06T02:59:53.676284+0000","last_unstale":"2023-10-06T03:09:49.175327+0000","last_undegraded":"2023-10-06T03:09:49.175327+0000","last_fullsized":"2023-10-06T03:09:49.175327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"26'61","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:29.093305+0000","last_change":"2023-10-06T03:10:29.093236+0000","last_active":"2023-10-06T03:10:29.093305+0000","last_peered":"2023-10-06T03:10:29.093305+0000","last_clean":"2023-10-06T03:10:29.093305+0000","last_became_active":"2023-10-06T02:59:53.686912+0000","last_became_peered":"2023-10-06T02:59:53.686912+0000","last_unstale":"2023-10-06T03:10:29.093305+0000","last_undegraded":"2023-10-06T03:10:29.093305+0000","last_fullsized":"2023-10-06T03:10:29.093305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'61","last_scrub_stamp":"2023-10-06T03:10:29.092966+0000","last_deep_scrub":"26'61","last_deep_scrub_stamp":"2023-10-06T03:10:29.092966+0000","last_clean_scrub_stamp":"2023-10-06T03:10:29.092966+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:54:32.830996+0000","scrub_duration":0.0041196959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"26'87","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203767+0000","last_change":"2023-10-06T02:59:53.685421+0000","last_active":"2023-10-06T03:09:49.203767+0000","last_peered":"2023-10-06T03:09:49.203767+0000","last_clean":"2023-10-06T03:09:49.203767+0000","last_became_active":"2023-10-06T02:59:53.684806+0000","last_became_peered":"2023-10-06T02:59:53.684806+0000","last_unstale":"2023-10-06T03:09:49.203767+0000","last_undegraded":"2023-10-06T03:09:49.203767+0000","last_fullsized":"2023-10-06T03:09:49.203767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"26'82","reported_seq":94,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.191802+0000","last_change":"2023-10-06T02:59:53.676085+0000","last_active":"2023-10-06T03:09:49.191802+0000","last_peered":"2023-10-06T03:09:49.191802+0000","last_clean":"2023-10-06T03:09:49.191802+0000","last_became_active":"2023-10-06T02:59:53.675718+0000","last_became_peered":"2023-10-06T02:59:53.675718+0000","last_unstale":"2023-10-06T03:09:49.191802+0000","last_undegraded":"2023-10-06T03:09:49.191802+0000","last_fullsized":"2023-10-06T03:09:49.191802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"26'92","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:37.165833+0000","last_change":"2023-10-06T03:10:37.165767+0000","last_active":"2023-10-06T03:10:37.165833+0000","last_peered":"2023-10-06T03:10:37.165833+0000","last_clean":"2023-10-06T03:10:37.165833+0000","last_became_active":"2023-10-06T02:59:53.675682+0000","last_became_peered":"2023-10-06T02:59:53.675682+0000","last_unstale":"2023-10-06T03:10:37.165833+0000","last_undegraded":"2023-10-06T03:10:37.165833+0000","last_fullsized":"2023-10-06T03:10:37.165833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2023-10-06T03:10:37.165477+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2023-10-06T03:10:37.165477+0000","last_clean_scrub_stamp":"2023-10-06T03:10:37.165477+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:47.788117+0000","scrub_duration":0.0039991189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"26'82","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:20.090999+0000","last_change":"2023-10-06T03:10:20.090874+0000","last_active":"2023-10-06T03:10:20.090999+0000","last_peered":"2023-10-06T03:10:20.090999+0000","last_clean":"2023-10-06T03:10:20.090999+0000","last_became_active":"2023-10-06T02:59:53.672930+0000","last_became_peered":"2023-10-06T02:59:53.672930+0000","last_unstale":"2023-10-06T03:10:20.090999+0000","last_undegraded":"2023-10-06T03:10:20.090999+0000","last_fullsized":"2023-10-06T03:10:20.090999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'82","last_scrub_stamp":"2023-10-06T03:10:20.090542+0000","last_deep_scrub":"26'82","last_deep_scrub_stamp":"2023-10-06T03:10:20.090542+0000","last_clean_scrub_stamp":"2023-10-06T03:10:20.090542+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:47.533895+0000","scrub_duration":0.0044770959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"26'79","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:25.073596+0000","last_change":"2023-10-06T03:10:25.073525+0000","last_active":"2023-10-06T03:10:25.073596+0000","last_peered":"2023-10-06T03:10:25.073596+0000","last_clean":"2023-10-06T03:10:25.073596+0000","last_became_active":"2023-10-06T02:59:53.678471+0000","last_became_peered":"2023-10-06T02:59:53.678471+0000","last_unstale":"2023-10-06T03:10:25.073596+0000","last_undegraded":"2023-10-06T03:10:25.073596+0000","last_fullsized":"2023-10-06T03:10:25.073596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2023-10-06T03:10:25.073267+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2023-10-06T03:10:25.073267+0000","last_clean_scrub_stamp":"2023-10-06T03:10:25.073267+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:53.195252+0000","scrub_duration":0.0043216670000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'1521","reported_seq":1544,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:27.171575+0000","last_change":"2023-10-06T03:10:27.171530+0000","last_active":"2023-10-06T03:10:27.171575+0000","last_peered":"2023-10-06T03:10:27.171575+0000","last_clean":"2023-10-06T03:10:27.171575+0000","last_became_active":"2023-10-06T02:59:53.296816+0000","last_became_peered":"2023-10-06T02:59:53.296816+0000","last_unstale":"2023-10-06T03:10:27.171575+0000","last_undegraded":"2023-10-06T03:10:27.171575+0000","last_fullsized":"2023-10-06T03:10:27.171575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1521","last_scrub_stamp":"2023-10-06T03:10:27.171341+0000","last_deep_scrub":"26'1521","last_deep_scrub_stamp":"2023-10-06T03:10:27.171341+0000","last_clean_scrub_stamp":"2023-10-06T03:10:27.171341+0000","objects_scrubbed":4,"log_size":1521,"log_dups_size":0,"ondisk_log_size":1521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:55.293325+0000","scrub_duration":0.045663007999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1406,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'65","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.175346+0000","last_change":"2023-10-06T02:59:53.684876+0000","last_active":"2023-10-06T03:09:49.175346+0000","last_peered":"2023-10-06T03:09:49.175346+0000","last_clean":"2023-10-06T03:09:49.175346+0000","last_became_active":"2023-10-06T02:59:53.684522+0000","last_became_peered":"2023-10-06T02:59:53.684522+0000","last_unstale":"2023-10-06T03:09:49.175346+0000","last_undegraded":"2023-10-06T03:09:49.175346+0000","last_fullsized":"2023-10-06T03:09:49.175346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"26'125","reported_seq":148,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:07.090031+0000","last_change":"2023-10-06T03:10:07.089961+0000","last_active":"2023-10-06T03:10:07.090031+0000","last_peered":"2023-10-06T03:10:07.090031+0000","last_clean":"2023-10-06T03:10:07.090031+0000","last_became_active":"2023-10-06T02:59:53.292378+0000","last_became_peered":"2023-10-06T02:59:53.292378+0000","last_unstale":"2023-10-06T03:10:07.090031+0000","last_undegraded":"2023-10-06T03:10:07.090031+0000","last_fullsized":"2023-10-06T03:10:07.090031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'125","last_scrub_stamp":"2023-10-06T03:10:07.089660+0000","last_deep_scrub":"26'125","last_deep_scrub_stamp":"2023-10-06T03:10:07.089660+0000","last_clean_scrub_stamp":"2023-10-06T03:10:07.089660+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:33.076065+0000","scrub_duration":0.0042091079999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"26'92","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:35.093402+0000","last_change":"2023-10-06T03:10:35.093329+0000","last_active":"2023-10-06T03:10:35.093402+0000","last_peered":"2023-10-06T03:10:35.093402+0000","last_clean":"2023-10-06T03:10:35.093402+0000","last_became_active":"2023-10-06T02:59:53.675219+0000","last_became_peered":"2023-10-06T02:59:53.675219+0000","last_unstale":"2023-10-06T03:10:35.093402+0000","last_undegraded":"2023-10-06T03:10:35.093402+0000","last_fullsized":"2023-10-06T03:10:35.093402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2023-10-06T03:10:35.093065+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2023-10-06T03:10:35.093065+0000","last_clean_scrub_stamp":"2023-10-06T03:10:35.093065+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:45.715705+0000","scrub_duration":0.0042966380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"26'124","reported_seq":147,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:15.125161+0000","last_change":"2023-10-06T03:10:15.125056+0000","last_active":"2023-10-06T03:10:15.125161+0000","last_peered":"2023-10-06T03:10:15.125161+0000","last_clean":"2023-10-06T03:10:15.125161+0000","last_became_active":"2023-10-06T02:59:53.301737+0000","last_became_peered":"2023-10-06T02:59:53.301737+0000","last_unstale":"2023-10-06T03:10:15.125161+0000","last_undegraded":"2023-10-06T03:10:15.125161+0000","last_fullsized":"2023-10-06T03:10:15.125161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'124","last_scrub_stamp":"2023-10-06T03:10:15.124658+0000","last_deep_scrub":"26'124","last_deep_scrub_stamp":"2023-10-06T03:10:15.124658+0000","last_clean_scrub_stamp":"2023-10-06T03:10:15.124658+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:43.006174+0000","scrub_duration":0.0049652760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'80","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203563+0000","last_change":"2023-10-06T02:59:53.684854+0000","last_active":"2023-10-06T03:09:49.203563+0000","last_peered":"2023-10-06T03:09:49.203563+0000","last_clean":"2023-10-06T03:09:49.203563+0000","last_became_active":"2023-10-06T02:59:53.684527+0000","last_became_peered":"2023-10-06T02:59:53.684527+0000","last_unstale":"2023-10-06T03:09:49.203563+0000","last_undegraded":"2023-10-06T03:09:49.203563+0000","last_fullsized":"2023-10-06T03:09:49.203563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"26'139","reported_seq":162,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:03.006058+0000","last_change":"2023-10-06T03:10:03.005991+0000","last_active":"2023-10-06T03:10:03.006058+0000","last_peered":"2023-10-06T03:10:03.006058+0000","last_clean":"2023-10-06T03:10:03.006058+0000","last_became_active":"2023-10-06T02:59:53.293707+0000","last_became_peered":"2023-10-06T02:59:53.293707+0000","last_unstale":"2023-10-06T03:10:03.006058+0000","last_undegraded":"2023-10-06T03:10:03.006058+0000","last_fullsized":"2023-10-06T03:10:03.006058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'139","last_scrub_stamp":"2023-10-06T03:10:03.005737+0000","last_deep_scrub":"26'139","last_deep_scrub_stamp":"2023-10-06T03:10:03.005737+0000","last_clean_scrub_stamp":"2023-10-06T03:10:03.005737+0000","objects_scrubbed":4,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:41.702358+0000","scrub_duration":0.011013787000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"26'119","reported_seq":142,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:17.154993+0000","last_change":"2023-10-06T03:10:17.154926+0000","last_active":"2023-10-06T03:10:17.154993+0000","last_peered":"2023-10-06T03:10:17.154993+0000","last_clean":"2023-10-06T03:10:17.154993+0000","last_became_active":"2023-10-06T02:59:53.296230+0000","last_became_peered":"2023-10-06T02:59:53.296230+0000","last_unstale":"2023-10-06T03:10:17.154993+0000","last_undegraded":"2023-10-06T03:10:17.154993+0000","last_fullsized":"2023-10-06T03:10:17.154993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2023-10-06T03:10:17.154673+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2023-10-06T03:10:17.154673+0000","last_clean_scrub_stamp":"2023-10-06T03:10:17.154673+0000","objects_scrubbed":1,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:23.330769+0000","scrub_duration":0.0076386739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"26'90","reported_seq":112,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:34.545362+0000","last_change":"2023-10-06T03:10:34.545294+0000","last_active":"2023-10-06T03:10:34.545362+0000","last_peered":"2023-10-06T03:10:34.545362+0000","last_clean":"2023-10-06T03:10:34.545362+0000","last_became_active":"2023-10-06T02:59:53.683705+0000","last_became_peered":"2023-10-06T02:59:53.683705+0000","last_unstale":"2023-10-06T03:10:34.545362+0000","last_undegraded":"2023-10-06T03:10:34.545362+0000","last_fullsized":"2023-10-06T03:10:34.545362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'90","last_scrub_stamp":"2023-10-06T03:10:34.545027+0000","last_deep_scrub":"26'90","last_deep_scrub_stamp":"2023-10-06T03:10:34.545027+0000","last_clean_scrub_stamp":"2023-10-06T03:10:34.545027+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:31.372952+0000","scrub_duration":0.0039139780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'107","reported_seq":130,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:21.176574+0000","last_change":"2023-10-06T03:10:21.176450+0000","last_active":"2023-10-06T03:10:21.176574+0000","last_peered":"2023-10-06T03:10:21.176574+0000","last_clean":"2023-10-06T03:10:21.176574+0000","last_became_active":"2023-10-06T02:59:53.296225+0000","last_became_peered":"2023-10-06T02:59:53.296225+0000","last_unstale":"2023-10-06T03:10:21.176574+0000","last_undegraded":"2023-10-06T03:10:21.176574+0000","last_fullsized":"2023-10-06T03:10:21.176574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'107","last_scrub_stamp":"2023-10-06T03:10:21.176172+0000","last_deep_scrub":"26'107","last_deep_scrub_stamp":"2023-10-06T03:10:21.176172+0000","last_clean_scrub_stamp":"2023-10-06T03:10:21.176172+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:48.619526+0000","scrub_duration":0.0078170730000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'81","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:33.222875+0000","last_change":"2023-10-06T03:10:33.222803+0000","last_active":"2023-10-06T03:10:33.222875+0000","last_peered":"2023-10-06T03:10:33.222875+0000","last_clean":"2023-10-06T03:10:33.222875+0000","last_became_active":"2023-10-06T02:59:53.682938+0000","last_became_peered":"2023-10-06T02:59:53.682938+0000","last_unstale":"2023-10-06T03:10:33.222875+0000","last_undegraded":"2023-10-06T03:10:33.222875+0000","last_fullsized":"2023-10-06T03:10:33.222875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'81","last_scrub_stamp":"2023-10-06T03:10:33.222535+0000","last_deep_scrub":"26'81","last_deep_scrub_stamp":"2023-10-06T03:10:33.222535+0000","last_clean_scrub_stamp":"2023-10-06T03:10:33.222535+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:43.845175+0000","scrub_duration":0.0043943419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"26'622","reported_seq":645,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:22.183860+0000","last_change":"2023-10-06T03:10:22.183763+0000","last_active":"2023-10-06T03:10:22.183860+0000","last_peered":"2023-10-06T03:10:22.183860+0000","last_clean":"2023-10-06T03:10:22.183860+0000","last_became_active":"2023-10-06T02:59:53.293602+0000","last_became_peered":"2023-10-06T02:59:53.293602+0000","last_unstale":"2023-10-06T03:10:22.183860+0000","last_undegraded":"2023-10-06T03:10:22.183860+0000","last_fullsized":"2023-10-06T03:10:22.183860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'622","last_scrub_stamp":"2023-10-06T03:10:22.183451+0000","last_deep_scrub":"26'622","last_deep_scrub_stamp":"2023-10-06T03:10:22.183451+0000","last_clean_scrub_stamp":"2023-10-06T03:10:22.183451+0000","objects_scrubbed":2,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:28.323446+0000","scrub_duration":0.026638347999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"26'75","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:10.010261+0000","last_change":"2023-10-06T03:10:10.010194+0000","last_active":"2023-10-06T03:10:10.010261+0000","last_peered":"2023-10-06T03:10:10.010261+0000","last_clean":"2023-10-06T03:10:10.010261+0000","last_became_active":"2023-10-06T02:59:53.671511+0000","last_became_peered":"2023-10-06T02:59:53.671511+0000","last_unstale":"2023-10-06T03:10:10.010261+0000","last_undegraded":"2023-10-06T03:10:10.010261+0000","last_fullsized":"2023-10-06T03:10:10.010261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'75","last_scrub_stamp":"2023-10-06T03:10:10.009944+0000","last_deep_scrub":"26'75","last_deep_scrub_stamp":"2023-10-06T03:10:10.009944+0000","last_clean_scrub_stamp":"2023-10-06T03:10:10.009944+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:35.996349+0000","scrub_duration":0.0048294820000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'134","reported_seq":157,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:16.293257+0000","last_change":"2023-10-06T03:10:16.293195+0000","last_active":"2023-10-06T03:10:16.293257+0000","last_peered":"2023-10-06T03:10:16.293257+0000","last_clean":"2023-10-06T03:10:16.293257+0000","last_became_active":"2023-10-06T02:59:53.299715+0000","last_became_peered":"2023-10-06T02:59:53.299715+0000","last_unstale":"2023-10-06T03:10:16.293257+0000","last_undegraded":"2023-10-06T03:10:16.293257+0000","last_fullsized":"2023-10-06T03:10:16.293257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'134","last_scrub_stamp":"2023-10-06T03:10:16.292913+0000","last_deep_scrub":"26'134","last_deep_scrub_stamp":"2023-10-06T03:10:16.292913+0000","last_clean_scrub_stamp":"2023-10-06T03:10:16.292913+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:22.469009+0000","scrub_duration":0.0043004039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"26'94","reported_seq":116,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:31.128981+0000","last_change":"2023-10-06T03:10:31.128863+0000","last_active":"2023-10-06T03:10:31.128981+0000","last_peered":"2023-10-06T03:10:31.128981+0000","last_clean":"2023-10-06T03:10:31.128981+0000","last_became_active":"2023-10-06T02:59:53.682994+0000","last_became_peered":"2023-10-06T02:59:53.682994+0000","last_unstale":"2023-10-06T03:10:31.128981+0000","last_undegraded":"2023-10-06T03:10:31.128981+0000","last_fullsized":"2023-10-06T03:10:31.128981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'94","last_scrub_stamp":"2023-10-06T03:10:31.128586+0000","last_deep_scrub":"26'94","last_deep_scrub_stamp":"2023-10-06T03:10:31.128586+0000","last_clean_scrub_stamp":"2023-10-06T03:10:31.128586+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:27.956512+0000","scrub_duration":0.0043574260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'620","reported_seq":643,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:02.130329+0000","last_change":"2023-10-06T03:10:02.130249+0000","last_active":"2023-10-06T03:10:02.130329+0000","last_peered":"2023-10-06T03:10:02.130329+0000","last_clean":"2023-10-06T03:10:02.130329+0000","last_became_active":"2023-10-06T02:59:53.300850+0000","last_became_peered":"2023-10-06T02:59:53.300850+0000","last_unstale":"2023-10-06T03:10:02.130329+0000","last_undegraded":"2023-10-06T03:10:02.130329+0000","last_fullsized":"2023-10-06T03:10:02.130329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'620","last_scrub_stamp":"2023-10-06T03:10:02.129953+0000","last_deep_scrub":"26'620","last_deep_scrub_stamp":"2023-10-06T03:10:02.129953+0000","last_clean_scrub_stamp":"2023-10-06T03:10:02.129953+0000","objects_scrubbed":2,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:16.383931+0000","scrub_duration":0.023249453,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'92","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:04.418253+0000","last_change":"2023-10-06T03:10:04.418128+0000","last_active":"2023-10-06T03:10:04.418253+0000","last_peered":"2023-10-06T03:10:04.418253+0000","last_clean":"2023-10-06T03:10:04.418253+0000","last_became_active":"2023-10-06T02:59:53.678630+0000","last_became_peered":"2023-10-06T02:59:53.678630+0000","last_unstale":"2023-10-06T03:10:04.418253+0000","last_undegraded":"2023-10-06T03:10:04.418253+0000","last_fullsized":"2023-10-06T03:10:04.418253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2023-10-06T03:10:04.417805+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2023-10-06T03:10:04.417805+0000","last_clean_scrub_stamp":"2023-10-06T03:10:04.417805+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:30.404211+0000","scrub_duration":0.004364588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'128","reported_seq":151,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:03.994004+0000","last_change":"2023-10-06T03:10:03.993933+0000","last_active":"2023-10-06T03:10:03.994004+0000","last_peered":"2023-10-06T03:10:03.994004+0000","last_clean":"2023-10-06T03:10:03.994004+0000","last_became_active":"2023-10-06T02:59:53.290773+0000","last_became_peered":"2023-10-06T02:59:53.290773+0000","last_unstale":"2023-10-06T03:10:03.994004+0000","last_undegraded":"2023-10-06T03:10:03.994004+0000","last_fullsized":"2023-10-06T03:10:03.994004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'128","last_scrub_stamp":"2023-10-06T03:10:03.993644+0000","last_deep_scrub":"26'128","last_deep_scrub_stamp":"2023-10-06T03:10:03.993644+0000","last_clean_scrub_stamp":"2023-10-06T03:10:03.993644+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:04.037931+0000","scrub_duration":0.0040760750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"26'92","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:39.192741+0000","last_change":"2023-10-06T03:10:39.192627+0000","last_active":"2023-10-06T03:10:39.192741+0000","last_peered":"2023-10-06T03:10:39.192741+0000","last_clean":"2023-10-06T03:10:39.192741+0000","last_became_active":"2023-10-06T02:59:53.676507+0000","last_became_peered":"2023-10-06T02:59:53.676507+0000","last_unstale":"2023-10-06T03:10:39.192741+0000","last_undegraded":"2023-10-06T03:10:39.192741+0000","last_fullsized":"2023-10-06T03:10:39.192741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2023-10-06T03:10:39.192300+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2023-10-06T03:10:39.192300+0000","last_clean_scrub_stamp":"2023-10-06T03:10:39.192300+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:44.472861+0000","scrub_duration":0.0045248679999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"26'126","reported_seq":149,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:20.318553+0000","last_change":"2023-10-06T03:10:20.318490+0000","last_active":"2023-10-06T03:10:20.318553+0000","last_peered":"2023-10-06T03:10:20.318553+0000","last_clean":"2023-10-06T03:10:20.318553+0000","last_became_active":"2023-10-06T02:59:53.288601+0000","last_became_peered":"2023-10-06T02:59:53.288601+0000","last_unstale":"2023-10-06T03:10:20.318553+0000","last_undegraded":"2023-10-06T03:10:20.318553+0000","last_fullsized":"2023-10-06T03:10:20.318553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'126","last_scrub_stamp":"2023-10-06T03:10:20.318239+0000","last_deep_scrub":"26'126","last_deep_scrub_stamp":"2023-10-06T03:10:20.318239+0000","last_clean_scrub_stamp":"2023-10-06T03:10:20.318239+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:25.779073+0000","scrub_duration":0.0042963699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"26'87","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:41.149474+0000","last_change":"2023-10-06T03:10:41.149356+0000","last_active":"2023-10-06T03:10:41.149474+0000","last_peered":"2023-10-06T03:10:41.149474+0000","last_clean":"2023-10-06T03:10:41.149474+0000","last_became_active":"2023-10-06T02:59:53.673268+0000","last_became_peered":"2023-10-06T02:59:53.673268+0000","last_unstale":"2023-10-06T03:10:41.149474+0000","last_undegraded":"2023-10-06T03:10:41.149474+0000","last_fullsized":"2023-10-06T03:10:41.149474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'87","last_scrub_stamp":"2023-10-06T03:10:41.149100+0000","last_deep_scrub":"26'87","last_deep_scrub_stamp":"2023-10-06T03:10:41.149100+0000","last_clean_scrub_stamp":"2023-10-06T03:10:41.149100+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:06.573747+0000","scrub_duration":0.0039433380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'688","reported_seq":711,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:01.095525+0000","last_change":"2023-10-06T03:10:01.095463+0000","last_active":"2023-10-06T03:10:01.095525+0000","last_peered":"2023-10-06T03:10:01.095525+0000","last_clean":"2023-10-06T03:10:01.095525+0000","last_became_active":"2023-10-06T02:59:53.297896+0000","last_became_peered":"2023-10-06T02:59:53.297896+0000","last_unstale":"2023-10-06T03:10:01.095525+0000","last_undegraded":"2023-10-06T03:10:01.095525+0000","last_fullsized":"2023-10-06T03:10:01.095525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'688","last_scrub_stamp":"2023-10-06T03:10:01.095265+0000","last_deep_scrub":"26'688","last_deep_scrub_stamp":"2023-10-06T03:10:01.095265+0000","last_clean_scrub_stamp":"2023-10-06T03:10:01.095265+0000","objects_scrubbed":1,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:29.509465+0000","scrub_duration":0.023556345999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"26'75","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.205232+0000","last_change":"2023-10-06T02:59:53.679712+0000","last_active":"2023-10-06T03:09:49.205232+0000","last_peered":"2023-10-06T03:09:49.205232+0000","last_clean":"2023-10-06T03:09:49.205232+0000","last_became_active":"2023-10-06T02:59:53.679390+0000","last_became_peered":"2023-10-06T02:59:53.679390+0000","last_unstale":"2023-10-06T03:09:49.205232+0000","last_undegraded":"2023-10-06T03:09:49.205232+0000","last_fullsized":"2023-10-06T03:09:49.205232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":181,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:05.097662+0000","last_change":"2023-10-06T03:10:05.097603+0000","last_active":"2023-10-06T03:10:05.097662+0000","last_peered":"2023-10-06T03:10:05.097662+0000","last_clean":"2023-10-06T03:10:05.097662+0000","last_became_active":"2023-10-06T02:59:44.072854+0000","last_became_peered":"2023-10-06T02:59:44.072854+0000","last_unstale":"2023-10-06T03:10:05.097662+0000","last_undegraded":"2023-10-06T03:10:05.097662+0000","last_fullsized":"2023-10-06T03:10:05.097662+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2023-10-06T03:10:05.097351+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2023-10-06T03:10:05.097351+0000","last_clean_scrub_stamp":"2023-10-06T03:10:05.097351+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:05.141638+0000","scrub_duration":0.013871631000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:09.346769+0000","last_change":"2023-10-06T03:10:09.346668+0000","last_active":"2023-10-06T03:10:09.346769+0000","last_peered":"2023-10-06T03:10:09.346769+0000","last_clean":"2023-10-06T03:10:09.346769+0000","last_became_active":"2023-10-06T02:59:49.106619+0000","last_became_peered":"2023-10-06T02:59:49.106619+0000","last_unstale":"2023-10-06T03:10:09.346769+0000","last_undegraded":"2023-10-06T03:10:09.346769+0000","last_fullsized":"2023-10-06T03:10:09.346769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:09.346351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:09.346351+0000","last_clean_scrub_stamp":"2023-10-06T03:10:09.346351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:35.332756+0000","scrub_duration":0.0039630009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"26'1463","reported_seq":1486,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:05.133084+0000","last_change":"2023-10-06T03:10:05.133006+0000","last_active":"2023-10-06T03:10:05.133084+0000","last_peered":"2023-10-06T03:10:05.133084+0000","last_clean":"2023-10-06T03:10:05.133084+0000","last_became_active":"2023-10-06T02:59:53.298012+0000","last_became_peered":"2023-10-06T02:59:53.298012+0000","last_unstale":"2023-10-06T03:10:05.133084+0000","last_undegraded":"2023-10-06T03:10:05.133084+0000","last_fullsized":"2023-10-06T03:10:05.133084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1463","last_scrub_stamp":"2023-10-06T03:10:05.132728+0000","last_deep_scrub":"26'1463","last_deep_scrub_stamp":"2023-10-06T03:10:05.132728+0000","last_clean_scrub_stamp":"2023-10-06T03:10:05.132728+0000","objects_scrubbed":2,"log_size":1463,"log_dups_size":0,"ondisk_log_size":1463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:16.936485+0000","scrub_duration":0.042468087000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1329,"num_write_kb":8969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"26'92","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:15.979132+0000","last_change":"2023-10-06T03:10:15.979001+0000","last_active":"2023-10-06T03:10:15.979132+0000","last_peered":"2023-10-06T03:10:15.979132+0000","last_clean":"2023-10-06T03:10:15.979132+0000","last_became_active":"2023-10-06T02:59:53.679200+0000","last_became_peered":"2023-10-06T02:59:53.679200+0000","last_unstale":"2023-10-06T03:10:15.979132+0000","last_undegraded":"2023-10-06T03:10:15.979132+0000","last_fullsized":"2023-10-06T03:10:15.979132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2023-10-06T03:10:15.978591+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2023-10-06T03:10:15.978591+0000","last_clean_scrub_stamp":"2023-10-06T03:10:15.978591+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:22.154687+0000","scrub_duration":0.0043756020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:06.062344+0000","last_change":"2023-10-06T03:10:06.062274+0000","last_active":"2023-10-06T03:10:06.062344+0000","last_peered":"2023-10-06T03:10:06.062344+0000","last_clean":"2023-10-06T03:10:06.062344+0000","last_became_active":"2023-10-06T02:59:49.106878+0000","last_became_peered":"2023-10-06T02:59:49.106878+0000","last_unstale":"2023-10-06T03:10:06.062344+0000","last_undegraded":"2023-10-06T03:10:06.062344+0000","last_fullsized":"2023-10-06T03:10:06.062344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:06.062015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:06.062015+0000","last_clean_scrub_stamp":"2023-10-06T03:10:06.062015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:17.865773+0000","scrub_duration":0.0058099720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"26'604","reported_seq":1110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:11.111104+0000","last_change":"2023-10-06T03:10:11.111027+0000","last_active":"2023-10-06T03:10:11.111104+0000","last_peered":"2023-10-06T03:10:11.111104+0000","last_clean":"2023-10-06T03:10:11.111104+0000","last_became_active":"2023-10-06T02:59:53.296171+0000","last_became_peered":"2023-10-06T02:59:53.296171+0000","last_unstale":"2023-10-06T03:10:11.111104+0000","last_undegraded":"2023-10-06T03:10:11.111104+0000","last_fullsized":"2023-10-06T03:10:11.111104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'604","last_scrub_stamp":"2023-10-06T03:10:11.110731+0000","last_deep_scrub":"26'604","last_deep_scrub_stamp":"2023-10-06T03:10:11.110731+0000","last_clean_scrub_stamp":"2023-10-06T03:10:11.110731+0000","objects_scrubbed":1,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:38.992246+0000","scrub_duration":0.012150444999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770024,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":483,"num_write_kb":1079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"26'88","reported_seq":110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:22.141939+0000","last_change":"2023-10-06T03:10:22.141869+0000","last_active":"2023-10-06T03:10:22.141939+0000","last_peered":"2023-10-06T03:10:22.141939+0000","last_clean":"2023-10-06T03:10:22.141939+0000","last_became_active":"2023-10-06T02:59:53.681786+0000","last_became_peered":"2023-10-06T02:59:53.681786+0000","last_unstale":"2023-10-06T03:10:22.141939+0000","last_undegraded":"2023-10-06T03:10:22.141939+0000","last_fullsized":"2023-10-06T03:10:22.141939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'88","last_scrub_stamp":"2023-10-06T03:10:22.141602+0000","last_deep_scrub":"26'88","last_deep_scrub_stamp":"2023-10-06T03:10:22.141602+0000","last_clean_scrub_stamp":"2023-10-06T03:10:22.141602+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:27.602437+0000","scrub_duration":0.0039522100000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:00.752920+0000","last_change":"2023-10-06T03:10:00.752834+0000","last_active":"2023-10-06T03:10:00.752920+0000","last_peered":"2023-10-06T03:10:00.752920+0000","last_clean":"2023-10-06T03:10:00.752920+0000","last_became_active":"2023-10-06T02:59:49.114769+0000","last_became_peered":"2023-10-06T02:59:49.114769+0000","last_unstale":"2023-10-06T03:10:00.752920+0000","last_undegraded":"2023-10-06T03:10:00.752920+0000","last_fullsized":"2023-10-06T03:10:00.752920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:00.752583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:00.752583+0000","last_clean_scrub_stamp":"2023-10-06T03:10:00.752583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:30.133142+0000","scrub_duration":0.0033960230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'1470","reported_seq":1493,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:04.020034+0000","last_change":"2023-10-06T03:10:04.019981+0000","last_active":"2023-10-06T03:10:04.020034+0000","last_peered":"2023-10-06T03:10:04.020034+0000","last_clean":"2023-10-06T03:10:04.020034+0000","last_became_active":"2023-10-06T02:59:53.298054+0000","last_became_peered":"2023-10-06T02:59:53.298054+0000","last_unstale":"2023-10-06T03:10:04.020034+0000","last_undegraded":"2023-10-06T03:10:04.020034+0000","last_fullsized":"2023-10-06T03:10:04.020034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1470","last_scrub_stamp":"2023-10-06T03:10:04.019787+0000","last_deep_scrub":"26'1470","last_deep_scrub_stamp":"2023-10-06T03:10:04.019787+0000","last_clean_scrub_stamp":"2023-10-06T03:10:04.019787+0000","objects_scrubbed":2,"log_size":1470,"log_dups_size":0,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:51.929095+0000","scrub_duration":0.048117597999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1335,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"26'79","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:07.879509+0000","last_change":"2023-10-06T03:10:07.879434+0000","last_active":"2023-10-06T03:10:07.879509+0000","last_peered":"2023-10-06T03:10:07.879509+0000","last_clean":"2023-10-06T03:10:07.879509+0000","last_became_active":"2023-10-06T02:59:53.673677+0000","last_became_peered":"2023-10-06T02:59:53.673677+0000","last_unstale":"2023-10-06T03:10:07.879509+0000","last_undegraded":"2023-10-06T03:10:07.879509+0000","last_fullsized":"2023-10-06T03:10:07.879509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2023-10-06T03:10:07.879169+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2023-10-06T03:10:07.879169+0000","last_clean_scrub_stamp":"2023-10-06T03:10:07.879169+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:07.923455+0000","scrub_duration":0.0046089219999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:14.264128+0000","last_change":"2023-10-06T03:10:14.264062+0000","last_active":"2023-10-06T03:10:14.264128+0000","last_peered":"2023-10-06T03:10:14.264128+0000","last_clean":"2023-10-06T03:10:14.264128+0000","last_became_active":"2023-10-06T02:59:49.107560+0000","last_became_peered":"2023-10-06T02:59:49.107560+0000","last_unstale":"2023-10-06T03:10:14.264128+0000","last_undegraded":"2023-10-06T03:10:14.264128+0000","last_fullsized":"2023-10-06T03:10:14.264128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:14.263786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:14.263786+0000","last_clean_scrub_stamp":"2023-10-06T03:10:14.263786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:42.145301+0000","scrub_duration":0.003869969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'122","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:21.301197+0000","last_change":"2023-10-06T03:10:21.301133+0000","last_active":"2023-10-06T03:10:21.301197+0000","last_peered":"2023-10-06T03:10:21.301197+0000","last_clean":"2023-10-06T03:10:21.301197+0000","last_became_active":"2023-10-06T02:59:53.300609+0000","last_became_peered":"2023-10-06T02:59:53.300609+0000","last_unstale":"2023-10-06T03:10:21.301197+0000","last_undegraded":"2023-10-06T03:10:21.301197+0000","last_fullsized":"2023-10-06T03:10:21.301197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'122","last_scrub_stamp":"2023-10-06T03:10:21.300877+0000","last_deep_scrub":"26'122","last_deep_scrub_stamp":"2023-10-06T03:10:21.300877+0000","last_clean_scrub_stamp":"2023-10-06T03:10:21.300877+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:49.422862+0000","scrub_duration":0.0040404660000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"26'78","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.192797+0000","last_change":"2023-10-06T03:00:34.740673+0000","last_active":"2023-10-06T03:09:49.192797+0000","last_peered":"2023-10-06T03:09:49.192797+0000","last_clean":"2023-10-06T03:09:49.192797+0000","last_became_active":"2023-10-06T03:00:34.740140+0000","last_became_peered":"2023-10-06T03:00:34.740140+0000","last_unstale":"2023-10-06T03:09:49.192797+0000","last_undegraded":"2023-10-06T03:09:49.192797+0000","last_fullsized":"2023-10-06T03:09:49.192797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'105","reported_seq":128,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:20.352688+0000","last_change":"2023-10-06T03:10:20.352592+0000","last_active":"2023-10-06T03:10:20.352688+0000","last_peered":"2023-10-06T03:10:20.352688+0000","last_clean":"2023-10-06T03:10:20.352688+0000","last_became_active":"2023-10-06T02:59:53.300919+0000","last_became_peered":"2023-10-06T02:59:53.300919+0000","last_unstale":"2023-10-06T03:10:20.352688+0000","last_undegraded":"2023-10-06T03:10:20.352688+0000","last_fullsized":"2023-10-06T03:10:20.352688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'105","last_scrub_stamp":"2023-10-06T03:10:20.352194+0000","last_deep_scrub":"26'105","last_deep_scrub_stamp":"2023-10-06T03:10:20.352194+0000","last_clean_scrub_stamp":"2023-10-06T03:10:20.352194+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:47.795547+0000","scrub_duration":0.004720185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:59.902097+0000","last_change":"2023-10-06T03:09:59.902052+0000","last_active":"2023-10-06T03:09:59.902097+0000","last_peered":"2023-10-06T03:09:59.902097+0000","last_clean":"2023-10-06T03:09:59.902097+0000","last_became_active":"2023-10-06T02:59:49.107967+0000","last_became_peered":"2023-10-06T02:59:49.107967+0000","last_unstale":"2023-10-06T03:09:59.902097+0000","last_undegraded":"2023-10-06T03:09:59.902097+0000","last_fullsized":"2023-10-06T03:09:59.902097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:09:59.901857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:09:59.901857+0000","last_clean_scrub_stamp":"2023-10-06T03:09:59.901857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:05.160444+0000","scrub_duration":0.003240022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'75","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:32.025953+0000","last_change":"2023-10-06T03:10:32.025884+0000","last_active":"2023-10-06T03:10:32.025953+0000","last_peered":"2023-10-06T03:10:32.025953+0000","last_clean":"2023-10-06T03:10:32.025953+0000","last_became_active":"2023-10-06T02:59:53.676385+0000","last_became_peered":"2023-10-06T02:59:53.676385+0000","last_unstale":"2023-10-06T03:10:32.025953+0000","last_undegraded":"2023-10-06T03:10:32.025953+0000","last_fullsized":"2023-10-06T03:10:32.025953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'75","last_scrub_stamp":"2023-10-06T03:10:32.025620+0000","last_deep_scrub":"26'75","last_deep_scrub_stamp":"2023-10-06T03:10:32.025620+0000","last_clean_scrub_stamp":"2023-10-06T03:10:32.025620+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:00.147604+0000","scrub_duration":0.0043942920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"26'115","reported_seq":138,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:04.938136+0000","last_change":"2023-10-06T03:10:04.938068+0000","last_active":"2023-10-06T03:10:04.938136+0000","last_peered":"2023-10-06T03:10:04.938136+0000","last_clean":"2023-10-06T03:10:04.938136+0000","last_became_active":"2023-10-06T02:59:53.302890+0000","last_became_peered":"2023-10-06T02:59:53.302890+0000","last_unstale":"2023-10-06T03:10:04.938136+0000","last_undegraded":"2023-10-06T03:10:04.938136+0000","last_fullsized":"2023-10-06T03:10:04.938136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'115","last_scrub_stamp":"2023-10-06T03:10:04.937798+0000","last_deep_scrub":"26'115","last_deep_scrub_stamp":"2023-10-06T03:10:04.937798+0000","last_clean_scrub_stamp":"2023-10-06T03:10:04.937798+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:19.191776+0000","scrub_duration":0.0040328159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:11.154639+0000","last_change":"2023-10-06T03:10:11.154566+0000","last_active":"2023-10-06T03:10:11.154639+0000","last_peered":"2023-10-06T03:10:11.154639+0000","last_clean":"2023-10-06T03:10:11.154639+0000","last_became_active":"2023-10-06T02:59:49.101530+0000","last_became_peered":"2023-10-06T02:59:49.101530+0000","last_unstale":"2023-10-06T03:10:11.154639+0000","last_undegraded":"2023-10-06T03:10:11.154639+0000","last_fullsized":"2023-10-06T03:10:11.154639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:11.154299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:11.154299+0000","last_clean_scrub_stamp":"2023-10-06T03:10:11.154299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:37.140705+0000","scrub_duration":0.0041325099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'79","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:18.192650+0000","last_change":"2023-10-06T03:10:18.192544+0000","last_active":"2023-10-06T03:10:18.192650+0000","last_peered":"2023-10-06T03:10:18.192650+0000","last_clean":"2023-10-06T03:10:18.192650+0000","last_became_active":"2023-10-06T02:59:53.672299+0000","last_became_peered":"2023-10-06T02:59:53.672299+0000","last_unstale":"2023-10-06T03:10:18.192650+0000","last_undegraded":"2023-10-06T03:10:18.192650+0000","last_fullsized":"2023-10-06T03:10:18.192650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2023-10-06T03:10:18.192108+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2023-10-06T03:10:18.192108+0000","last_clean_scrub_stamp":"2023-10-06T03:10:18.192108+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:24.332103+0000","scrub_duration":0.0047218800000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"26'121","reported_seq":144,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:10.175123+0000","last_change":"2023-10-06T03:10:10.175047+0000","last_active":"2023-10-06T03:10:10.175123+0000","last_peered":"2023-10-06T03:10:10.175123+0000","last_clean":"2023-10-06T03:10:10.175123+0000","last_became_active":"2023-10-06T02:59:53.299271+0000","last_became_peered":"2023-10-06T02:59:53.299271+0000","last_unstale":"2023-10-06T03:10:10.175123+0000","last_undegraded":"2023-10-06T03:10:10.175123+0000","last_fullsized":"2023-10-06T03:10:10.175123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'121","last_scrub_stamp":"2023-10-06T03:10:10.174733+0000","last_deep_scrub":"26'121","last_deep_scrub_stamp":"2023-10-06T03:10:10.174733+0000","last_clean_scrub_stamp":"2023-10-06T03:10:10.174733+0000","objects_scrubbed":1,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:36.161138+0000","scrub_duration":0.0074238999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:00.939734+0000","last_change":"2023-10-06T03:10:00.939709+0000","last_active":"2023-10-06T03:10:00.939734+0000","last_peered":"2023-10-06T03:10:00.939734+0000","last_clean":"2023-10-06T03:10:00.939734+0000","last_became_active":"2023-10-06T02:59:49.099689+0000","last_became_peered":"2023-10-06T02:59:49.099689+0000","last_unstale":"2023-10-06T03:10:00.939734+0000","last_undegraded":"2023-10-06T03:10:00.939734+0000","last_fullsized":"2023-10-06T03:10:00.939734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:00.939619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:00.939619+0000","last_clean_scrub_stamp":"2023-10-06T03:10:00.939619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:52.791469+0000","scrub_duration":0.0037315680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'94","reported_seq":116,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:19.045676+0000","last_change":"2023-10-06T03:10:19.045609+0000","last_active":"2023-10-06T03:10:19.045676+0000","last_peered":"2023-10-06T03:10:19.045676+0000","last_clean":"2023-10-06T03:10:19.045676+0000","last_became_active":"2023-10-06T02:59:53.684983+0000","last_became_peered":"2023-10-06T02:59:53.684983+0000","last_unstale":"2023-10-06T03:10:19.045676+0000","last_undegraded":"2023-10-06T03:10:19.045676+0000","last_fullsized":"2023-10-06T03:10:19.045676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'94","last_scrub_stamp":"2023-10-06T03:10:19.045347+0000","last_deep_scrub":"26'94","last_deep_scrub_stamp":"2023-10-06T03:10:19.045347+0000","last_clean_scrub_stamp":"2023-10-06T03:10:19.045347+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:56.886921+0000","scrub_duration":0.0044076339999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'245","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:14.182077+0000","last_change":"2023-10-06T03:10:14.182047+0000","last_active":"2023-10-06T03:10:14.182077+0000","last_peered":"2023-10-06T03:10:14.182077+0000","last_clean":"2023-10-06T03:10:14.182077+0000","last_became_active":"2023-10-06T02:59:53.300086+0000","last_became_peered":"2023-10-06T02:59:53.300086+0000","last_unstale":"2023-10-06T03:10:14.182077+0000","last_undegraded":"2023-10-06T03:10:14.182077+0000","last_fullsized":"2023-10-06T03:10:14.182077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'245","last_scrub_stamp":"2023-10-06T03:10:14.181904+0000","last_deep_scrub":"26'245","last_deep_scrub_stamp":"2023-10-06T03:10:14.181904+0000","last_clean_scrub_stamp":"2023-10-06T03:10:14.181904+0000","objects_scrubbed":1,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:20.358000+0000","scrub_duration":0.017879721000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:02.012539+0000","last_change":"2023-10-06T03:10:02.012475+0000","last_active":"2023-10-06T03:10:02.012539+0000","last_peered":"2023-10-06T03:10:02.012539+0000","last_clean":"2023-10-06T03:10:02.012539+0000","last_became_active":"2023-10-06T02:59:49.102397+0000","last_became_peered":"2023-10-06T02:59:49.102397+0000","last_unstale":"2023-10-06T03:10:02.012539+0000","last_undegraded":"2023-10-06T03:10:02.012539+0000","last_fullsized":"2023-10-06T03:10:02.012539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:02.012201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:02.012201+0000","last_clean_scrub_stamp":"2023-10-06T03:10:02.012201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:16.266178+0000","scrub_duration":0.0038301799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'77","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:30.221042+0000","last_change":"2023-10-06T03:10:30.220966+0000","last_active":"2023-10-06T03:10:30.221042+0000","last_peered":"2023-10-06T03:10:30.221042+0000","last_clean":"2023-10-06T03:10:30.221042+0000","last_became_active":"2023-10-06T02:59:53.675895+0000","last_became_peered":"2023-10-06T02:59:53.675895+0000","last_unstale":"2023-10-06T03:10:30.221042+0000","last_undegraded":"2023-10-06T03:10:30.221042+0000","last_fullsized":"2023-10-06T03:10:30.221042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'77","last_scrub_stamp":"2023-10-06T03:10:30.220665+0000","last_deep_scrub":"26'77","last_deep_scrub_stamp":"2023-10-06T03:10:30.220665+0000","last_clean_scrub_stamp":"2023-10-06T03:10:30.220665+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:29.279026+0000","scrub_duration":0.0042864239999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"26'85","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:11.453952+0000","last_change":"2023-10-06T03:10:11.453859+0000","last_active":"2023-10-06T03:10:11.453952+0000","last_peered":"2023-10-06T03:10:11.453952+0000","last_clean":"2023-10-06T03:10:11.453952+0000","last_became_active":"2023-10-06T02:59:53.676528+0000","last_became_peered":"2023-10-06T02:59:53.676528+0000","last_unstale":"2023-10-06T03:10:11.453952+0000","last_undegraded":"2023-10-06T03:10:11.453952+0000","last_fullsized":"2023-10-06T03:10:11.453952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'85","last_scrub_stamp":"2023-10-06T03:10:11.453577+0000","last_deep_scrub":"26'85","last_deep_scrub_stamp":"2023-10-06T03:10:11.453577+0000","last_clean_scrub_stamp":"2023-10-06T03:10:11.453577+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:17.629673+0000","scrub_duration":0.0039029749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'532","reported_seq":555,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:16.383715+0000","last_change":"2023-10-06T03:10:16.383643+0000","last_active":"2023-10-06T03:10:16.383715+0000","last_peered":"2023-10-06T03:10:16.383715+0000","last_clean":"2023-10-06T03:10:16.383715+0000","last_became_active":"2023-10-06T02:59:53.291434+0000","last_became_peered":"2023-10-06T02:59:53.291434+0000","last_unstale":"2023-10-06T03:10:16.383715+0000","last_undegraded":"2023-10-06T03:10:16.383715+0000","last_fullsized":"2023-10-06T03:10:16.383715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'532","last_scrub_stamp":"2023-10-06T03:10:16.383436+0000","last_deep_scrub":"26'532","last_deep_scrub_stamp":"2023-10-06T03:10:16.383436+0000","last_clean_scrub_stamp":"2023-10-06T03:10:16.383436+0000","objects_scrubbed":4,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:22.523431+0000","scrub_duration":0.025598717999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'80","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:38.984855+0000","last_change":"2023-10-06T03:10:38.984780+0000","last_active":"2023-10-06T03:10:38.984855+0000","last_peered":"2023-10-06T03:10:38.984855+0000","last_clean":"2023-10-06T03:10:38.984855+0000","last_became_active":"2023-10-06T02:59:53.677924+0000","last_became_peered":"2023-10-06T02:59:53.677924+0000","last_unstale":"2023-10-06T03:10:38.984855+0000","last_undegraded":"2023-10-06T03:10:38.984855+0000","last_fullsized":"2023-10-06T03:10:38.984855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'80","last_scrub_stamp":"2023-10-06T03:10:38.984501+0000","last_deep_scrub":"26'80","last_deep_scrub_stamp":"2023-10-06T03:10:38.984501+0000","last_clean_scrub_stamp":"2023-10-06T03:10:38.984501+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:20.778103+0000","scrub_duration":0.004266616,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"26'338","reported_seq":361,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:35.263523+0000","last_change":"2023-10-06T03:10:35.263400+0000","last_active":"2023-10-06T03:10:35.263523+0000","last_peered":"2023-10-06T03:10:35.263523+0000","last_clean":"2023-10-06T03:10:35.263523+0000","last_became_active":"2023-10-06T02:59:53.300926+0000","last_became_peered":"2023-10-06T02:59:53.300926+0000","last_unstale":"2023-10-06T03:10:35.263523+0000","last_undegraded":"2023-10-06T03:10:35.263523+0000","last_fullsized":"2023-10-06T03:10:35.263523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'338","last_scrub_stamp":"2023-10-06T03:10:35.263147+0000","last_deep_scrub":"26'338","last_deep_scrub_stamp":"2023-10-06T03:10:35.263147+0000","last_clean_scrub_stamp":"2023-10-06T03:10:35.263147+0000","objects_scrubbed":2,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:32.091073+0000","scrub_duration":0.0090030820000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'135","reported_seq":158,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:21.379685+0000","last_change":"2023-10-06T03:10:21.379611+0000","last_active":"2023-10-06T03:10:21.379685+0000","last_peered":"2023-10-06T03:10:21.379685+0000","last_clean":"2023-10-06T03:10:21.379685+0000","last_became_active":"2023-10-06T02:59:53.292493+0000","last_became_peered":"2023-10-06T02:59:53.292493+0000","last_unstale":"2023-10-06T03:10:21.379685+0000","last_undegraded":"2023-10-06T03:10:21.379685+0000","last_fullsized":"2023-10-06T03:10:21.379685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'135","last_scrub_stamp":"2023-10-06T03:10:21.379356+0000","last_deep_scrub":"26'135","last_deep_scrub_stamp":"2023-10-06T03:10:21.379356+0000","last_clean_scrub_stamp":"2023-10-06T03:10:21.379356+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:27.519351+0000","scrub_duration":0.0037082560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"26'94","reported_seq":116,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:22.071844+0000","last_change":"2023-10-06T03:10:22.071705+0000","last_active":"2023-10-06T03:10:22.071844+0000","last_peered":"2023-10-06T03:10:22.071844+0000","last_clean":"2023-10-06T03:10:22.071844+0000","last_became_active":"2023-10-06T02:59:53.676410+0000","last_became_peered":"2023-10-06T02:59:53.676410+0000","last_unstale":"2023-10-06T03:10:22.071844+0000","last_undegraded":"2023-10-06T03:10:22.071844+0000","last_fullsized":"2023-10-06T03:10:22.071844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'94","last_scrub_stamp":"2023-10-06T03:10:22.071378+0000","last_deep_scrub":"26'94","last_deep_scrub_stamp":"2023-10-06T03:10:22.071378+0000","last_clean_scrub_stamp":"2023-10-06T03:10:22.071378+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:54:25.809408+0000","scrub_duration":0.0044959429999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"26'122","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:02.171081+0000","last_change":"2023-10-06T03:10:02.171020+0000","last_active":"2023-10-06T03:10:02.171081+0000","last_peered":"2023-10-06T03:10:02.171081+0000","last_clean":"2023-10-06T03:10:02.171081+0000","last_became_active":"2023-10-06T02:59:53.293596+0000","last_became_peered":"2023-10-06T02:59:53.293596+0000","last_unstale":"2023-10-06T03:10:02.171081+0000","last_undegraded":"2023-10-06T03:10:02.171081+0000","last_fullsized":"2023-10-06T03:10:02.171081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'122","last_scrub_stamp":"2023-10-06T03:10:02.170789+0000","last_deep_scrub":"26'122","last_deep_scrub_stamp":"2023-10-06T03:10:02.170789+0000","last_clean_scrub_stamp":"2023-10-06T03:10:02.170789+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:13.974546+0000","scrub_duration":0.004002299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"26'91","reported_seq":113,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:34.127708+0000","last_change":"2023-10-06T03:10:34.127634+0000","last_active":"2023-10-06T03:10:34.127708+0000","last_peered":"2023-10-06T03:10:34.127708+0000","last_clean":"2023-10-06T03:10:34.127708+0000","last_became_active":"2023-10-06T02:59:53.673559+0000","last_became_peered":"2023-10-06T02:59:53.673559+0000","last_unstale":"2023-10-06T03:10:34.127708+0000","last_undegraded":"2023-10-06T03:10:34.127708+0000","last_fullsized":"2023-10-06T03:10:34.127708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'91","last_scrub_stamp":"2023-10-06T03:10:34.127350+0000","last_deep_scrub":"26'91","last_deep_scrub_stamp":"2023-10-06T03:10:34.127350+0000","last_clean_scrub_stamp":"2023-10-06T03:10:34.127350+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:33.185711+0000","scrub_duration":0.0041150700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"26'76","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:14.006345+0000","last_change":"2023-10-06T03:10:14.006299+0000","last_active":"2023-10-06T03:10:14.006345+0000","last_peered":"2023-10-06T03:10:14.006345+0000","last_clean":"2023-10-06T03:10:14.006345+0000","last_became_active":"2023-10-06T02:59:53.674086+0000","last_became_peered":"2023-10-06T02:59:53.674086+0000","last_unstale":"2023-10-06T03:10:14.006345+0000","last_undegraded":"2023-10-06T03:10:14.006345+0000","last_fullsized":"2023-10-06T03:10:14.006345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'76","last_scrub_stamp":"2023-10-06T03:10:14.006109+0000","last_deep_scrub":"26'76","last_deep_scrub_stamp":"2023-10-06T03:10:14.006109+0000","last_clean_scrub_stamp":"2023-10-06T03:10:14.006109+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:41.887624+0000","scrub_duration":0.0031022850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'1577","reported_seq":1600,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:14.100221+0000","last_change":"2023-10-06T03:10:14.100176+0000","last_active":"2023-10-06T03:10:14.100221+0000","last_peered":"2023-10-06T03:10:14.100221+0000","last_clean":"2023-10-06T03:10:14.100221+0000","last_became_active":"2023-10-06T02:59:53.296550+0000","last_became_peered":"2023-10-06T02:59:53.296550+0000","last_unstale":"2023-10-06T03:10:14.100221+0000","last_undegraded":"2023-10-06T03:10:14.100221+0000","last_fullsized":"2023-10-06T03:10:14.100221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1577","last_scrub_stamp":"2023-10-06T03:10:14.100012+0000","last_deep_scrub":"26'1577","last_deep_scrub_stamp":"2023-10-06T03:10:14.100012+0000","last_clean_scrub_stamp":"2023-10-06T03:10:14.100012+0000","objects_scrubbed":2,"log_size":1577,"log_dups_size":0,"ondisk_log_size":1577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:41.981527+0000","scrub_duration":0.036199587999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7633302,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1449,"num_write_kb":8304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'82","reported_seq":94,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.186317+0000","last_change":"2023-10-06T02:59:53.683771+0000","last_active":"2023-10-06T03:09:49.186317+0000","last_peered":"2023-10-06T03:09:49.186317+0000","last_clean":"2023-10-06T03:09:49.186317+0000","last_became_active":"2023-10-06T02:59:53.683458+0000","last_became_peered":"2023-10-06T02:59:53.683458+0000","last_unstale":"2023-10-06T03:09:49.186317+0000","last_undegraded":"2023-10-06T03:09:49.186317+0000","last_fullsized":"2023-10-06T03:09:49.186317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'118","reported_seq":141,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:05.967468+0000","last_change":"2023-10-06T03:10:05.967386+0000","last_active":"2023-10-06T03:10:05.967468+0000","last_peered":"2023-10-06T03:10:05.967468+0000","last_clean":"2023-10-06T03:10:05.967468+0000","last_became_active":"2023-10-06T02:59:53.300797+0000","last_became_peered":"2023-10-06T02:59:53.300797+0000","last_unstale":"2023-10-06T03:10:05.967468+0000","last_undegraded":"2023-10-06T03:10:05.967468+0000","last_fullsized":"2023-10-06T03:10:05.967468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'118","last_scrub_stamp":"2023-10-06T03:10:05.967098+0000","last_deep_scrub":"26'118","last_deep_scrub_stamp":"2023-10-06T03:10:05.967098+0000","last_clean_scrub_stamp":"2023-10-06T03:10:05.967098+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:44.663720+0000","scrub_duration":0.0045722510000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"26'77","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.203952+0000","last_change":"2023-10-06T02:59:53.683576+0000","last_active":"2023-10-06T03:09:49.203952+0000","last_peered":"2023-10-06T03:09:49.203952+0000","last_clean":"2023-10-06T03:09:49.203952+0000","last_became_active":"2023-10-06T02:59:53.683301+0000","last_became_peered":"2023-10-06T02:59:53.683301+0000","last_unstale":"2023-10-06T03:09:49.203952+0000","last_undegraded":"2023-10-06T03:09:49.203952+0000","last_fullsized":"2023-10-06T03:09:49.203952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'490","reported_seq":513,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:29.274764+0000","last_change":"2023-10-06T03:10:29.274712+0000","last_active":"2023-10-06T03:10:29.274764+0000","last_peered":"2023-10-06T03:10:29.274764+0000","last_clean":"2023-10-06T03:10:29.274764+0000","last_became_active":"2023-10-06T02:59:53.297724+0000","last_became_peered":"2023-10-06T02:59:53.297724+0000","last_unstale":"2023-10-06T03:10:29.274764+0000","last_undegraded":"2023-10-06T03:10:29.274764+0000","last_fullsized":"2023-10-06T03:10:29.274764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'490","last_scrub_stamp":"2023-10-06T03:10:29.274528+0000","last_deep_scrub":"26'490","last_deep_scrub_stamp":"2023-10-06T03:10:29.274528+0000","last_clean_scrub_stamp":"2023-10-06T03:10:29.274528+0000","objects_scrubbed":1,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:26.102454+0000","scrub_duration":0.021059049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":4283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'74","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:01.727031+0000","last_change":"2023-10-06T03:10:01.726976+0000","last_active":"2023-10-06T03:10:01.727031+0000","last_peered":"2023-10-06T03:10:01.727031+0000","last_clean":"2023-10-06T03:10:01.727031+0000","last_became_active":"2023-10-06T02:59:53.684378+0000","last_became_peered":"2023-10-06T02:59:53.684378+0000","last_unstale":"2023-10-06T03:10:01.727031+0000","last_undegraded":"2023-10-06T03:10:01.727031+0000","last_fullsized":"2023-10-06T03:10:01.727031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'74","last_scrub_stamp":"2023-10-06T03:10:01.726739+0000","last_deep_scrub":"26'74","last_deep_scrub_stamp":"2023-10-06T03:10:01.726739+0000","last_clean_scrub_stamp":"2023-10-06T03:10:01.726739+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:19.568134+0000","scrub_duration":0.0023701149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"26'936","reported_seq":959,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:01.195525+0000","last_change":"2023-10-06T03:10:01.195483+0000","last_active":"2023-10-06T03:10:01.195525+0000","last_peered":"2023-10-06T03:10:01.195525+0000","last_clean":"2023-10-06T03:10:01.195525+0000","last_became_active":"2023-10-06T02:59:53.297471+0000","last_became_peered":"2023-10-06T02:59:53.297471+0000","last_unstale":"2023-10-06T03:10:01.195525+0000","last_undegraded":"2023-10-06T03:10:01.195525+0000","last_fullsized":"2023-10-06T03:10:01.195525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'936","last_scrub_stamp":"2023-10-06T03:10:01.195322+0000","last_deep_scrub":"26'936","last_deep_scrub_stamp":"2023-10-06T03:10:01.195322+0000","last_clean_scrub_stamp":"2023-10-06T03:10:01.195322+0000","objects_scrubbed":1,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:01.239609+0000","scrub_duration":0.024228012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":4592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'78","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:49.204888+0000","last_change":"2023-10-06T02:59:53.679138+0000","last_active":"2023-10-06T03:09:49.204888+0000","last_peered":"2023-10-06T03:09:49.204888+0000","last_clean":"2023-10-06T03:09:49.204888+0000","last_became_active":"2023-10-06T02:59:53.678831+0000","last_became_peered":"2023-10-06T02:59:53.678831+0000","last_unstale":"2023-10-06T03:09:49.204888+0000","last_undegraded":"2023-10-06T03:09:49.204888+0000","last_fullsized":"2023-10-06T03:09:49.204888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:53.257064+0000","last_clean_scrub_stamp":"2023-10-06T02:59:53.257064+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"26'114","reported_seq":137,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:26.476464+0000","last_change":"2023-10-06T03:10:26.476389+0000","last_active":"2023-10-06T03:10:26.476464+0000","last_peered":"2023-10-06T03:10:26.476464+0000","last_clean":"2023-10-06T03:10:26.476464+0000","last_became_active":"2023-10-06T02:59:53.295697+0000","last_became_peered":"2023-10-06T02:59:53.295697+0000","last_unstale":"2023-10-06T03:10:26.476464+0000","last_undegraded":"2023-10-06T03:10:26.476464+0000","last_fullsized":"2023-10-06T03:10:26.476464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'114","last_scrub_stamp":"2023-10-06T03:10:26.476117+0000","last_deep_scrub":"26'114","last_deep_scrub_stamp":"2023-10-06T03:10:26.476117+0000","last_clean_scrub_stamp":"2023-10-06T03:10:26.476117+0000","objects_scrubbed":1,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:54.598101+0000","scrub_duration":0.0072948750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'99","reported_seq":121,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:09.384832+0000","last_change":"2023-10-06T03:10:09.384741+0000","last_active":"2023-10-06T03:10:09.384832+0000","last_peered":"2023-10-06T03:10:09.384832+0000","last_clean":"2023-10-06T03:10:09.384832+0000","last_became_active":"2023-10-06T02:59:53.672629+0000","last_became_peered":"2023-10-06T02:59:53.672629+0000","last_unstale":"2023-10-06T03:10:09.384832+0000","last_undegraded":"2023-10-06T03:10:09.384832+0000","last_fullsized":"2023-10-06T03:10:09.384832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2023-10-06T03:10:09.384456+0000","last_deep_scrub":"26'99","last_deep_scrub_stamp":"2023-10-06T03:10:09.384456+0000","last_clean_scrub_stamp":"2023-10-06T03:10:09.384456+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:37.265971+0000","scrub_duration":0.0040951579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'1074","reported_seq":1097,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:25.484981+0000","last_change":"2023-10-06T03:10:25.484904+0000","last_active":"2023-10-06T03:10:25.484981+0000","last_peered":"2023-10-06T03:10:25.484981+0000","last_clean":"2023-10-06T03:10:25.484981+0000","last_became_active":"2023-10-06T02:59:53.296843+0000","last_became_peered":"2023-10-06T02:59:53.296843+0000","last_unstale":"2023-10-06T03:10:25.484981+0000","last_undegraded":"2023-10-06T03:10:25.484981+0000","last_fullsized":"2023-10-06T03:10:25.484981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1074","last_scrub_stamp":"2023-10-06T03:10:25.484703+0000","last_deep_scrub":"26'1074","last_deep_scrub_stamp":"2023-10-06T03:10:25.484703+0000","last_clean_scrub_stamp":"2023-10-06T03:10:25.484703+0000","objects_scrubbed":3,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:30.945538+0000","scrub_duration":0.040221699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":8534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"26'89","reported_seq":111,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:33.170566+0000","last_change":"2023-10-06T03:10:33.170491+0000","last_active":"2023-10-06T03:10:33.170566+0000","last_peered":"2023-10-06T03:10:33.170566+0000","last_clean":"2023-10-06T03:10:33.170566+0000","last_became_active":"2023-10-06T02:59:53.673662+0000","last_became_peered":"2023-10-06T02:59:53.673662+0000","last_unstale":"2023-10-06T03:10:33.170566+0000","last_undegraded":"2023-10-06T03:10:33.170566+0000","last_fullsized":"2023-10-06T03:10:33.170566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'89","last_scrub_stamp":"2023-10-06T03:10:33.170232+0000","last_deep_scrub":"26'89","last_deep_scrub_stamp":"2023-10-06T03:10:33.170232+0000","last_clean_scrub_stamp":"2023-10-06T03:10:33.170232+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:29.998158+0000","scrub_duration":0.0040621269999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"26'538","reported_seq":561,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:04.152442+0000","last_change":"2023-10-06T03:10:04.152368+0000","last_active":"2023-10-06T03:10:04.152442+0000","last_peered":"2023-10-06T03:10:04.152442+0000","last_clean":"2023-10-06T03:10:04.152442+0000","last_became_active":"2023-10-06T02:59:53.298881+0000","last_became_peered":"2023-10-06T02:59:53.298881+0000","last_unstale":"2023-10-06T03:10:04.152442+0000","last_undegraded":"2023-10-06T03:10:04.152442+0000","last_fullsized":"2023-10-06T03:10:04.152442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'538","last_scrub_stamp":"2023-10-06T03:10:04.152201+0000","last_deep_scrub":"26'538","last_deep_scrub_stamp":"2023-10-06T03:10:04.152201+0000","last_clean_scrub_stamp":"2023-10-06T03:10:04.152201+0000","objects_scrubbed":1,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:04.196488+0000","scrub_duration":0.023718249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'87","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:15.347106+0000","last_change":"2023-10-06T03:10:15.347035+0000","last_active":"2023-10-06T03:10:15.347106+0000","last_peered":"2023-10-06T03:10:15.347106+0000","last_clean":"2023-10-06T03:10:15.347106+0000","last_became_active":"2023-10-06T02:59:53.675092+0000","last_became_peered":"2023-10-06T02:59:53.675092+0000","last_unstale":"2023-10-06T03:10:15.347106+0000","last_undegraded":"2023-10-06T03:10:15.347106+0000","last_fullsized":"2023-10-06T03:10:15.347106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'87","last_scrub_stamp":"2023-10-06T03:10:15.346771+0000","last_deep_scrub":"26'87","last_deep_scrub_stamp":"2023-10-06T03:10:15.346771+0000","last_clean_scrub_stamp":"2023-10-06T03:10:15.346771+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:42.790125+0000","scrub_duration":0.0041187369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"26'555","reported_seq":578,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:17.213065+0000","last_change":"2023-10-06T03:10:17.213012+0000","last_active":"2023-10-06T03:10:17.213065+0000","last_peered":"2023-10-06T03:10:17.213065+0000","last_clean":"2023-10-06T03:10:17.213065+0000","last_became_active":"2023-10-06T02:59:53.293752+0000","last_became_peered":"2023-10-06T02:59:53.293752+0000","last_unstale":"2023-10-06T03:10:17.213065+0000","last_undegraded":"2023-10-06T03:10:17.213065+0000","last_fullsized":"2023-10-06T03:10:17.213065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'555","last_scrub_stamp":"2023-10-06T03:10:17.212836+0000","last_deep_scrub":"26'555","last_deep_scrub_stamp":"2023-10-06T03:10:17.212836+0000","last_clean_scrub_stamp":"2023-10-06T03:10:17.212836+0000","objects_scrubbed":3,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:55.054409+0000","scrub_duration":0.024957905999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":438,"num_write_kb":4309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":75513604,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":11546,"num_write_kb":80285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151085056,"data_stored":151027208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15227,"ondisk_log_size":15227,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574984,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314548,"kb_used_data":17260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057292,"statfs":{"total":96636764160,"available":96314667008,"internally_reserved":0,"allocated":17674240,"data_stored":17475112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.90600000000000003,"15min":0.85699999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.41099999999999998},"max":{"1min":1.2789999999999999,"5min":1.893,"15min":1.893},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0029999999999999,"15min":0.98899999999999999},"min":{"1min":0.61699999999999999,"5min":0.54500000000000004,"15min":0.48099999999999998},"max":{"1min":1.2370000000000001,"5min":1.8,"15min":1.8},"last":1.2030000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.91500000000000004,"15min":0.92800000000000005},"min":{"1min":0.54600000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.266,"5min":1.349,"15min":1.389},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81499999999999995,"15min":0.82499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.38500000000000001},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.2350000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.91400000000000003,"15min":0.95499999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.55800000000000005},"max":{"1min":1.0469999999999999,"5min":1.333,"15min":1.4199999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.0700000000000001,"15min":1.1299999999999999},"min":{"1min":0.77100000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3160000000000001,"5min":1.3779999999999999,"15min":1.6359999999999999},"last":1.302}]},{"osd":3,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.93400000000000005,"15min":0.95099999999999996},"min":{"1min":0.56599999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.609,"5min":3.609,"15min":3.609},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0669999999999999,"15min":1.0900000000000001},"min":{"1min":0.75800000000000001,"5min":0.68200000000000005,"15min":0.66900000000000004},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.1160000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.89200000000000002,"15min":0.91300000000000003},"min":{"1min":0.67900000000000005,"5min":0.624,"15min":0.50600000000000001},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0049999999999999,"15min":1.044},"min":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.57499999999999996},"max":{"1min":1.3919999999999999,"5min":1.395,"15min":1.4590000000000001},"last":1.2689999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0640000000000001,"15min":1.1459999999999999},"min":{"1min":0.90600000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.425,"5min":1.51,"15min":1.833},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.0229999999999999,"15min":1.0529999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.59199999999999997},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.048}]},{"osd":6,"last update":"Fri Oct 6 03:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.093,"15min":1.1180000000000001},"min":{"1min":0.92200000000000004,"5min":0.73799999999999999,"15min":0.71399999999999997},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1499999999999999,"15min":1.1850000000000001},"min":{"1min":0.90700000000000003,"5min":0.78100000000000003,"15min":0.76100000000000001},"max":{"1min":1.5660000000000001,"5min":1.5669999999999999,"15min":1.5860000000000001},"last":1.353}]}]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309848,"kb_used_data":4368,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94061992,"statfs":{"total":96636764160,"available":96319479808,"internally_reserved":0,"allocated":4472832,"data_stored":4300972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.92900000000000005,"15min":1.012},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.548,"5min":1.548,"15min":6.6989999999999998},"last":1.248},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.98999999999999999,"15min":1.0780000000000001},"min":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.53200000000000003},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":6.9199999999999999},"last":0.92400000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86799999999999999,"15min":0.879},"min":{"1min":0.60599999999999998,"5min":0.56100000000000005,"15min":0.434},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.879,"15min":0.89000000000000001},"min":{"1min":0.55100000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.1879999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.65600000000000003,"5min":0.55700000000000005,"15min":0.51700000000000002},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.745},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90700000000000003,"15min":0.93700000000000006},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.0469999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.95899999999999996,"15min":0.94399999999999995},"min":{"1min":0.71399999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5820000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.141,"5min":1.0069999999999999,"15min":1.018},"min":{"1min":0.79200000000000004,"5min":0.65300000000000002,"15min":0.52500000000000002},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":1.0129999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.91500000000000004,"15min":1.266},"min":{"1min":0.64000000000000001,"5min":0.57499999999999996,"15min":0.56000000000000005},"max":{"1min":1.5449999999999999,"5min":1.7609999999999999,"15min":17.757000000000001},"last":1.097},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.1180000000000001,"15min":1.4550000000000001},"min":{"1min":0.92700000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.734,"5min":2.734,"15min":17.382999999999999},"last":1.0840000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.016,"15min":1.121},"min":{"1min":0.72599999999999998,"5min":0.64800000000000002,"15min":0.61599999999999999},"max":{"1min":2.548,"5min":2.548,"15min":4.3090000000000002},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.1639999999999999,"15min":1.2430000000000001},"min":{"1min":0.876,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":3.3500000000000001,"5min":3.3500000000000001,"15min":4.5709999999999997},"last":1.2929999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.1000000000000001,"15min":1.147},"min":{"1min":0.97899999999999998,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.476,"5min":2.476,"15min":2.476},"last":1.125},{"interface":"front","average":{"1min":1.232,"5min":1.141,"15min":1.1739999999999999},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":3.919,"5min":3.919,"15min":3.919},"last":1.159}]}]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326240,"kb_used_data":24856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94045600,"statfs":{"total":96636764160,"available":96302694400,"internally_reserved":0,"allocated":25452544,"data_stored":25273116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.876,"15min":0.88400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.40799999999999997},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2849999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.96799999999999997,"15min":1.0009999999999999},"min":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.54800000000000004},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.1200000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.874,"15min":0.88600000000000001},"min":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.321,"5min":1.321,"15min":1.363},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.90600000000000003,"15min":0.90500000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2230000000000001,"5min":1.2669999999999999,"15min":1.2689999999999999},"last":0.70299999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.879,"15min":0.89900000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.53400000000000003},"max":{"1min":1.2030000000000001,"5min":1.27,"15min":1.405},"last":1.2},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.98099999999999998,"15min":0.98599999999999999},"min":{"1min":0.72599999999999998,"5min":0.59399999999999997,"15min":0.44500000000000001},"max":{"1min":1.2230000000000001,"5min":1.4610000000000001,"15min":1.6220000000000001},"last":0.83299999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.95799999999999996,"15min":0.95399999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"max":{"1min":1.298,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0529999999999999,"15min":1.0449999999999999},"min":{"1min":0.80100000000000005,"5min":0.72199999999999998,"15min":0.68999999999999995},"max":{"1min":1.278,"5min":1.3720000000000001,"15min":1.53},"last":0.91700000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.94299999999999995,"15min":0.92900000000000005},"min":{"1min":0.71499999999999997,"5min":0.61399999999999999,"15min":0.46999999999999997},"max":{"1min":1.3340000000000001,"5min":1.446,"15min":1.446},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.167,"5min":1.0920000000000001,"15min":1.075},"min":{"1min":0.89900000000000002,"5min":0.68400000000000005,"15min":0.60599999999999998},"max":{"1min":1.577,"5min":1.577,"15min":1.657},"last":1.298}]},{"osd":6,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0800000000000001,"15min":1.05},"min":{"1min":0.80700000000000005,"5min":0.68600000000000005,"15min":0.58399999999999996},"max":{"1min":1.3069999999999999,"5min":1.546,"15min":1.546},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.1080000000000001,"15min":1.083},"min":{"1min":0.878,"5min":0.77200000000000002,"15min":0.441},"max":{"1min":1.4119999999999999,"5min":1.538,"15min":1.538},"last":1.0549999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.155,"15min":1.1659999999999999},"min":{"1min":0.82799999999999996,"5min":0.748,"15min":0.748},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.542},"last":1.605},{"interface":"front","average":{"1min":1.22,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.95399999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.401,"5min":1.637,"15min":2.048},"last":1.161}]}]},{"osd":4,"up_from":13,"seq":55834574985,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335192,"kb_used_data":29712,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94036648,"statfs":{"total":96636764160,"available":96293527552,"internally_reserved":0,"allocated":30425088,"data_stored":30237520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.55200000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0629999999999999,"5min":1.302,"15min":1.4830000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.89200000000000002,"15min":0.92300000000000004},"min":{"1min":0.56499999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.5289999999999999},"last":1.075}]},{"osd":1,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86199999999999999,"15min":0.86799999999999999},"min":{"1min":0.52200000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.879,"15min":0.88900000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.49199999999999999},"max":{"1min":1.091,"5min":1.387,"15min":1.387},"last":0.89200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94699999999999995,"15min":0.96499999999999997},"min":{"1min":0.59299999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.4159999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.75600000000000001,"5min":0.63900000000000001,"15min":0.53700000000000003},"max":{"1min":1.3049999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.0329999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.94899999999999995,"15min":0.97099999999999997},"min":{"1min":0.66300000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3759999999999999,"5min":1.3839999999999999,"15min":1.3859999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97299999999999998,"15min":0.999},"min":{"1min":0.61899999999999999,"5min":0.57399999999999995,"15min":0.56200000000000006},"max":{"1min":1.351,"5min":1.625,"15min":1.625},"last":0.82799999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92000000000000004,"15min":0.95399999999999996},"min":{"1min":0.53400000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.0309999999999999,"15min":1.075},"min":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4610000000000001,"5min":1.526,"15min":1.526},"last":0.84799999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.018,"15min":1.0549999999999999},"min":{"1min":0.71399999999999997,"5min":0.629,"15min":0.61299999999999999},"max":{"1min":1.3839999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.046,"15min":1.083},"min":{"1min":0.71399999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.1160000000000001,"15min":1.1699999999999999},"min":{"1min":0.82099999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4970000000000001,"5min":1.5629999999999999,"15min":1.7629999999999999},"last":0.745},{"interface":"front","average":{"1min":1.208,"5min":1.1619999999999999,"15min":1.2050000000000001},"min":{"1min":0.84599999999999997,"5min":0.753,"15min":0.56299999999999994},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.91900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333692,"kb_used_data":28212,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94038148,"statfs":{"total":96636764160,"available":96295063552,"internally_reserved":0,"allocated":28889088,"data_stored":28711580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1899999999999999,"5min":1.27,"15min":1.464},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.746,"15min":0.72299999999999998},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.252,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.82399999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.71599999999999997,"15min":0.95299999999999996},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.96299999999999997,"5min":1.3049999999999999,"15min":10.970000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.143,"5min":1.694,"15min":1.694},"last":0.91300000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81100000000000005,"15min":0.85899999999999999},"min":{"1min":0.48599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.999,"5min":1.2110000000000001,"15min":1.6419999999999999},"last":0.87},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.89000000000000001,"15min":0.92400000000000004},"min":{"1min":0.52100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.212,"5min":1.323,"15min":1.333},"last":0.79200000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.96699999999999997,"15min":1.01},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4099999999999999,"5min":1.855,"15min":1.855},"last":1.272},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0760000000000001,"15min":1.1379999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.421,"5min":1.421,"15min":2.3570000000000002},"last":0.96899999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0349999999999999,"15min":1.1080000000000001},"min":{"1min":0.76300000000000001,"5min":0.621,"15min":0.61099999999999999},"max":{"1min":1.357,"5min":1.518,"15min":2.218},"last":1.03},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.109,"15min":1.2609999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.4850000000000001,"5min":1.5649999999999999,"15min":5.585},"last":1.2250000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":1.071,"15min":1.2050000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4510000000000001,"5min":1.9490000000000001,"15min":5.0860000000000003},"last":1.006},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.163,"15min":1.218},"min":{"1min":0.81599999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.468,"5min":1.6679999999999999,"15min":2.3069999999999999},"last":1.1639999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:09:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.196,"15min":1.3300000000000001},"min":{"1min":0.81100000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4299999999999999,"5min":1.8500000000000001,"15min":5.6239999999999997},"last":1.093},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.157,"15min":1.262},"min":{"1min":0.69899999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.353,"5min":2.0950000000000002,"15min":5.1310000000000002},"last":1.119}]}]},{"osd":2,"up_from":13,"seq":55834574985,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318040,"kb_used_data":8464,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94053800,"statfs":{"total":96636764160,"available":96311091200,"internally_reserved":0,"allocated":8667136,"data_stored":8495276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64700000000000002,"15min":0.69899999999999995},"min":{"1min":0.33300000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.99099999999999999,"5min":1.038,"15min":1.4019999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.70599999999999996,"15min":0.749},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82099999999999995,"5min":1.323,"15min":1.8799999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.52000000000000002,"5min":0.375,"15min":0.33300000000000002},"max":{"1min":1.0920000000000001,"5min":1.224,"15min":1.224},"last":1.01},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84299999999999997,"15min":0.83999999999999997},"min":{"1min":0.37,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1180000000000001,"5min":1.252,"15min":1.341},"last":0.74299999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85199999999999998,"15min":0.86599999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.145,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.91200000000000003,"15min":0.96999999999999997},"min":{"1min":0.57899999999999996,"5min":0.46999999999999997,"15min":0.46000000000000002},"max":{"1min":1.2130000000000001,"5min":1.329,"15min":1.587},"last":0.95899999999999996}]},{"osd":4,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.96899999999999997,"15min":1.0229999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6779999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.077,"15min":1.105},"min":{"1min":0.82799999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.611,"5min":1.6419999999999999,"15min":1.9350000000000001},"last":1.1659999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.119,"15min":1.1439999999999999},"min":{"1min":0.75900000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.0700000000000001,"15min":1.111},"min":{"1min":0.63,"5min":0.63,"15min":0.60499999999999998},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":2.048},"last":0.90800000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.149,"15min":1.1950000000000001},"min":{"1min":0.81399999999999995,"5min":0.70499999999999996,"15min":0.68600000000000005},"max":{"1min":1.548,"5min":1.6379999999999999,"15min":2.7040000000000002},"last":1.361},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.198,"15min":1.2410000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.677,"5min":1.677,"15min":2.2000000000000002},"last":1.3240000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:09:56 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.1399999999999999,"15min":1.2150000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":2.286},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2350000000000001,"15min":1.29},"min":{"1min":1.008,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4770000000000001,"5min":1.669,"15min":2.3940000000000001},"last":1.4510000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313944,"kb_used_data":16656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057896,"statfs":{"total":96636764160,"available":96315285504,"internally_reserved":0,"allocated":17055744,"data_stored":16883884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.69199999999999995,"15min":0.68300000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.23599999999999999},"max":{"1min":0.873,"5min":1.179,"15min":1.179},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79900000000000004,"15min":0.79600000000000004},"min":{"1min":0.434,"5min":0.42299999999999999,"15min":0.39300000000000002},"max":{"1min":0.99399999999999999,"5min":1.218,"15min":1.3089999999999999},"last":1.085}]},{"osd":2,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69699999999999995,"15min":0.70099999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.264,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.83499999999999996,"15min":0.85799999999999998},"min":{"1min":0.54600000000000004,"5min":0.42299999999999999,"15min":0.36599999999999999},"max":{"1min":1.222,"5min":1.3109999999999999,"15min":1.3169999999999999},"last":0.94599999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91900000000000004,"15min":0.88300000000000001},"min":{"1min":0.63100000000000001,"5min":0.5,"15min":0.42299999999999999},"max":{"1min":1.226,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.54000000000000004,"5min":0.503,"15min":0.49199999999999999},"max":{"1min":1.119,"5min":1.2270000000000001,"15min":1.337},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.95299999999999996,"15min":0.97699999999999998},"min":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.51300000000000001},"max":{"1min":1.3540000000000001,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.876},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.129,"15min":1.1040000000000001},"min":{"1min":0.68600000000000005,"5min":0.65800000000000003,"15min":0.437},"max":{"1min":1.4299999999999999,"5min":1.556,"15min":1.6060000000000001},"last":1.288}]},{"osd":5,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0680000000000001,"15min":1.0760000000000001},"min":{"1min":0.76300000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4239999999999999,"5min":1.587,"15min":1.587},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.081,"15min":1.075},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.61199999999999999},"max":{"1min":1.496,"5min":1.911,"15min":1.911},"last":0.98899999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.155,"15min":1.1519999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.70499999999999996},"max":{"1min":1.591,"5min":2.081,"15min":2.081},"last":1.397},{"interface":"front","average":{"1min":1.159,"5min":1.1359999999999999,"15min":1.163},"min":{"1min":0.79000000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4950000000000001,"5min":1.996,"15min":1.996},"last":1.163}]},{"osd":7,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.206,"15min":1.1990000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.498},"max":{"1min":1.472,"5min":1.6879999999999999,"15min":1.8999999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.2090000000000001,"15min":1.2230000000000001},"min":{"1min":0.82499999999999996,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.5009999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.4470000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574985,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322736,"kb_used_data":21352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94049104,"statfs":{"total":96636764160,"available":96306282496,"internally_reserved":0,"allocated":21864448,"data_stored":21683828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.68500000000000005,"15min":0.66900000000000004},"min":{"1min":0.38200000000000001,"5min":0.30199999999999999,"15min":0.26900000000000002},"max":{"1min":0.72799999999999998,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.755,"15min":0.747},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.34899999999999998},"max":{"1min":1.0429999999999999,"5min":1.2290000000000001,"15min":1.2849999999999999},"last":0.94199999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.504,"5min":0.40600000000000003,"15min":0.33900000000000002},"max":{"1min":1.04,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.69599999999999995,"15min":0.71099999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.871,"5min":1.0720000000000001,"15min":1.2669999999999999},"last":0.79300000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83199999999999996,"15min":0.81200000000000006},"min":{"1min":0.59399999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0940000000000001,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.89200000000000002,"15min":0.92000000000000004},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.34599999999999997},"max":{"1min":1.159,"5min":1.3580000000000001,"15min":1.599},"last":0.85499999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.92100000000000004,"15min":0.94799999999999995},"min":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.179,"5min":1.5129999999999999,"15min":1.52},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.091,"15min":1.0960000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.248,"5min":1.859,"15min":1.859},"last":1.002}]},{"osd":5,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.1100000000000001,"15min":1.1299999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3779999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.151,"15min":1.153},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.411,"5min":1.573,"15min":1.573},"last":1.034}]},{"osd":6,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.155,"15min":1.165},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.466,"5min":1.6359999999999999,"15min":1.7050000000000001},"last":1.153},{"interface":"front","average":{"1min":1.014,"5min":1.0880000000000001,"15min":1.105},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3759999999999999,"5min":1.579,"15min":2.1579999999999999},"last":1.264}]},{"osd":7,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1479999999999999,"15min":1.1539999999999999},"min":{"1min":0.78500000000000003,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.4359999999999999,"5min":1.7090000000000001,"15min":2.2480000000000002},"last":1.333},{"interface":"front","average":{"1min":1.079,"5min":1.2190000000000001,"15min":1.2370000000000001},"min":{"1min":0.64700000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.329,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.2050000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20992000,"data_stored":20986792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28610560,"data_stored":28604912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30146560,"data_stored":30130852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16801792,"data_stored":16778076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:10:43.338 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.338 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.339 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.339 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.339 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.339 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.339 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.339 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.340 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.340 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.340 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.340 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.340 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.340 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.340 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.340 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.341 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.341 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.341 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.342 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.342 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.342 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.342 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-06T02:59:53.257064+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=59, tm_sec=53, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=9, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:10:43.342 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T03:10:52.762 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:10:52.765 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:10:52.767 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:10:52.770 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:10:52.772 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:11:03.344 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:11:03.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.455+0000 7f6899ee9700 1 Processor -- start 2023-10-06T03:11:03.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.455+0000 7f6899ee9700 1 -- start start 2023-10-06T03:11:03.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f6899ee9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689406c930 0x7f689406d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:03.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f6899ee9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68940bb080 0x7f689414ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:03.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f6899ee9700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689406d990 con 0x7f689414d1f0 2023-10-06T03:11:03.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f6899ee9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689406dc50 con 0x7f68940bb080 2023-10-06T03:11:03.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f6899ee9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689406df30 con 0x7f689406c930 2023-10-06T03:11:03.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f68996e8700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f689414d1f0 0x7f68940695f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51678/0 (socket says 172.21.15.27:51678) 2023-10-06T03:11:03.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f68996e8700 1 -- 172.21.15.27:0/3173676998 learned_addr learned my addr 172.21.15.27:0/3173676998 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:11:03.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f6898ee7700 1 --2- 172.21.15.27:0/3173676998 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689406c930 0x7f689406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:03.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f6893fff700 1 --2- 172.21.15.27:0/3173676998 >> v2:172.21.15.123:3300/0 conn(0x7f68940bb080 0x7f689414ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:03.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f68937fe700 1 -- 172.21.15.27:0/3173676998 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302162182 0 0) 0x7f689406d990 con 0x7f689414d1f0 2023-10-06T03:11:03.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f68937fe700 1 -- 172.21.15.27:0/3173676998 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f687c003570 con 0x7f689414d1f0 2023-10-06T03:11:03.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f6898ee7700 1 -- 172.21.15.27:0/3173676998 >> v2:172.21.15.123:3300/0 conn(0x7f68940bb080 msgr2=0x7f689414ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:11:03.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f6898ee7700 1 --2- 172.21.15.27:0/3173676998 >> v2:172.21.15.123:3300/0 conn(0x7f68940bb080 0x7f689414ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f6898ee7700 1 -- 172.21.15.27:0/3173676998 >> v1:172.21.15.27:6789/0 conn(0x7f689414d1f0 legacy=0x7f68940695f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:03.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f68937fe700 1 -- 172.21.15.27:0/3173676998 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2008034093 0 0) 0x7f687c003570 con 0x7f689414d1f0 2023-10-06T03:11:03.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f6898ee7700 1 -- 172.21.15.27:0/3173676998 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689406cd00 con 0x7f689406c930 2023-10-06T03:11:03.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f6893fff700 1 --2- 172.21.15.27:0/3173676998 >> v2:172.21.15.123:3300/0 conn(0x7f68940bb080 0x7f689414ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:11:03.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f6898ee7700 1 --2- 172.21.15.27:0/3173676998 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689406c930 0x7f689406d450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6884009e60 tx=0x7f6884009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=259be48c25045e58 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f68937fe700 1 -- 172.21.15.27:0/3173676998 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688400e070 con 0x7f689406c930 2023-10-06T03:11:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f68937fe700 1 -- 172.21.15.27:0/3173676998 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688400b7a0 con 0x7f689406c930 2023-10-06T03:11:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.459+0000 7f68937fe700 1 -- 172.21.15.27:0/3173676998 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c001470 con 0x7f689406c930 2023-10-06T03:11:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.463+0000 7f6899ee9700 1 -- 172.21.15.27:0/3173676998 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689406c930 msgr2=0x7f689406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.463+0000 7f6899ee9700 1 --2- 172.21.15.27:0/3173676998 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689406c930 0x7f689406d450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6884009e60 tx=0x7f6884009780 comp rx=0 tx=0).stop 2023-10-06T03:11:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.463+0000 7f6899ee9700 1 -- 172.21.15.27:0/3173676998 shutdown_connections 2023-10-06T03:11:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.463+0000 7f6899ee9700 1 --2- 172.21.15.27:0/3173676998 >> v2:172.21.15.123:3300/0 conn(0x7f68940bb080 0x7f689414ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.463+0000 7f6899ee9700 1 --2- 172.21.15.27:0/3173676998 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689406c930 0x7f689406d450 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.463+0000 7f6899ee9700 1 -- 172.21.15.27:0/3173676998 >> 172.21.15.27:0/3173676998 conn(0x7f6894067b30 msgr2=0x7f68940bec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:03.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.463+0000 7f6899ee9700 1 -- 172.21.15.27:0/3173676998 shutdown_connections 2023-10-06T03:11:03.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.463+0000 7f6899ee9700 1 -- 172.21.15.27:0/3173676998 wait complete. 2023-10-06T03:11:03.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.463+0000 7f6899ee9700 1 Processor -- start 2023-10-06T03:11:03.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.463+0000 7f6899ee9700 1 -- start start 2023-10-06T03:11:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.463+0000 7f6899ee9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689406c930 0x7f68940bd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6899ee9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68940bb080 0x7f689415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6899ee9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f689414d1f0 0x7f6894143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6899ee9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6894148470 con 0x7f68940bb080 2023-10-06T03:11:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6899ee9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68941595e0 con 0x7f689414d1f0 2023-10-06T03:11:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6899ee9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68940bd0f0 con 0x7f689406c930 2023-10-06T03:11:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6893fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68940bb080 0x7f689415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6893fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68940bb080 0x7f689415d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42136/0 (socket says 172.21.15.27:42136) 2023-10-06T03:11:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6893fff700 1 -- 172.21.15.27:0/607042076 learned_addr learned my addr 172.21.15.27:0/607042076 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:11:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6898ee7700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689406c930 0x7f68940bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f68996e8700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f689414d1f0 0x7f6894143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:03.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6893fff700 1 -- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689406c930 msgr2=0x7f68940bd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:03.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6893fff700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689406c930 0x7f68940bd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6893fff700 1 -- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f689414d1f0 msgr2=0x7f6894143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:03.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6893fff700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f689414d1f0 0x7f6894143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6893fff700 1 -- 172.21.15.27:0/607042076 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6888009420 con 0x7f68940bb080 2023-10-06T03:11:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f68996e8700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f689414d1f0 0x7f6894143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:11:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6893fff700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68940bb080 0x7f689415d2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f688800ec80 tx=0x7f68880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6890ff9700 1 -- 172.21.15.27:0/607042076 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688800c920 con 0x7f68940bb080 2023-10-06T03:11:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6890ff9700 1 -- 172.21.15.27:0/607042076 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688800ca80 con 0x7f68940bb080 2023-10-06T03:11:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6899ee9700 1 -- 172.21.15.27:0/607042076 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6884009a20 con 0x7f68940bb080 2023-10-06T03:11:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6890ff9700 1 -- 172.21.15.27:0/607042076 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688800ce00 con 0x7f68940bb080 2023-10-06T03:11:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6899ee9700 1 -- 172.21.15.27:0/607042076 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68940bce10 con 0x7f68940bb080 2023-10-06T03:11:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.467+0000 7f6899ee9700 1 -- 172.21.15.27:0/607042076 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6894159790 con 0x7f68940bb080 2023-10-06T03:11:03.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.471+0000 7f6890ff9700 1 -- 172.21.15.27:0/607042076 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6888013680 con 0x7f68940bb080 2023-10-06T03:11:03.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.471+0000 7f6890ff9700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6880060550 0x7f6880062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:03.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.471+0000 7f6890ff9700 1 -- 172.21.15.27:0/607042076 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f688807cca0 con 0x7f68940bb080 2023-10-06T03:11:03.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.471+0000 7f6898ee7700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6880060550 0x7f6880062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:03.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.471+0000 7f6898ee7700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6880060550 0x7f6880062a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68840099f0 tx=0x7f6884018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:03.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.479+0000 7f6890ff9700 1 -- 172.21.15.27:0/607042076 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6894159790 con 0x7f68940bb080 2023-10-06T03:11:03.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.635+0000 7f6899ee9700 1 -- 172.21.15.27:0/607042076 --> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6894159790 con 0x7f6880060550 2023-10-06T03:11:03.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.655+0000 7f6890ff9700 1 -- 172.21.15.27:0/607042076 <== mgr.4101 v2:172.21.15.123:6832/33327 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312371 (secure 0 0 0) 0x7f6894159790 con 0x7f6880060550 2023-10-06T03:11:03.661 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:11:03.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.659+0000 7f6899ee9700 1 -- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6880060550 msgr2=0x7f6880062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:03.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.659+0000 7f6899ee9700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6880060550 0x7f6880062a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68840099f0 tx=0x7f6884018000 comp rx=0 tx=0).stop 2023-10-06T03:11:03.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.659+0000 7f6899ee9700 1 -- 172.21.15.27:0/607042076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68940bb080 msgr2=0x7f689415d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:03.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.659+0000 7f6899ee9700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68940bb080 0x7f689415d2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f688800ec80 tx=0x7f68880091a0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.659+0000 7f6899ee9700 1 -- 172.21.15.27:0/607042076 shutdown_connections 2023-10-06T03:11:03.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.659+0000 7f6899ee9700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6880060550 0x7f6880062a00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.659+0000 7f6899ee9700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f689414d1f0 0x7f6894143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.659+0000 7f6899ee9700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68940bb080 0x7f689415d2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.659+0000 7f6899ee9700 1 --2- 172.21.15.27:0/607042076 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689406c930 0x7f68940bd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.659+0000 7f6899ee9700 1 -- 172.21.15.27:0/607042076 >> 172.21.15.27:0/607042076 conn(0x7f6894067b30 msgr2=0x7f68940695f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:03.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.659+0000 7f6899ee9700 1 -- 172.21.15.27:0/607042076 shutdown_connections 2023-10-06T03:11:03.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.659+0000 7f6899ee9700 1 -- 172.21.15.27:0/607042076 wait complete. 2023-10-06T03:11:03.666 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-10-06T03:11:03.679 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2023-10-06T03:11:03.208451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76103972,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":599,"num_read_kb":1179,"num_write":11705,"num_write_kb":82701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20626,"ondisk_log_size":20626,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2574240,"kb_used_data":150880,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752400480,"statfs":{"total":773094113280,"available":770458091520,"internally_reserved":0,"allocated":154501120,"data_stored":153061288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004108"},"pg_stats":[{"pgid":"4.3f","version":"26'91","reported_seq":113,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:07.709957+0000","last_change":"2023-10-06T03:10:07.709876+0000","last_active":"2023-10-06T03:10:07.709957+0000","last_peered":"2023-10-06T03:10:07.709957+0000","last_clean":"2023-10-06T03:10:07.709957+0000","last_became_active":"2023-10-06T02:59:53.681495+0000","last_became_peered":"2023-10-06T02:59:53.681495+0000","last_unstale":"2023-10-06T03:10:07.709957+0000","last_undegraded":"2023-10-06T03:10:07.709957+0000","last_fullsized":"2023-10-06T03:10:07.709957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'91","last_scrub_stamp":"2023-10-06T03:10:07.709583+0000","last_deep_scrub":"26'91","last_deep_scrub_stamp":"2023-10-06T03:10:07.709583+0000","last_clean_scrub_stamp":"2023-10-06T03:10:07.709583+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:21.963561+0000","scrub_duration":0.0038659110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"26'80","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:50.789139+0000","last_change":"2023-10-06T03:10:50.789013+0000","last_active":"2023-10-06T03:10:50.789139+0000","last_peered":"2023-10-06T03:10:50.789139+0000","last_clean":"2023-10-06T03:10:50.789139+0000","last_became_active":"2023-10-06T02:59:53.681849+0000","last_became_peered":"2023-10-06T02:59:53.681849+0000","last_unstale":"2023-10-06T03:10:50.789139+0000","last_undegraded":"2023-10-06T03:10:50.789139+0000","last_fullsized":"2023-10-06T03:10:50.789139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'80","last_scrub_stamp":"2023-10-06T03:10:50.788743+0000","last_deep_scrub":"26'80","last_deep_scrub_stamp":"2023-10-06T03:10:50.788743+0000","last_clean_scrub_stamp":"2023-10-06T03:10:50.788743+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:45.221576+0000","scrub_duration":0.0043966090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"26'65","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:11:00.168107+0000","last_change":"2023-10-06T03:11:00.167982+0000","last_active":"2023-10-06T03:11:00.168107+0000","last_peered":"2023-10-06T03:11:00.168107+0000","last_clean":"2023-10-06T03:11:00.168107+0000","last_became_active":"2023-10-06T02:59:53.678264+0000","last_became_peered":"2023-10-06T02:59:53.678264+0000","last_unstale":"2023-10-06T03:11:00.168107+0000","last_undegraded":"2023-10-06T03:11:00.168107+0000","last_fullsized":"2023-10-06T03:11:00.168107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'65","last_scrub_stamp":"2023-10-06T03:11:00.167697+0000","last_deep_scrub":"26'65","last_deep_scrub_stamp":"2023-10-06T03:11:00.167697+0000","last_clean_scrub_stamp":"2023-10-06T03:11:00.167697+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:33.672094+0000","scrub_duration":0.0045877840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"26'76","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:05.009567+0000","last_change":"2023-10-06T03:10:05.009488+0000","last_active":"2023-10-06T03:10:05.009567+0000","last_peered":"2023-10-06T03:10:05.009567+0000","last_clean":"2023-10-06T03:10:05.009567+0000","last_became_active":"2023-10-06T02:59:53.671555+0000","last_became_peered":"2023-10-06T02:59:53.671555+0000","last_unstale":"2023-10-06T03:10:05.009567+0000","last_undegraded":"2023-10-06T03:10:05.009567+0000","last_fullsized":"2023-10-06T03:10:05.009567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'76","last_scrub_stamp":"2023-10-06T03:10:05.009230+0000","last_deep_scrub":"26'76","last_deep_scrub_stamp":"2023-10-06T03:10:05.009230+0000","last_clean_scrub_stamp":"2023-10-06T03:10:05.009230+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:16.812988+0000","scrub_duration":0.0043911949999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"26'85","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:44.111835+0000","last_change":"2023-10-06T03:10:44.111737+0000","last_active":"2023-10-06T03:10:44.111835+0000","last_peered":"2023-10-06T03:10:44.111835+0000","last_clean":"2023-10-06T03:10:44.111835+0000","last_became_active":"2023-10-06T02:59:53.682399+0000","last_became_peered":"2023-10-06T02:59:53.682399+0000","last_unstale":"2023-10-06T03:10:44.111835+0000","last_undegraded":"2023-10-06T03:10:44.111835+0000","last_fullsized":"2023-10-06T03:10:44.111835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'85","last_scrub_stamp":"2023-10-06T03:10:44.111455+0000","last_deep_scrub":"26'85","last_deep_scrub_stamp":"2023-10-06T03:10:44.111455+0000","last_clean_scrub_stamp":"2023-10-06T03:10:44.111455+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:28.745687+0000","scrub_duration":0.0042013179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"26'80","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:59.155042+0000","last_change":"2023-10-06T03:10:59.154939+0000","last_active":"2023-10-06T03:10:59.155042+0000","last_peered":"2023-10-06T03:10:59.155042+0000","last_clean":"2023-10-06T03:10:59.155042+0000","last_became_active":"2023-10-06T02:59:53.676481+0000","last_became_peered":"2023-10-06T02:59:53.676481+0000","last_unstale":"2023-10-06T03:10:59.155042+0000","last_undegraded":"2023-10-06T03:10:59.155042+0000","last_fullsized":"2023-10-06T03:10:59.155042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'80","last_scrub_stamp":"2023-10-06T03:10:59.154660+0000","last_deep_scrub":"26'80","last_deep_scrub_stamp":"2023-10-06T03:10:59.154660+0000","last_clean_scrub_stamp":"2023-10-06T03:10:59.154660+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:48.024826+0000","scrub_duration":0.0045549320000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"26'93","reported_seq":115,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:47.393383+0000","last_change":"2023-10-06T03:10:47.393288+0000","last_active":"2023-10-06T03:10:47.393383+0000","last_peered":"2023-10-06T03:10:47.393383+0000","last_clean":"2023-10-06T03:10:47.393383+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:10:47.393383+0000","last_undegraded":"2023-10-06T03:10:47.393383+0000","last_fullsized":"2023-10-06T03:10:47.393383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'93","last_scrub_stamp":"2023-10-06T03:10:47.393028+0000","last_deep_scrub":"26'93","last_deep_scrub_stamp":"2023-10-06T03:10:47.393028+0000","last_clean_scrub_stamp":"2023-10-06T03:10:47.393028+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:12.817674+0000","scrub_duration":0.004786261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"26'77","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:45.726848+0000","last_change":"2023-10-06T03:10:45.726786+0000","last_active":"2023-10-06T03:10:45.726848+0000","last_peered":"2023-10-06T03:10:45.726848+0000","last_clean":"2023-10-06T03:10:45.726848+0000","last_became_active":"2023-10-06T02:59:53.683524+0000","last_became_peered":"2023-10-06T02:59:53.683524+0000","last_unstale":"2023-10-06T03:10:45.726848+0000","last_undegraded":"2023-10-06T03:10:45.726848+0000","last_fullsized":"2023-10-06T03:10:45.726848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'77","last_scrub_stamp":"2023-10-06T03:10:45.726510+0000","last_deep_scrub":"26'77","last_deep_scrub_stamp":"2023-10-06T03:10:45.726510+0000","last_clean_scrub_stamp":"2023-10-06T03:10:45.726510+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:11.151156+0000","scrub_duration":0.0039849899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"26'89","reported_seq":111,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:41.033923+0000","last_change":"2023-10-06T03:10:41.033789+0000","last_active":"2023-10-06T03:10:41.033923+0000","last_peered":"2023-10-06T03:10:41.033923+0000","last_clean":"2023-10-06T03:10:41.033923+0000","last_became_active":"2023-10-06T02:59:53.680086+0000","last_became_peered":"2023-10-06T02:59:53.680086+0000","last_unstale":"2023-10-06T03:10:41.033923+0000","last_undegraded":"2023-10-06T03:10:41.033923+0000","last_fullsized":"2023-10-06T03:10:41.033923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'89","last_scrub_stamp":"2023-10-06T03:10:41.033478+0000","last_deep_scrub":"26'89","last_deep_scrub_stamp":"2023-10-06T03:10:41.033478+0000","last_clean_scrub_stamp":"2023-10-06T03:10:41.033478+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:46.314040+0000","scrub_duration":0.0042084009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"26'73","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:38.588274+0000","last_change":"2023-10-06T03:10:38.588170+0000","last_active":"2023-10-06T03:10:38.588274+0000","last_peered":"2023-10-06T03:10:38.588274+0000","last_clean":"2023-10-06T03:10:38.588274+0000","last_became_active":"2023-10-06T02:59:53.675243+0000","last_became_peered":"2023-10-06T02:59:53.675243+0000","last_unstale":"2023-10-06T03:10:38.588274+0000","last_undegraded":"2023-10-06T03:10:38.588274+0000","last_fullsized":"2023-10-06T03:10:38.588274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'73","last_scrub_stamp":"2023-10-06T03:10:38.587913+0000","last_deep_scrub":"26'73","last_deep_scrub_stamp":"2023-10-06T03:10:38.587913+0000","last_clean_scrub_stamp":"2023-10-06T03:10:38.587913+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:24.915221+0000","scrub_duration":0.0046023369999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"26'79","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:51.158594+0000","last_change":"2023-10-06T03:10:51.158526+0000","last_active":"2023-10-06T03:10:51.158594+0000","last_peered":"2023-10-06T03:10:51.158594+0000","last_clean":"2023-10-06T03:10:51.158594+0000","last_became_active":"2023-10-06T02:59:53.678985+0000","last_became_peered":"2023-10-06T02:59:53.678985+0000","last_unstale":"2023-10-06T03:10:51.158594+0000","last_undegraded":"2023-10-06T03:10:51.158594+0000","last_fullsized":"2023-10-06T03:10:51.158594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2023-10-06T03:10:51.158259+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2023-10-06T03:10:51.158259+0000","last_clean_scrub_stamp":"2023-10-06T03:10:51.158259+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:36.458924+0000","scrub_duration":0.0040154969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"26'79","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:08.683966+0000","last_change":"2023-10-06T03:10:08.683851+0000","last_active":"2023-10-06T03:10:08.683966+0000","last_peered":"2023-10-06T03:10:08.683966+0000","last_clean":"2023-10-06T03:10:08.683966+0000","last_became_active":"2023-10-06T02:59:53.682464+0000","last_became_peered":"2023-10-06T02:59:53.682464+0000","last_unstale":"2023-10-06T03:10:08.683966+0000","last_undegraded":"2023-10-06T03:10:08.683966+0000","last_fullsized":"2023-10-06T03:10:08.683966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2023-10-06T03:10:08.683416+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2023-10-06T03:10:08.683416+0000","last_clean_scrub_stamp":"2023-10-06T03:10:08.683416+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:47.380038+0000","scrub_duration":0.0046938989999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"26'84","reported_seq":115,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:06.733722+0000","last_change":"2023-10-06T03:10:06.733648+0000","last_active":"2023-10-06T03:10:06.733722+0000","last_peered":"2023-10-06T03:10:06.733722+0000","last_clean":"2023-10-06T03:10:06.733722+0000","last_became_active":"2023-10-06T03:00:34.741173+0000","last_became_peered":"2023-10-06T03:00:34.741173+0000","last_unstale":"2023-10-06T03:10:06.733722+0000","last_undegraded":"2023-10-06T03:10:06.733722+0000","last_fullsized":"2023-10-06T03:10:06.733722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'84","last_scrub_stamp":"2023-10-06T03:10:06.733358+0000","last_deep_scrub":"26'84","last_deep_scrub_stamp":"2023-10-06T03:10:06.733358+0000","last_clean_scrub_stamp":"2023-10-06T03:10:06.733358+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:54.642666+0000","scrub_duration":0.0043106860000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"26'74","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:35.510642+0000","last_change":"2023-10-06T03:10:35.510575+0000","last_active":"2023-10-06T03:10:35.510642+0000","last_peered":"2023-10-06T03:10:35.510642+0000","last_clean":"2023-10-06T03:10:35.510642+0000","last_became_active":"2023-10-06T02:59:53.672957+0000","last_became_peered":"2023-10-06T02:59:53.672957+0000","last_unstale":"2023-10-06T03:10:35.510642+0000","last_undegraded":"2023-10-06T03:10:35.510642+0000","last_fullsized":"2023-10-06T03:10:35.510642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'74","last_scrub_stamp":"2023-10-06T03:10:35.510297+0000","last_deep_scrub":"26'74","last_deep_scrub_stamp":"2023-10-06T03:10:35.510297+0000","last_clean_scrub_stamp":"2023-10-06T03:10:35.510297+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:34.568658+0000","scrub_duration":0.0045798820000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"26'78","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:36.284084+0000","last_change":"2023-10-06T03:10:36.283994+0000","last_active":"2023-10-06T03:10:36.284084+0000","last_peered":"2023-10-06T03:10:36.284084+0000","last_clean":"2023-10-06T03:10:36.284084+0000","last_became_active":"2023-10-06T02:59:53.686352+0000","last_became_peered":"2023-10-06T02:59:53.686352+0000","last_unstale":"2023-10-06T03:10:36.284084+0000","last_undegraded":"2023-10-06T03:10:36.284084+0000","last_fullsized":"2023-10-06T03:10:36.284084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'78","last_scrub_stamp":"2023-10-06T03:10:36.283722+0000","last_deep_scrub":"26'78","last_deep_scrub_stamp":"2023-10-06T03:10:36.283722+0000","last_clean_scrub_stamp":"2023-10-06T03:10:36.283722+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:35.342083+0000","scrub_duration":0.0042887849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"26'88","reported_seq":110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:50.127206+0000","last_change":"2023-10-06T03:10:50.127132+0000","last_active":"2023-10-06T03:10:50.127206+0000","last_peered":"2023-10-06T03:10:50.127206+0000","last_clean":"2023-10-06T03:10:50.127206+0000","last_became_active":"2023-10-06T02:59:53.678449+0000","last_became_peered":"2023-10-06T02:59:53.678449+0000","last_unstale":"2023-10-06T03:10:50.127206+0000","last_undegraded":"2023-10-06T03:10:50.127206+0000","last_fullsized":"2023-10-06T03:10:50.127206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'88","last_scrub_stamp":"2023-10-06T03:10:50.126869+0000","last_deep_scrub":"26'88","last_deep_scrub_stamp":"2023-10-06T03:10:50.126869+0000","last_clean_scrub_stamp":"2023-10-06T03:10:50.126869+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:24.804914+0000","scrub_duration":0.0045387149999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"26'80","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:32.112002+0000","last_change":"2023-10-06T03:10:32.111930+0000","last_active":"2023-10-06T03:10:32.112002+0000","last_peered":"2023-10-06T03:10:32.112002+0000","last_clean":"2023-10-06T03:10:32.112002+0000","last_became_active":"2023-10-06T02:59:53.680028+0000","last_became_peered":"2023-10-06T02:59:53.680028+0000","last_unstale":"2023-10-06T03:10:32.112002+0000","last_undegraded":"2023-10-06T03:10:32.112002+0000","last_fullsized":"2023-10-06T03:10:32.112002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'80","last_scrub_stamp":"2023-10-06T03:10:32.111623+0000","last_deep_scrub":"26'80","last_deep_scrub_stamp":"2023-10-06T03:10:32.111623+0000","last_clean_scrub_stamp":"2023-10-06T03:10:32.111623+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:31.169984+0000","scrub_duration":0.0044276089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"26'76","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:49.168473+0000","last_change":"2023-10-06T03:10:49.168380+0000","last_active":"2023-10-06T03:10:49.168473+0000","last_peered":"2023-10-06T03:10:49.168473+0000","last_clean":"2023-10-06T03:10:49.168473+0000","last_became_active":"2023-10-06T02:59:53.676602+0000","last_became_peered":"2023-10-06T02:59:53.676602+0000","last_unstale":"2023-10-06T03:10:49.168473+0000","last_undegraded":"2023-10-06T03:10:49.168473+0000","last_fullsized":"2023-10-06T03:10:49.168473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'76","last_scrub_stamp":"2023-10-06T03:10:49.168115+0000","last_deep_scrub":"26'76","last_deep_scrub_stamp":"2023-10-06T03:10:49.168115+0000","last_clean_scrub_stamp":"2023-10-06T03:10:49.168115+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:20.460225+0000","scrub_duration":0.0046140139999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"26'75","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:02.765983+0000","last_change":"2023-10-06T03:10:02.765921+0000","last_active":"2023-10-06T03:10:02.765983+0000","last_peered":"2023-10-06T03:10:02.765983+0000","last_clean":"2023-10-06T03:10:02.765983+0000","last_became_active":"2023-10-06T02:59:53.675657+0000","last_became_peered":"2023-10-06T02:59:53.675657+0000","last_unstale":"2023-10-06T03:10:02.765983+0000","last_undegraded":"2023-10-06T03:10:02.765983+0000","last_fullsized":"2023-10-06T03:10:02.765983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'75","last_scrub_stamp":"2023-10-06T03:10:02.765676+0000","last_deep_scrub":"26'75","last_deep_scrub_stamp":"2023-10-06T03:10:02.765676+0000","last_clean_scrub_stamp":"2023-10-06T03:10:02.765676+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.141625+0000","scrub_duration":0.004252451,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"26'82","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:48.181716+0000","last_change":"2023-10-06T03:10:48.181633+0000","last_active":"2023-10-06T03:10:48.181716+0000","last_peered":"2023-10-06T03:10:48.181716+0000","last_clean":"2023-10-06T03:10:48.181716+0000","last_became_active":"2023-10-06T02:59:53.672690+0000","last_became_peered":"2023-10-06T02:59:53.672690+0000","last_unstale":"2023-10-06T03:10:48.181716+0000","last_undegraded":"2023-10-06T03:10:48.181716+0000","last_fullsized":"2023-10-06T03:10:48.181716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'82","last_scrub_stamp":"2023-10-06T03:10:48.181317+0000","last_deep_scrub":"26'82","last_deep_scrub_stamp":"2023-10-06T03:10:48.181317+0000","last_clean_scrub_stamp":"2023-10-06T03:10:48.181317+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:43:00.459928+0000","scrub_duration":0.0047352719999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"26'83","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:45.411825+0000","last_change":"2023-10-06T03:10:45.411686+0000","last_active":"2023-10-06T03:10:45.411825+0000","last_peered":"2023-10-06T03:10:45.411825+0000","last_clean":"2023-10-06T03:10:45.411825+0000","last_became_active":"2023-10-06T02:59:53.684145+0000","last_became_peered":"2023-10-06T02:59:53.684145+0000","last_unstale":"2023-10-06T03:10:45.411825+0000","last_undegraded":"2023-10-06T03:10:45.411825+0000","last_fullsized":"2023-10-06T03:10:45.411825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'83","last_scrub_stamp":"2023-10-06T03:10:45.411408+0000","last_deep_scrub":"26'83","last_deep_scrub_stamp":"2023-10-06T03:10:45.411408+0000","last_clean_scrub_stamp":"2023-10-06T03:10:45.411408+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:50.691970+0000","scrub_duration":0.0045388299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"26'88","reported_seq":110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:23.116215+0000","last_change":"2023-10-06T03:10:23.116148+0000","last_active":"2023-10-06T03:10:23.116215+0000","last_peered":"2023-10-06T03:10:23.116215+0000","last_clean":"2023-10-06T03:10:23.116215+0000","last_became_active":"2023-10-06T02:59:53.682948+0000","last_became_peered":"2023-10-06T02:59:53.682948+0000","last_unstale":"2023-10-06T03:10:23.116215+0000","last_undegraded":"2023-10-06T03:10:23.116215+0000","last_fullsized":"2023-10-06T03:10:23.116215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'88","last_scrub_stamp":"2023-10-06T03:10:23.115868+0000","last_deep_scrub":"26'88","last_deep_scrub_stamp":"2023-10-06T03:10:23.115868+0000","last_clean_scrub_stamp":"2023-10-06T03:10:23.115868+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:51.237852+0000","scrub_duration":0.0041091720000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"26'69","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:46.201883+0000","last_change":"2023-10-06T03:10:46.201811+0000","last_active":"2023-10-06T03:10:46.201883+0000","last_peered":"2023-10-06T03:10:46.201883+0000","last_clean":"2023-10-06T03:10:46.201883+0000","last_became_active":"2023-10-06T02:59:53.675319+0000","last_became_peered":"2023-10-06T02:59:53.675319+0000","last_unstale":"2023-10-06T03:10:46.201883+0000","last_undegraded":"2023-10-06T03:10:46.201883+0000","last_fullsized":"2023-10-06T03:10:46.201883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'69","last_scrub_stamp":"2023-10-06T03:10:46.201545+0000","last_deep_scrub":"26'69","last_deep_scrub_stamp":"2023-10-06T03:10:46.201545+0000","last_clean_scrub_stamp":"2023-10-06T03:10:46.201545+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:30.835777+0000","scrub_duration":0.0041873650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"26'87","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:39.327345+0000","last_change":"2023-10-06T03:10:39.327243+0000","last_active":"2023-10-06T03:10:39.327345+0000","last_peered":"2023-10-06T03:10:39.327345+0000","last_clean":"2023-10-06T03:10:39.327345+0000","last_became_active":"2023-10-06T02:59:53.686007+0000","last_became_peered":"2023-10-06T02:59:53.686007+0000","last_unstale":"2023-10-06T03:10:39.327345+0000","last_undegraded":"2023-10-06T03:10:39.327345+0000","last_fullsized":"2023-10-06T03:10:39.327345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'87","last_scrub_stamp":"2023-10-06T03:10:39.326988+0000","last_deep_scrub":"26'87","last_deep_scrub_stamp":"2023-10-06T03:10:39.326988+0000","last_clean_scrub_stamp":"2023-10-06T03:10:39.326988+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:49.949628+0000","scrub_duration":0.004449967,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"26'91","reported_seq":113,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:48.021565+0000","last_change":"2023-10-06T03:10:48.021490+0000","last_active":"2023-10-06T03:10:48.021565+0000","last_peered":"2023-10-06T03:10:48.021565+0000","last_clean":"2023-10-06T03:10:48.021565+0000","last_became_active":"2023-10-06T02:59:53.682511+0000","last_became_peered":"2023-10-06T02:59:53.682511+0000","last_unstale":"2023-10-06T03:10:48.021565+0000","last_undegraded":"2023-10-06T03:10:48.021565+0000","last_fullsized":"2023-10-06T03:10:48.021565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'91","last_scrub_stamp":"2023-10-06T03:10:48.021209+0000","last_deep_scrub":"26'91","last_deep_scrub_stamp":"2023-10-06T03:10:48.021209+0000","last_clean_scrub_stamp":"2023-10-06T03:10:48.021209+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:53.301770+0000","scrub_duration":0.0045867039999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"26'98","reported_seq":120,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:26.039280+0000","last_change":"2023-10-06T03:10:26.039202+0000","last_active":"2023-10-06T03:10:26.039280+0000","last_peered":"2023-10-06T03:10:26.039280+0000","last_clean":"2023-10-06T03:10:26.039280+0000","last_became_active":"2023-10-06T02:59:53.681732+0000","last_became_peered":"2023-10-06T02:59:53.681732+0000","last_unstale":"2023-10-06T03:10:26.039280+0000","last_undegraded":"2023-10-06T03:10:26.039280+0000","last_fullsized":"2023-10-06T03:10:26.039280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'98","last_scrub_stamp":"2023-10-06T03:10:26.038889+0000","last_deep_scrub":"26'98","last_deep_scrub_stamp":"2023-10-06T03:10:26.038889+0000","last_clean_scrub_stamp":"2023-10-06T03:10:26.038889+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:03.880462+0000","scrub_duration":0.004522608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"26'80","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:46.774103+0000","last_change":"2023-10-06T03:10:46.774038+0000","last_active":"2023-10-06T03:10:46.774103+0000","last_peered":"2023-10-06T03:10:46.774103+0000","last_clean":"2023-10-06T03:10:46.774103+0000","last_became_active":"2023-10-06T02:59:53.676284+0000","last_became_peered":"2023-10-06T02:59:53.676284+0000","last_unstale":"2023-10-06T03:10:46.774103+0000","last_undegraded":"2023-10-06T03:10:46.774103+0000","last_fullsized":"2023-10-06T03:10:46.774103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'80","last_scrub_stamp":"2023-10-06T03:10:46.773756+0000","last_deep_scrub":"26'80","last_deep_scrub_stamp":"2023-10-06T03:10:46.773756+0000","last_clean_scrub_stamp":"2023-10-06T03:10:46.773756+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:31.407987+0000","scrub_duration":0.0038011519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"26'61","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:29.093305+0000","last_change":"2023-10-06T03:10:29.093236+0000","last_active":"2023-10-06T03:10:29.093305+0000","last_peered":"2023-10-06T03:10:29.093305+0000","last_clean":"2023-10-06T03:10:29.093305+0000","last_became_active":"2023-10-06T02:59:53.686912+0000","last_became_peered":"2023-10-06T02:59:53.686912+0000","last_unstale":"2023-10-06T03:10:29.093305+0000","last_undegraded":"2023-10-06T03:10:29.093305+0000","last_fullsized":"2023-10-06T03:10:29.093305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'61","last_scrub_stamp":"2023-10-06T03:10:29.092966+0000","last_deep_scrub":"26'61","last_deep_scrub_stamp":"2023-10-06T03:10:29.092966+0000","last_clean_scrub_stamp":"2023-10-06T03:10:29.092966+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:54:32.830996+0000","scrub_duration":0.0041196959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"26'87","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:43.163026+0000","last_change":"2023-10-06T03:10:43.162977+0000","last_active":"2023-10-06T03:10:43.163026+0000","last_peered":"2023-10-06T03:10:43.163026+0000","last_clean":"2023-10-06T03:10:43.163026+0000","last_became_active":"2023-10-06T02:59:53.684806+0000","last_became_peered":"2023-10-06T02:59:53.684806+0000","last_unstale":"2023-10-06T03:10:43.163026+0000","last_undegraded":"2023-10-06T03:10:43.163026+0000","last_fullsized":"2023-10-06T03:10:43.163026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'87","last_scrub_stamp":"2023-10-06T03:10:43.162738+0000","last_deep_scrub":"26'87","last_deep_scrub_stamp":"2023-10-06T03:10:43.162738+0000","last_clean_scrub_stamp":"2023-10-06T03:10:43.162738+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:48.443299+0000","scrub_duration":0.003462929,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"26'82","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:42.196751+0000","last_change":"2023-10-06T03:10:42.196681+0000","last_active":"2023-10-06T03:10:42.196751+0000","last_peered":"2023-10-06T03:10:42.196751+0000","last_clean":"2023-10-06T03:10:42.196751+0000","last_became_active":"2023-10-06T02:59:53.675718+0000","last_became_peered":"2023-10-06T02:59:53.675718+0000","last_unstale":"2023-10-06T03:10:42.196751+0000","last_undegraded":"2023-10-06T03:10:42.196751+0000","last_fullsized":"2023-10-06T03:10:42.196751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'82","last_scrub_stamp":"2023-10-06T03:10:42.196407+0000","last_deep_scrub":"26'82","last_deep_scrub_stamp":"2023-10-06T03:10:42.196407+0000","last_clean_scrub_stamp":"2023-10-06T03:10:42.196407+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:26.830638+0000","scrub_duration":0.0039779869999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"26'92","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:37.165833+0000","last_change":"2023-10-06T03:10:37.165767+0000","last_active":"2023-10-06T03:10:37.165833+0000","last_peered":"2023-10-06T03:10:37.165833+0000","last_clean":"2023-10-06T03:10:37.165833+0000","last_became_active":"2023-10-06T02:59:53.675682+0000","last_became_peered":"2023-10-06T02:59:53.675682+0000","last_unstale":"2023-10-06T03:10:37.165833+0000","last_undegraded":"2023-10-06T03:10:37.165833+0000","last_fullsized":"2023-10-06T03:10:37.165833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2023-10-06T03:10:37.165477+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2023-10-06T03:10:37.165477+0000","last_clean_scrub_stamp":"2023-10-06T03:10:37.165477+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:47.788117+0000","scrub_duration":0.0039991189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"26'82","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:20.090999+0000","last_change":"2023-10-06T03:10:20.090874+0000","last_active":"2023-10-06T03:10:20.090999+0000","last_peered":"2023-10-06T03:10:20.090999+0000","last_clean":"2023-10-06T03:10:20.090999+0000","last_became_active":"2023-10-06T02:59:53.672930+0000","last_became_peered":"2023-10-06T02:59:53.672930+0000","last_unstale":"2023-10-06T03:10:20.090999+0000","last_undegraded":"2023-10-06T03:10:20.090999+0000","last_fullsized":"2023-10-06T03:10:20.090999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'82","last_scrub_stamp":"2023-10-06T03:10:20.090542+0000","last_deep_scrub":"26'82","last_deep_scrub_stamp":"2023-10-06T03:10:20.090542+0000","last_clean_scrub_stamp":"2023-10-06T03:10:20.090542+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:47.533895+0000","scrub_duration":0.0044770959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"26'79","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:25.073596+0000","last_change":"2023-10-06T03:10:25.073525+0000","last_active":"2023-10-06T03:10:25.073596+0000","last_peered":"2023-10-06T03:10:25.073596+0000","last_clean":"2023-10-06T03:10:25.073596+0000","last_became_active":"2023-10-06T02:59:53.678471+0000","last_became_peered":"2023-10-06T02:59:53.678471+0000","last_unstale":"2023-10-06T03:10:25.073596+0000","last_undegraded":"2023-10-06T03:10:25.073596+0000","last_fullsized":"2023-10-06T03:10:25.073596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2023-10-06T03:10:25.073267+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2023-10-06T03:10:25.073267+0000","last_clean_scrub_stamp":"2023-10-06T03:10:25.073267+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:53.195252+0000","scrub_duration":0.0043216670000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'1521","reported_seq":1544,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:27.171575+0000","last_change":"2023-10-06T03:10:27.171530+0000","last_active":"2023-10-06T03:10:27.171575+0000","last_peered":"2023-10-06T03:10:27.171575+0000","last_clean":"2023-10-06T03:10:27.171575+0000","last_became_active":"2023-10-06T02:59:53.296816+0000","last_became_peered":"2023-10-06T02:59:53.296816+0000","last_unstale":"2023-10-06T03:10:27.171575+0000","last_undegraded":"2023-10-06T03:10:27.171575+0000","last_fullsized":"2023-10-06T03:10:27.171575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1521","last_scrub_stamp":"2023-10-06T03:10:27.171341+0000","last_deep_scrub":"26'1521","last_deep_scrub_stamp":"2023-10-06T03:10:27.171341+0000","last_clean_scrub_stamp":"2023-10-06T03:10:27.171341+0000","objects_scrubbed":4,"log_size":1521,"log_dups_size":0,"ondisk_log_size":1521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:55.293325+0000","scrub_duration":0.045663007999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1406,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'65","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:43.690734+0000","last_change":"2023-10-06T03:10:43.690667+0000","last_active":"2023-10-06T03:10:43.690734+0000","last_peered":"2023-10-06T03:10:43.690734+0000","last_clean":"2023-10-06T03:10:43.690734+0000","last_became_active":"2023-10-06T02:59:53.684522+0000","last_became_peered":"2023-10-06T02:59:53.684522+0000","last_unstale":"2023-10-06T03:10:43.690734+0000","last_undegraded":"2023-10-06T03:10:43.690734+0000","last_fullsized":"2023-10-06T03:10:43.690734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'65","last_scrub_stamp":"2023-10-06T03:10:43.690401+0000","last_deep_scrub":"26'65","last_deep_scrub_stamp":"2023-10-06T03:10:43.690401+0000","last_clean_scrub_stamp":"2023-10-06T03:10:43.690401+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:48.970963+0000","scrub_duration":0.003904972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"26'125","reported_seq":148,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:07.090031+0000","last_change":"2023-10-06T03:10:07.089961+0000","last_active":"2023-10-06T03:10:07.090031+0000","last_peered":"2023-10-06T03:10:07.090031+0000","last_clean":"2023-10-06T03:10:07.090031+0000","last_became_active":"2023-10-06T02:59:53.292378+0000","last_became_peered":"2023-10-06T02:59:53.292378+0000","last_unstale":"2023-10-06T03:10:07.090031+0000","last_undegraded":"2023-10-06T03:10:07.090031+0000","last_fullsized":"2023-10-06T03:10:07.090031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'125","last_scrub_stamp":"2023-10-06T03:10:07.089660+0000","last_deep_scrub":"26'125","last_deep_scrub_stamp":"2023-10-06T03:10:07.089660+0000","last_clean_scrub_stamp":"2023-10-06T03:10:07.089660+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:33.076065+0000","scrub_duration":0.0042091079999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"26'92","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:35.093402+0000","last_change":"2023-10-06T03:10:35.093329+0000","last_active":"2023-10-06T03:10:35.093402+0000","last_peered":"2023-10-06T03:10:35.093402+0000","last_clean":"2023-10-06T03:10:35.093402+0000","last_became_active":"2023-10-06T02:59:53.675219+0000","last_became_peered":"2023-10-06T02:59:53.675219+0000","last_unstale":"2023-10-06T03:10:35.093402+0000","last_undegraded":"2023-10-06T03:10:35.093402+0000","last_fullsized":"2023-10-06T03:10:35.093402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2023-10-06T03:10:35.093065+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2023-10-06T03:10:35.093065+0000","last_clean_scrub_stamp":"2023-10-06T03:10:35.093065+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:45.715705+0000","scrub_duration":0.0042966380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"26'124","reported_seq":147,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:15.125161+0000","last_change":"2023-10-06T03:10:15.125056+0000","last_active":"2023-10-06T03:10:15.125161+0000","last_peered":"2023-10-06T03:10:15.125161+0000","last_clean":"2023-10-06T03:10:15.125161+0000","last_became_active":"2023-10-06T02:59:53.301737+0000","last_became_peered":"2023-10-06T02:59:53.301737+0000","last_unstale":"2023-10-06T03:10:15.125161+0000","last_undegraded":"2023-10-06T03:10:15.125161+0000","last_fullsized":"2023-10-06T03:10:15.125161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'124","last_scrub_stamp":"2023-10-06T03:10:15.124658+0000","last_deep_scrub":"26'124","last_deep_scrub_stamp":"2023-10-06T03:10:15.124658+0000","last_clean_scrub_stamp":"2023-10-06T03:10:15.124658+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:43.006174+0000","scrub_duration":0.0049652760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'80","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:50.168284+0000","last_change":"2023-10-06T03:10:50.168217+0000","last_active":"2023-10-06T03:10:50.168284+0000","last_peered":"2023-10-06T03:10:50.168284+0000","last_clean":"2023-10-06T03:10:50.168284+0000","last_became_active":"2023-10-06T02:59:53.684527+0000","last_became_peered":"2023-10-06T02:59:53.684527+0000","last_unstale":"2023-10-06T03:10:50.168284+0000","last_undegraded":"2023-10-06T03:10:50.168284+0000","last_fullsized":"2023-10-06T03:10:50.168284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'80","last_scrub_stamp":"2023-10-06T03:10:50.167907+0000","last_deep_scrub":"26'80","last_deep_scrub_stamp":"2023-10-06T03:10:50.167907+0000","last_clean_scrub_stamp":"2023-10-06T03:10:50.167907+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:44.600740+0000","scrub_duration":0.0040748690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"26'139","reported_seq":162,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:03.006058+0000","last_change":"2023-10-06T03:10:03.005991+0000","last_active":"2023-10-06T03:10:03.006058+0000","last_peered":"2023-10-06T03:10:03.006058+0000","last_clean":"2023-10-06T03:10:03.006058+0000","last_became_active":"2023-10-06T02:59:53.293707+0000","last_became_peered":"2023-10-06T02:59:53.293707+0000","last_unstale":"2023-10-06T03:10:03.006058+0000","last_undegraded":"2023-10-06T03:10:03.006058+0000","last_fullsized":"2023-10-06T03:10:03.006058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'139","last_scrub_stamp":"2023-10-06T03:10:03.005737+0000","last_deep_scrub":"26'139","last_deep_scrub_stamp":"2023-10-06T03:10:03.005737+0000","last_clean_scrub_stamp":"2023-10-06T03:10:03.005737+0000","objects_scrubbed":4,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:41.702358+0000","scrub_duration":0.011013787000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"26'119","reported_seq":142,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:17.154993+0000","last_change":"2023-10-06T03:10:17.154926+0000","last_active":"2023-10-06T03:10:17.154993+0000","last_peered":"2023-10-06T03:10:17.154993+0000","last_clean":"2023-10-06T03:10:17.154993+0000","last_became_active":"2023-10-06T02:59:53.296230+0000","last_became_peered":"2023-10-06T02:59:53.296230+0000","last_unstale":"2023-10-06T03:10:17.154993+0000","last_undegraded":"2023-10-06T03:10:17.154993+0000","last_fullsized":"2023-10-06T03:10:17.154993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2023-10-06T03:10:17.154673+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2023-10-06T03:10:17.154673+0000","last_clean_scrub_stamp":"2023-10-06T03:10:17.154673+0000","objects_scrubbed":1,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:23.330769+0000","scrub_duration":0.0076386739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"26'90","reported_seq":112,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:34.545362+0000","last_change":"2023-10-06T03:10:34.545294+0000","last_active":"2023-10-06T03:10:34.545362+0000","last_peered":"2023-10-06T03:10:34.545362+0000","last_clean":"2023-10-06T03:10:34.545362+0000","last_became_active":"2023-10-06T02:59:53.683705+0000","last_became_peered":"2023-10-06T02:59:53.683705+0000","last_unstale":"2023-10-06T03:10:34.545362+0000","last_undegraded":"2023-10-06T03:10:34.545362+0000","last_fullsized":"2023-10-06T03:10:34.545362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'90","last_scrub_stamp":"2023-10-06T03:10:34.545027+0000","last_deep_scrub":"26'90","last_deep_scrub_stamp":"2023-10-06T03:10:34.545027+0000","last_clean_scrub_stamp":"2023-10-06T03:10:34.545027+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:31.372952+0000","scrub_duration":0.0039139780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'107","reported_seq":130,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:21.176574+0000","last_change":"2023-10-06T03:10:21.176450+0000","last_active":"2023-10-06T03:10:21.176574+0000","last_peered":"2023-10-06T03:10:21.176574+0000","last_clean":"2023-10-06T03:10:21.176574+0000","last_became_active":"2023-10-06T02:59:53.296225+0000","last_became_peered":"2023-10-06T02:59:53.296225+0000","last_unstale":"2023-10-06T03:10:21.176574+0000","last_undegraded":"2023-10-06T03:10:21.176574+0000","last_fullsized":"2023-10-06T03:10:21.176574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'107","last_scrub_stamp":"2023-10-06T03:10:21.176172+0000","last_deep_scrub":"26'107","last_deep_scrub_stamp":"2023-10-06T03:10:21.176172+0000","last_clean_scrub_stamp":"2023-10-06T03:10:21.176172+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:48.619526+0000","scrub_duration":0.0078170730000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'81","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:33.222875+0000","last_change":"2023-10-06T03:10:33.222803+0000","last_active":"2023-10-06T03:10:33.222875+0000","last_peered":"2023-10-06T03:10:33.222875+0000","last_clean":"2023-10-06T03:10:33.222875+0000","last_became_active":"2023-10-06T02:59:53.682938+0000","last_became_peered":"2023-10-06T02:59:53.682938+0000","last_unstale":"2023-10-06T03:10:33.222875+0000","last_undegraded":"2023-10-06T03:10:33.222875+0000","last_fullsized":"2023-10-06T03:10:33.222875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'81","last_scrub_stamp":"2023-10-06T03:10:33.222535+0000","last_deep_scrub":"26'81","last_deep_scrub_stamp":"2023-10-06T03:10:33.222535+0000","last_clean_scrub_stamp":"2023-10-06T03:10:33.222535+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:43.845175+0000","scrub_duration":0.0043943419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"26'622","reported_seq":645,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:22.183860+0000","last_change":"2023-10-06T03:10:22.183763+0000","last_active":"2023-10-06T03:10:22.183860+0000","last_peered":"2023-10-06T03:10:22.183860+0000","last_clean":"2023-10-06T03:10:22.183860+0000","last_became_active":"2023-10-06T02:59:53.293602+0000","last_became_peered":"2023-10-06T02:59:53.293602+0000","last_unstale":"2023-10-06T03:10:22.183860+0000","last_undegraded":"2023-10-06T03:10:22.183860+0000","last_fullsized":"2023-10-06T03:10:22.183860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'622","last_scrub_stamp":"2023-10-06T03:10:22.183451+0000","last_deep_scrub":"26'622","last_deep_scrub_stamp":"2023-10-06T03:10:22.183451+0000","last_clean_scrub_stamp":"2023-10-06T03:10:22.183451+0000","objects_scrubbed":2,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:28.323446+0000","scrub_duration":0.026638347999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"26'75","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:10.010261+0000","last_change":"2023-10-06T03:10:10.010194+0000","last_active":"2023-10-06T03:10:10.010261+0000","last_peered":"2023-10-06T03:10:10.010261+0000","last_clean":"2023-10-06T03:10:10.010261+0000","last_became_active":"2023-10-06T02:59:53.671511+0000","last_became_peered":"2023-10-06T02:59:53.671511+0000","last_unstale":"2023-10-06T03:10:10.010261+0000","last_undegraded":"2023-10-06T03:10:10.010261+0000","last_fullsized":"2023-10-06T03:10:10.010261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'75","last_scrub_stamp":"2023-10-06T03:10:10.009944+0000","last_deep_scrub":"26'75","last_deep_scrub_stamp":"2023-10-06T03:10:10.009944+0000","last_clean_scrub_stamp":"2023-10-06T03:10:10.009944+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:35.996349+0000","scrub_duration":0.0048294820000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'134","reported_seq":157,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:16.293257+0000","last_change":"2023-10-06T03:10:16.293195+0000","last_active":"2023-10-06T03:10:16.293257+0000","last_peered":"2023-10-06T03:10:16.293257+0000","last_clean":"2023-10-06T03:10:16.293257+0000","last_became_active":"2023-10-06T02:59:53.299715+0000","last_became_peered":"2023-10-06T02:59:53.299715+0000","last_unstale":"2023-10-06T03:10:16.293257+0000","last_undegraded":"2023-10-06T03:10:16.293257+0000","last_fullsized":"2023-10-06T03:10:16.293257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'134","last_scrub_stamp":"2023-10-06T03:10:16.292913+0000","last_deep_scrub":"26'134","last_deep_scrub_stamp":"2023-10-06T03:10:16.292913+0000","last_clean_scrub_stamp":"2023-10-06T03:10:16.292913+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:22.469009+0000","scrub_duration":0.0043004039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"26'94","reported_seq":116,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:31.128981+0000","last_change":"2023-10-06T03:10:31.128863+0000","last_active":"2023-10-06T03:10:31.128981+0000","last_peered":"2023-10-06T03:10:31.128981+0000","last_clean":"2023-10-06T03:10:31.128981+0000","last_became_active":"2023-10-06T02:59:53.682994+0000","last_became_peered":"2023-10-06T02:59:53.682994+0000","last_unstale":"2023-10-06T03:10:31.128981+0000","last_undegraded":"2023-10-06T03:10:31.128981+0000","last_fullsized":"2023-10-06T03:10:31.128981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'94","last_scrub_stamp":"2023-10-06T03:10:31.128586+0000","last_deep_scrub":"26'94","last_deep_scrub_stamp":"2023-10-06T03:10:31.128586+0000","last_clean_scrub_stamp":"2023-10-06T03:10:31.128586+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:27.956512+0000","scrub_duration":0.0043574260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'620","reported_seq":643,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:02.130329+0000","last_change":"2023-10-06T03:10:02.130249+0000","last_active":"2023-10-06T03:10:02.130329+0000","last_peered":"2023-10-06T03:10:02.130329+0000","last_clean":"2023-10-06T03:10:02.130329+0000","last_became_active":"2023-10-06T02:59:53.300850+0000","last_became_peered":"2023-10-06T02:59:53.300850+0000","last_unstale":"2023-10-06T03:10:02.130329+0000","last_undegraded":"2023-10-06T03:10:02.130329+0000","last_fullsized":"2023-10-06T03:10:02.130329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'620","last_scrub_stamp":"2023-10-06T03:10:02.129953+0000","last_deep_scrub":"26'620","last_deep_scrub_stamp":"2023-10-06T03:10:02.129953+0000","last_clean_scrub_stamp":"2023-10-06T03:10:02.129953+0000","objects_scrubbed":2,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:16.383931+0000","scrub_duration":0.023249453,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'92","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:04.418253+0000","last_change":"2023-10-06T03:10:04.418128+0000","last_active":"2023-10-06T03:10:04.418253+0000","last_peered":"2023-10-06T03:10:04.418253+0000","last_clean":"2023-10-06T03:10:04.418253+0000","last_became_active":"2023-10-06T02:59:53.678630+0000","last_became_peered":"2023-10-06T02:59:53.678630+0000","last_unstale":"2023-10-06T03:10:04.418253+0000","last_undegraded":"2023-10-06T03:10:04.418253+0000","last_fullsized":"2023-10-06T03:10:04.418253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2023-10-06T03:10:04.417805+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2023-10-06T03:10:04.417805+0000","last_clean_scrub_stamp":"2023-10-06T03:10:04.417805+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:30.404211+0000","scrub_duration":0.004364588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'128","reported_seq":151,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:03.994004+0000","last_change":"2023-10-06T03:10:03.993933+0000","last_active":"2023-10-06T03:10:03.994004+0000","last_peered":"2023-10-06T03:10:03.994004+0000","last_clean":"2023-10-06T03:10:03.994004+0000","last_became_active":"2023-10-06T02:59:53.290773+0000","last_became_peered":"2023-10-06T02:59:53.290773+0000","last_unstale":"2023-10-06T03:10:03.994004+0000","last_undegraded":"2023-10-06T03:10:03.994004+0000","last_fullsized":"2023-10-06T03:10:03.994004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'128","last_scrub_stamp":"2023-10-06T03:10:03.993644+0000","last_deep_scrub":"26'128","last_deep_scrub_stamp":"2023-10-06T03:10:03.993644+0000","last_clean_scrub_stamp":"2023-10-06T03:10:03.993644+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:04.037931+0000","scrub_duration":0.0040760750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"26'92","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:39.192741+0000","last_change":"2023-10-06T03:10:39.192627+0000","last_active":"2023-10-06T03:10:39.192741+0000","last_peered":"2023-10-06T03:10:39.192741+0000","last_clean":"2023-10-06T03:10:39.192741+0000","last_became_active":"2023-10-06T02:59:53.676507+0000","last_became_peered":"2023-10-06T02:59:53.676507+0000","last_unstale":"2023-10-06T03:10:39.192741+0000","last_undegraded":"2023-10-06T03:10:39.192741+0000","last_fullsized":"2023-10-06T03:10:39.192741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2023-10-06T03:10:39.192300+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2023-10-06T03:10:39.192300+0000","last_clean_scrub_stamp":"2023-10-06T03:10:39.192300+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:44.472861+0000","scrub_duration":0.0045248679999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"26'126","reported_seq":149,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:20.318553+0000","last_change":"2023-10-06T03:10:20.318490+0000","last_active":"2023-10-06T03:10:20.318553+0000","last_peered":"2023-10-06T03:10:20.318553+0000","last_clean":"2023-10-06T03:10:20.318553+0000","last_became_active":"2023-10-06T02:59:53.288601+0000","last_became_peered":"2023-10-06T02:59:53.288601+0000","last_unstale":"2023-10-06T03:10:20.318553+0000","last_undegraded":"2023-10-06T03:10:20.318553+0000","last_fullsized":"2023-10-06T03:10:20.318553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'126","last_scrub_stamp":"2023-10-06T03:10:20.318239+0000","last_deep_scrub":"26'126","last_deep_scrub_stamp":"2023-10-06T03:10:20.318239+0000","last_clean_scrub_stamp":"2023-10-06T03:10:20.318239+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:25.779073+0000","scrub_duration":0.0042963699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"26'87","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:41.149474+0000","last_change":"2023-10-06T03:10:41.149356+0000","last_active":"2023-10-06T03:10:41.149474+0000","last_peered":"2023-10-06T03:10:41.149474+0000","last_clean":"2023-10-06T03:10:41.149474+0000","last_became_active":"2023-10-06T02:59:53.673268+0000","last_became_peered":"2023-10-06T02:59:53.673268+0000","last_unstale":"2023-10-06T03:10:41.149474+0000","last_undegraded":"2023-10-06T03:10:41.149474+0000","last_fullsized":"2023-10-06T03:10:41.149474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'87","last_scrub_stamp":"2023-10-06T03:10:41.149100+0000","last_deep_scrub":"26'87","last_deep_scrub_stamp":"2023-10-06T03:10:41.149100+0000","last_clean_scrub_stamp":"2023-10-06T03:10:41.149100+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:06.573747+0000","scrub_duration":0.0039433380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'688","reported_seq":711,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:01.095525+0000","last_change":"2023-10-06T03:10:01.095463+0000","last_active":"2023-10-06T03:10:01.095525+0000","last_peered":"2023-10-06T03:10:01.095525+0000","last_clean":"2023-10-06T03:10:01.095525+0000","last_became_active":"2023-10-06T02:59:53.297896+0000","last_became_peered":"2023-10-06T02:59:53.297896+0000","last_unstale":"2023-10-06T03:10:01.095525+0000","last_undegraded":"2023-10-06T03:10:01.095525+0000","last_fullsized":"2023-10-06T03:10:01.095525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'688","last_scrub_stamp":"2023-10-06T03:10:01.095265+0000","last_deep_scrub":"26'688","last_deep_scrub_stamp":"2023-10-06T03:10:01.095265+0000","last_clean_scrub_stamp":"2023-10-06T03:10:01.095265+0000","objects_scrubbed":1,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:29.509465+0000","scrub_duration":0.023556345999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"26'75","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:42.967848+0000","last_change":"2023-10-06T03:10:42.967782+0000","last_active":"2023-10-06T03:10:42.967848+0000","last_peered":"2023-10-06T03:10:42.967848+0000","last_clean":"2023-10-06T03:10:42.967848+0000","last_became_active":"2023-10-06T02:59:53.679390+0000","last_became_peered":"2023-10-06T02:59:53.679390+0000","last_unstale":"2023-10-06T03:10:42.967848+0000","last_undegraded":"2023-10-06T03:10:42.967848+0000","last_fullsized":"2023-10-06T03:10:42.967848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'75","last_scrub_stamp":"2023-10-06T03:10:42.967524+0000","last_deep_scrub":"26'75","last_deep_scrub_stamp":"2023-10-06T03:10:42.967524+0000","last_clean_scrub_stamp":"2023-10-06T03:10:42.967524+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:29.294832+0000","scrub_duration":0.0037453460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":181,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:05.097662+0000","last_change":"2023-10-06T03:10:05.097603+0000","last_active":"2023-10-06T03:10:05.097662+0000","last_peered":"2023-10-06T03:10:05.097662+0000","last_clean":"2023-10-06T03:10:05.097662+0000","last_became_active":"2023-10-06T02:59:44.072854+0000","last_became_peered":"2023-10-06T02:59:44.072854+0000","last_unstale":"2023-10-06T03:10:05.097662+0000","last_undegraded":"2023-10-06T03:10:05.097662+0000","last_fullsized":"2023-10-06T03:10:05.097662+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2023-10-06T03:10:05.097351+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2023-10-06T03:10:05.097351+0000","last_clean_scrub_stamp":"2023-10-06T03:10:05.097351+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:05.141638+0000","scrub_duration":0.013871631000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:09.346769+0000","last_change":"2023-10-06T03:10:09.346668+0000","last_active":"2023-10-06T03:10:09.346769+0000","last_peered":"2023-10-06T03:10:09.346769+0000","last_clean":"2023-10-06T03:10:09.346769+0000","last_became_active":"2023-10-06T02:59:49.106619+0000","last_became_peered":"2023-10-06T02:59:49.106619+0000","last_unstale":"2023-10-06T03:10:09.346769+0000","last_undegraded":"2023-10-06T03:10:09.346769+0000","last_fullsized":"2023-10-06T03:10:09.346769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:09.346351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:09.346351+0000","last_clean_scrub_stamp":"2023-10-06T03:10:09.346351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:35.332756+0000","scrub_duration":0.0039630009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"26'1463","reported_seq":1486,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:05.133084+0000","last_change":"2023-10-06T03:10:05.133006+0000","last_active":"2023-10-06T03:10:05.133084+0000","last_peered":"2023-10-06T03:10:05.133084+0000","last_clean":"2023-10-06T03:10:05.133084+0000","last_became_active":"2023-10-06T02:59:53.298012+0000","last_became_peered":"2023-10-06T02:59:53.298012+0000","last_unstale":"2023-10-06T03:10:05.133084+0000","last_undegraded":"2023-10-06T03:10:05.133084+0000","last_fullsized":"2023-10-06T03:10:05.133084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1463","last_scrub_stamp":"2023-10-06T03:10:05.132728+0000","last_deep_scrub":"26'1463","last_deep_scrub_stamp":"2023-10-06T03:10:05.132728+0000","last_clean_scrub_stamp":"2023-10-06T03:10:05.132728+0000","objects_scrubbed":2,"log_size":1463,"log_dups_size":0,"ondisk_log_size":1463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:16.936485+0000","scrub_duration":0.042468087000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1329,"num_write_kb":8969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"26'92","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:15.979132+0000","last_change":"2023-10-06T03:10:15.979001+0000","last_active":"2023-10-06T03:10:15.979132+0000","last_peered":"2023-10-06T03:10:15.979132+0000","last_clean":"2023-10-06T03:10:15.979132+0000","last_became_active":"2023-10-06T02:59:53.679200+0000","last_became_peered":"2023-10-06T02:59:53.679200+0000","last_unstale":"2023-10-06T03:10:15.979132+0000","last_undegraded":"2023-10-06T03:10:15.979132+0000","last_fullsized":"2023-10-06T03:10:15.979132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2023-10-06T03:10:15.978591+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2023-10-06T03:10:15.978591+0000","last_clean_scrub_stamp":"2023-10-06T03:10:15.978591+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:22.154687+0000","scrub_duration":0.0043756020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:06.062344+0000","last_change":"2023-10-06T03:10:06.062274+0000","last_active":"2023-10-06T03:10:06.062344+0000","last_peered":"2023-10-06T03:10:06.062344+0000","last_clean":"2023-10-06T03:10:06.062344+0000","last_became_active":"2023-10-06T02:59:49.106878+0000","last_became_peered":"2023-10-06T02:59:49.106878+0000","last_unstale":"2023-10-06T03:10:06.062344+0000","last_undegraded":"2023-10-06T03:10:06.062344+0000","last_fullsized":"2023-10-06T03:10:06.062344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:06.062015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:06.062015+0000","last_clean_scrub_stamp":"2023-10-06T03:10:06.062015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:17.865773+0000","scrub_duration":0.0058099720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"26'604","reported_seq":1110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:11.111104+0000","last_change":"2023-10-06T03:10:11.111027+0000","last_active":"2023-10-06T03:10:11.111104+0000","last_peered":"2023-10-06T03:10:11.111104+0000","last_clean":"2023-10-06T03:10:11.111104+0000","last_became_active":"2023-10-06T02:59:53.296171+0000","last_became_peered":"2023-10-06T02:59:53.296171+0000","last_unstale":"2023-10-06T03:10:11.111104+0000","last_undegraded":"2023-10-06T03:10:11.111104+0000","last_fullsized":"2023-10-06T03:10:11.111104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'604","last_scrub_stamp":"2023-10-06T03:10:11.110731+0000","last_deep_scrub":"26'604","last_deep_scrub_stamp":"2023-10-06T03:10:11.110731+0000","last_clean_scrub_stamp":"2023-10-06T03:10:11.110731+0000","objects_scrubbed":1,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:38.992246+0000","scrub_duration":0.012150444999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770024,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":483,"num_write_kb":1079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"26'88","reported_seq":110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:22.141939+0000","last_change":"2023-10-06T03:10:22.141869+0000","last_active":"2023-10-06T03:10:22.141939+0000","last_peered":"2023-10-06T03:10:22.141939+0000","last_clean":"2023-10-06T03:10:22.141939+0000","last_became_active":"2023-10-06T02:59:53.681786+0000","last_became_peered":"2023-10-06T02:59:53.681786+0000","last_unstale":"2023-10-06T03:10:22.141939+0000","last_undegraded":"2023-10-06T03:10:22.141939+0000","last_fullsized":"2023-10-06T03:10:22.141939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'88","last_scrub_stamp":"2023-10-06T03:10:22.141602+0000","last_deep_scrub":"26'88","last_deep_scrub_stamp":"2023-10-06T03:10:22.141602+0000","last_clean_scrub_stamp":"2023-10-06T03:10:22.141602+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:27.602437+0000","scrub_duration":0.0039522100000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:00.752920+0000","last_change":"2023-10-06T03:10:00.752834+0000","last_active":"2023-10-06T03:10:00.752920+0000","last_peered":"2023-10-06T03:10:00.752920+0000","last_clean":"2023-10-06T03:10:00.752920+0000","last_became_active":"2023-10-06T02:59:49.114769+0000","last_became_peered":"2023-10-06T02:59:49.114769+0000","last_unstale":"2023-10-06T03:10:00.752920+0000","last_undegraded":"2023-10-06T03:10:00.752920+0000","last_fullsized":"2023-10-06T03:10:00.752920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:00.752583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:00.752583+0000","last_clean_scrub_stamp":"2023-10-06T03:10:00.752583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:30.133142+0000","scrub_duration":0.0033960230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'1470","reported_seq":1493,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:04.020034+0000","last_change":"2023-10-06T03:10:04.019981+0000","last_active":"2023-10-06T03:10:04.020034+0000","last_peered":"2023-10-06T03:10:04.020034+0000","last_clean":"2023-10-06T03:10:04.020034+0000","last_became_active":"2023-10-06T02:59:53.298054+0000","last_became_peered":"2023-10-06T02:59:53.298054+0000","last_unstale":"2023-10-06T03:10:04.020034+0000","last_undegraded":"2023-10-06T03:10:04.020034+0000","last_fullsized":"2023-10-06T03:10:04.020034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1470","last_scrub_stamp":"2023-10-06T03:10:04.019787+0000","last_deep_scrub":"26'1470","last_deep_scrub_stamp":"2023-10-06T03:10:04.019787+0000","last_clean_scrub_stamp":"2023-10-06T03:10:04.019787+0000","objects_scrubbed":2,"log_size":1470,"log_dups_size":0,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:51.929095+0000","scrub_duration":0.048117597999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1335,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"26'79","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:07.879509+0000","last_change":"2023-10-06T03:10:07.879434+0000","last_active":"2023-10-06T03:10:07.879509+0000","last_peered":"2023-10-06T03:10:07.879509+0000","last_clean":"2023-10-06T03:10:07.879509+0000","last_became_active":"2023-10-06T02:59:53.673677+0000","last_became_peered":"2023-10-06T02:59:53.673677+0000","last_unstale":"2023-10-06T03:10:07.879509+0000","last_undegraded":"2023-10-06T03:10:07.879509+0000","last_fullsized":"2023-10-06T03:10:07.879509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2023-10-06T03:10:07.879169+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2023-10-06T03:10:07.879169+0000","last_clean_scrub_stamp":"2023-10-06T03:10:07.879169+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:07.923455+0000","scrub_duration":0.0046089219999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:14.264128+0000","last_change":"2023-10-06T03:10:14.264062+0000","last_active":"2023-10-06T03:10:14.264128+0000","last_peered":"2023-10-06T03:10:14.264128+0000","last_clean":"2023-10-06T03:10:14.264128+0000","last_became_active":"2023-10-06T02:59:49.107560+0000","last_became_peered":"2023-10-06T02:59:49.107560+0000","last_unstale":"2023-10-06T03:10:14.264128+0000","last_undegraded":"2023-10-06T03:10:14.264128+0000","last_fullsized":"2023-10-06T03:10:14.264128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:14.263786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:14.263786+0000","last_clean_scrub_stamp":"2023-10-06T03:10:14.263786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:42.145301+0000","scrub_duration":0.003869969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'122","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:21.301197+0000","last_change":"2023-10-06T03:10:21.301133+0000","last_active":"2023-10-06T03:10:21.301197+0000","last_peered":"2023-10-06T03:10:21.301197+0000","last_clean":"2023-10-06T03:10:21.301197+0000","last_became_active":"2023-10-06T02:59:53.300609+0000","last_became_peered":"2023-10-06T02:59:53.300609+0000","last_unstale":"2023-10-06T03:10:21.301197+0000","last_undegraded":"2023-10-06T03:10:21.301197+0000","last_fullsized":"2023-10-06T03:10:21.301197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'122","last_scrub_stamp":"2023-10-06T03:10:21.300877+0000","last_deep_scrub":"26'122","last_deep_scrub_stamp":"2023-10-06T03:10:21.300877+0000","last_clean_scrub_stamp":"2023-10-06T03:10:21.300877+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:49.422862+0000","scrub_duration":0.0040404660000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"26'78","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:52.794532+0000","last_change":"2023-10-06T03:10:52.794470+0000","last_active":"2023-10-06T03:10:52.794532+0000","last_peered":"2023-10-06T03:10:52.794532+0000","last_clean":"2023-10-06T03:10:52.794532+0000","last_became_active":"2023-10-06T03:00:34.740140+0000","last_became_peered":"2023-10-06T03:00:34.740140+0000","last_unstale":"2023-10-06T03:10:52.794532+0000","last_undegraded":"2023-10-06T03:10:52.794532+0000","last_fullsized":"2023-10-06T03:10:52.794532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'78","last_scrub_stamp":"2023-10-06T03:10:52.794192+0000","last_deep_scrub":"26'78","last_deep_scrub_stamp":"2023-10-06T03:10:52.794192+0000","last_clean_scrub_stamp":"2023-10-06T03:10:52.794192+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:43:05.072802+0000","scrub_duration":0.0041833979999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'105","reported_seq":128,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:20.352688+0000","last_change":"2023-10-06T03:10:20.352592+0000","last_active":"2023-10-06T03:10:20.352688+0000","last_peered":"2023-10-06T03:10:20.352688+0000","last_clean":"2023-10-06T03:10:20.352688+0000","last_became_active":"2023-10-06T02:59:53.300919+0000","last_became_peered":"2023-10-06T02:59:53.300919+0000","last_unstale":"2023-10-06T03:10:20.352688+0000","last_undegraded":"2023-10-06T03:10:20.352688+0000","last_fullsized":"2023-10-06T03:10:20.352688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'105","last_scrub_stamp":"2023-10-06T03:10:20.352194+0000","last_deep_scrub":"26'105","last_deep_scrub_stamp":"2023-10-06T03:10:20.352194+0000","last_clean_scrub_stamp":"2023-10-06T03:10:20.352194+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:47.795547+0000","scrub_duration":0.004720185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:09:59.902097+0000","last_change":"2023-10-06T03:09:59.902052+0000","last_active":"2023-10-06T03:09:59.902097+0000","last_peered":"2023-10-06T03:09:59.902097+0000","last_clean":"2023-10-06T03:09:59.902097+0000","last_became_active":"2023-10-06T02:59:49.107967+0000","last_became_peered":"2023-10-06T02:59:49.107967+0000","last_unstale":"2023-10-06T03:09:59.902097+0000","last_undegraded":"2023-10-06T03:09:59.902097+0000","last_fullsized":"2023-10-06T03:09:59.902097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:09:59.901857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:09:59.901857+0000","last_clean_scrub_stamp":"2023-10-06T03:09:59.901857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:05.160444+0000","scrub_duration":0.003240022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'75","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:32.025953+0000","last_change":"2023-10-06T03:10:32.025884+0000","last_active":"2023-10-06T03:10:32.025953+0000","last_peered":"2023-10-06T03:10:32.025953+0000","last_clean":"2023-10-06T03:10:32.025953+0000","last_became_active":"2023-10-06T02:59:53.676385+0000","last_became_peered":"2023-10-06T02:59:53.676385+0000","last_unstale":"2023-10-06T03:10:32.025953+0000","last_undegraded":"2023-10-06T03:10:32.025953+0000","last_fullsized":"2023-10-06T03:10:32.025953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'75","last_scrub_stamp":"2023-10-06T03:10:32.025620+0000","last_deep_scrub":"26'75","last_deep_scrub_stamp":"2023-10-06T03:10:32.025620+0000","last_clean_scrub_stamp":"2023-10-06T03:10:32.025620+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:00.147604+0000","scrub_duration":0.0043942920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"26'115","reported_seq":138,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:04.938136+0000","last_change":"2023-10-06T03:10:04.938068+0000","last_active":"2023-10-06T03:10:04.938136+0000","last_peered":"2023-10-06T03:10:04.938136+0000","last_clean":"2023-10-06T03:10:04.938136+0000","last_became_active":"2023-10-06T02:59:53.302890+0000","last_became_peered":"2023-10-06T02:59:53.302890+0000","last_unstale":"2023-10-06T03:10:04.938136+0000","last_undegraded":"2023-10-06T03:10:04.938136+0000","last_fullsized":"2023-10-06T03:10:04.938136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'115","last_scrub_stamp":"2023-10-06T03:10:04.937798+0000","last_deep_scrub":"26'115","last_deep_scrub_stamp":"2023-10-06T03:10:04.937798+0000","last_clean_scrub_stamp":"2023-10-06T03:10:04.937798+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:19.191776+0000","scrub_duration":0.0040328159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:11.154639+0000","last_change":"2023-10-06T03:10:11.154566+0000","last_active":"2023-10-06T03:10:11.154639+0000","last_peered":"2023-10-06T03:10:11.154639+0000","last_clean":"2023-10-06T03:10:11.154639+0000","last_became_active":"2023-10-06T02:59:49.101530+0000","last_became_peered":"2023-10-06T02:59:49.101530+0000","last_unstale":"2023-10-06T03:10:11.154639+0000","last_undegraded":"2023-10-06T03:10:11.154639+0000","last_fullsized":"2023-10-06T03:10:11.154639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:11.154299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:11.154299+0000","last_clean_scrub_stamp":"2023-10-06T03:10:11.154299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:37.140705+0000","scrub_duration":0.0041325099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'79","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:18.192650+0000","last_change":"2023-10-06T03:10:18.192544+0000","last_active":"2023-10-06T03:10:18.192650+0000","last_peered":"2023-10-06T03:10:18.192650+0000","last_clean":"2023-10-06T03:10:18.192650+0000","last_became_active":"2023-10-06T02:59:53.672299+0000","last_became_peered":"2023-10-06T02:59:53.672299+0000","last_unstale":"2023-10-06T03:10:18.192650+0000","last_undegraded":"2023-10-06T03:10:18.192650+0000","last_fullsized":"2023-10-06T03:10:18.192650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2023-10-06T03:10:18.192108+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2023-10-06T03:10:18.192108+0000","last_clean_scrub_stamp":"2023-10-06T03:10:18.192108+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:24.332103+0000","scrub_duration":0.0047218800000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"26'121","reported_seq":144,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:10.175123+0000","last_change":"2023-10-06T03:10:10.175047+0000","last_active":"2023-10-06T03:10:10.175123+0000","last_peered":"2023-10-06T03:10:10.175123+0000","last_clean":"2023-10-06T03:10:10.175123+0000","last_became_active":"2023-10-06T02:59:53.299271+0000","last_became_peered":"2023-10-06T02:59:53.299271+0000","last_unstale":"2023-10-06T03:10:10.175123+0000","last_undegraded":"2023-10-06T03:10:10.175123+0000","last_fullsized":"2023-10-06T03:10:10.175123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'121","last_scrub_stamp":"2023-10-06T03:10:10.174733+0000","last_deep_scrub":"26'121","last_deep_scrub_stamp":"2023-10-06T03:10:10.174733+0000","last_clean_scrub_stamp":"2023-10-06T03:10:10.174733+0000","objects_scrubbed":1,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:36.161138+0000","scrub_duration":0.0074238999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:00.939734+0000","last_change":"2023-10-06T03:10:00.939709+0000","last_active":"2023-10-06T03:10:00.939734+0000","last_peered":"2023-10-06T03:10:00.939734+0000","last_clean":"2023-10-06T03:10:00.939734+0000","last_became_active":"2023-10-06T02:59:49.099689+0000","last_became_peered":"2023-10-06T02:59:49.099689+0000","last_unstale":"2023-10-06T03:10:00.939734+0000","last_undegraded":"2023-10-06T03:10:00.939734+0000","last_fullsized":"2023-10-06T03:10:00.939734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:00.939619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:00.939619+0000","last_clean_scrub_stamp":"2023-10-06T03:10:00.939619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:52.791469+0000","scrub_duration":0.0037315680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'94","reported_seq":116,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:19.045676+0000","last_change":"2023-10-06T03:10:19.045609+0000","last_active":"2023-10-06T03:10:19.045676+0000","last_peered":"2023-10-06T03:10:19.045676+0000","last_clean":"2023-10-06T03:10:19.045676+0000","last_became_active":"2023-10-06T02:59:53.684983+0000","last_became_peered":"2023-10-06T02:59:53.684983+0000","last_unstale":"2023-10-06T03:10:19.045676+0000","last_undegraded":"2023-10-06T03:10:19.045676+0000","last_fullsized":"2023-10-06T03:10:19.045676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'94","last_scrub_stamp":"2023-10-06T03:10:19.045347+0000","last_deep_scrub":"26'94","last_deep_scrub_stamp":"2023-10-06T03:10:19.045347+0000","last_clean_scrub_stamp":"2023-10-06T03:10:19.045347+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:56.886921+0000","scrub_duration":0.0044076339999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'245","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:14.182077+0000","last_change":"2023-10-06T03:10:14.182047+0000","last_active":"2023-10-06T03:10:14.182077+0000","last_peered":"2023-10-06T03:10:14.182077+0000","last_clean":"2023-10-06T03:10:14.182077+0000","last_became_active":"2023-10-06T02:59:53.300086+0000","last_became_peered":"2023-10-06T02:59:53.300086+0000","last_unstale":"2023-10-06T03:10:14.182077+0000","last_undegraded":"2023-10-06T03:10:14.182077+0000","last_fullsized":"2023-10-06T03:10:14.182077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'245","last_scrub_stamp":"2023-10-06T03:10:14.181904+0000","last_deep_scrub":"26'245","last_deep_scrub_stamp":"2023-10-06T03:10:14.181904+0000","last_clean_scrub_stamp":"2023-10-06T03:10:14.181904+0000","objects_scrubbed":1,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:20.358000+0000","scrub_duration":0.017879721000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:02.012539+0000","last_change":"2023-10-06T03:10:02.012475+0000","last_active":"2023-10-06T03:10:02.012539+0000","last_peered":"2023-10-06T03:10:02.012539+0000","last_clean":"2023-10-06T03:10:02.012539+0000","last_became_active":"2023-10-06T02:59:49.102397+0000","last_became_peered":"2023-10-06T02:59:49.102397+0000","last_unstale":"2023-10-06T03:10:02.012539+0000","last_undegraded":"2023-10-06T03:10:02.012539+0000","last_fullsized":"2023-10-06T03:10:02.012539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:10:02.012201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:10:02.012201+0000","last_clean_scrub_stamp":"2023-10-06T03:10:02.012201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:16.266178+0000","scrub_duration":0.0038301799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'77","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:30.221042+0000","last_change":"2023-10-06T03:10:30.220966+0000","last_active":"2023-10-06T03:10:30.221042+0000","last_peered":"2023-10-06T03:10:30.221042+0000","last_clean":"2023-10-06T03:10:30.221042+0000","last_became_active":"2023-10-06T02:59:53.675895+0000","last_became_peered":"2023-10-06T02:59:53.675895+0000","last_unstale":"2023-10-06T03:10:30.221042+0000","last_undegraded":"2023-10-06T03:10:30.221042+0000","last_fullsized":"2023-10-06T03:10:30.221042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'77","last_scrub_stamp":"2023-10-06T03:10:30.220665+0000","last_deep_scrub":"26'77","last_deep_scrub_stamp":"2023-10-06T03:10:30.220665+0000","last_clean_scrub_stamp":"2023-10-06T03:10:30.220665+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:29.279026+0000","scrub_duration":0.0042864239999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"26'85","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:11.453952+0000","last_change":"2023-10-06T03:10:11.453859+0000","last_active":"2023-10-06T03:10:11.453952+0000","last_peered":"2023-10-06T03:10:11.453952+0000","last_clean":"2023-10-06T03:10:11.453952+0000","last_became_active":"2023-10-06T02:59:53.676528+0000","last_became_peered":"2023-10-06T02:59:53.676528+0000","last_unstale":"2023-10-06T03:10:11.453952+0000","last_undegraded":"2023-10-06T03:10:11.453952+0000","last_fullsized":"2023-10-06T03:10:11.453952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'85","last_scrub_stamp":"2023-10-06T03:10:11.453577+0000","last_deep_scrub":"26'85","last_deep_scrub_stamp":"2023-10-06T03:10:11.453577+0000","last_clean_scrub_stamp":"2023-10-06T03:10:11.453577+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:17.629673+0000","scrub_duration":0.0039029749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'532","reported_seq":555,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:16.383715+0000","last_change":"2023-10-06T03:10:16.383643+0000","last_active":"2023-10-06T03:10:16.383715+0000","last_peered":"2023-10-06T03:10:16.383715+0000","last_clean":"2023-10-06T03:10:16.383715+0000","last_became_active":"2023-10-06T02:59:53.291434+0000","last_became_peered":"2023-10-06T02:59:53.291434+0000","last_unstale":"2023-10-06T03:10:16.383715+0000","last_undegraded":"2023-10-06T03:10:16.383715+0000","last_fullsized":"2023-10-06T03:10:16.383715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'532","last_scrub_stamp":"2023-10-06T03:10:16.383436+0000","last_deep_scrub":"26'532","last_deep_scrub_stamp":"2023-10-06T03:10:16.383436+0000","last_clean_scrub_stamp":"2023-10-06T03:10:16.383436+0000","objects_scrubbed":4,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:22.523431+0000","scrub_duration":0.025598717999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":4391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'80","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:38.984855+0000","last_change":"2023-10-06T03:10:38.984780+0000","last_active":"2023-10-06T03:10:38.984855+0000","last_peered":"2023-10-06T03:10:38.984855+0000","last_clean":"2023-10-06T03:10:38.984855+0000","last_became_active":"2023-10-06T02:59:53.677924+0000","last_became_peered":"2023-10-06T02:59:53.677924+0000","last_unstale":"2023-10-06T03:10:38.984855+0000","last_undegraded":"2023-10-06T03:10:38.984855+0000","last_fullsized":"2023-10-06T03:10:38.984855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'80","last_scrub_stamp":"2023-10-06T03:10:38.984501+0000","last_deep_scrub":"26'80","last_deep_scrub_stamp":"2023-10-06T03:10:38.984501+0000","last_clean_scrub_stamp":"2023-10-06T03:10:38.984501+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:20.778103+0000","scrub_duration":0.004266616,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"26'338","reported_seq":361,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:35.263523+0000","last_change":"2023-10-06T03:10:35.263400+0000","last_active":"2023-10-06T03:10:35.263523+0000","last_peered":"2023-10-06T03:10:35.263523+0000","last_clean":"2023-10-06T03:10:35.263523+0000","last_became_active":"2023-10-06T02:59:53.300926+0000","last_became_peered":"2023-10-06T02:59:53.300926+0000","last_unstale":"2023-10-06T03:10:35.263523+0000","last_undegraded":"2023-10-06T03:10:35.263523+0000","last_fullsized":"2023-10-06T03:10:35.263523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'338","last_scrub_stamp":"2023-10-06T03:10:35.263147+0000","last_deep_scrub":"26'338","last_deep_scrub_stamp":"2023-10-06T03:10:35.263147+0000","last_clean_scrub_stamp":"2023-10-06T03:10:35.263147+0000","objects_scrubbed":2,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:32.091073+0000","scrub_duration":0.0090030820000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'135","reported_seq":158,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:21.379685+0000","last_change":"2023-10-06T03:10:21.379611+0000","last_active":"2023-10-06T03:10:21.379685+0000","last_peered":"2023-10-06T03:10:21.379685+0000","last_clean":"2023-10-06T03:10:21.379685+0000","last_became_active":"2023-10-06T02:59:53.292493+0000","last_became_peered":"2023-10-06T02:59:53.292493+0000","last_unstale":"2023-10-06T03:10:21.379685+0000","last_undegraded":"2023-10-06T03:10:21.379685+0000","last_fullsized":"2023-10-06T03:10:21.379685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'135","last_scrub_stamp":"2023-10-06T03:10:21.379356+0000","last_deep_scrub":"26'135","last_deep_scrub_stamp":"2023-10-06T03:10:21.379356+0000","last_clean_scrub_stamp":"2023-10-06T03:10:21.379356+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:27.519351+0000","scrub_duration":0.0037082560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"26'94","reported_seq":116,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:22.071844+0000","last_change":"2023-10-06T03:10:22.071705+0000","last_active":"2023-10-06T03:10:22.071844+0000","last_peered":"2023-10-06T03:10:22.071844+0000","last_clean":"2023-10-06T03:10:22.071844+0000","last_became_active":"2023-10-06T02:59:53.676410+0000","last_became_peered":"2023-10-06T02:59:53.676410+0000","last_unstale":"2023-10-06T03:10:22.071844+0000","last_undegraded":"2023-10-06T03:10:22.071844+0000","last_fullsized":"2023-10-06T03:10:22.071844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'94","last_scrub_stamp":"2023-10-06T03:10:22.071378+0000","last_deep_scrub":"26'94","last_deep_scrub_stamp":"2023-10-06T03:10:22.071378+0000","last_clean_scrub_stamp":"2023-10-06T03:10:22.071378+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:54:25.809408+0000","scrub_duration":0.0044959429999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"26'122","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:02.171081+0000","last_change":"2023-10-06T03:10:02.171020+0000","last_active":"2023-10-06T03:10:02.171081+0000","last_peered":"2023-10-06T03:10:02.171081+0000","last_clean":"2023-10-06T03:10:02.171081+0000","last_became_active":"2023-10-06T02:59:53.293596+0000","last_became_peered":"2023-10-06T02:59:53.293596+0000","last_unstale":"2023-10-06T03:10:02.171081+0000","last_undegraded":"2023-10-06T03:10:02.171081+0000","last_fullsized":"2023-10-06T03:10:02.171081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'122","last_scrub_stamp":"2023-10-06T03:10:02.170789+0000","last_deep_scrub":"26'122","last_deep_scrub_stamp":"2023-10-06T03:10:02.170789+0000","last_clean_scrub_stamp":"2023-10-06T03:10:02.170789+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:13.974546+0000","scrub_duration":0.004002299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"26'91","reported_seq":113,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:34.127708+0000","last_change":"2023-10-06T03:10:34.127634+0000","last_active":"2023-10-06T03:10:34.127708+0000","last_peered":"2023-10-06T03:10:34.127708+0000","last_clean":"2023-10-06T03:10:34.127708+0000","last_became_active":"2023-10-06T02:59:53.673559+0000","last_became_peered":"2023-10-06T02:59:53.673559+0000","last_unstale":"2023-10-06T03:10:34.127708+0000","last_undegraded":"2023-10-06T03:10:34.127708+0000","last_fullsized":"2023-10-06T03:10:34.127708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'91","last_scrub_stamp":"2023-10-06T03:10:34.127350+0000","last_deep_scrub":"26'91","last_deep_scrub_stamp":"2023-10-06T03:10:34.127350+0000","last_clean_scrub_stamp":"2023-10-06T03:10:34.127350+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:33.185711+0000","scrub_duration":0.0041150700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"26'76","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:14.006345+0000","last_change":"2023-10-06T03:10:14.006299+0000","last_active":"2023-10-06T03:10:14.006345+0000","last_peered":"2023-10-06T03:10:14.006345+0000","last_clean":"2023-10-06T03:10:14.006345+0000","last_became_active":"2023-10-06T02:59:53.674086+0000","last_became_peered":"2023-10-06T02:59:53.674086+0000","last_unstale":"2023-10-06T03:10:14.006345+0000","last_undegraded":"2023-10-06T03:10:14.006345+0000","last_fullsized":"2023-10-06T03:10:14.006345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'76","last_scrub_stamp":"2023-10-06T03:10:14.006109+0000","last_deep_scrub":"26'76","last_deep_scrub_stamp":"2023-10-06T03:10:14.006109+0000","last_clean_scrub_stamp":"2023-10-06T03:10:14.006109+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:41.887624+0000","scrub_duration":0.0031022850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'1577","reported_seq":1600,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:14.100221+0000","last_change":"2023-10-06T03:10:14.100176+0000","last_active":"2023-10-06T03:10:14.100221+0000","last_peered":"2023-10-06T03:10:14.100221+0000","last_clean":"2023-10-06T03:10:14.100221+0000","last_became_active":"2023-10-06T02:59:53.296550+0000","last_became_peered":"2023-10-06T02:59:53.296550+0000","last_unstale":"2023-10-06T03:10:14.100221+0000","last_undegraded":"2023-10-06T03:10:14.100221+0000","last_fullsized":"2023-10-06T03:10:14.100221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1577","last_scrub_stamp":"2023-10-06T03:10:14.100012+0000","last_deep_scrub":"26'1577","last_deep_scrub_stamp":"2023-10-06T03:10:14.100012+0000","last_clean_scrub_stamp":"2023-10-06T03:10:14.100012+0000","objects_scrubbed":2,"log_size":1577,"log_dups_size":0,"ondisk_log_size":1577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:41.981527+0000","scrub_duration":0.036199587999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7633302,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1449,"num_write_kb":8304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'82","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:43.087093+0000","last_change":"2023-10-06T03:10:43.086957+0000","last_active":"2023-10-06T03:10:43.087093+0000","last_peered":"2023-10-06T03:10:43.087093+0000","last_clean":"2023-10-06T03:10:43.087093+0000","last_became_active":"2023-10-06T02:59:53.683458+0000","last_became_peered":"2023-10-06T02:59:53.683458+0000","last_unstale":"2023-10-06T03:10:43.087093+0000","last_undegraded":"2023-10-06T03:10:43.087093+0000","last_fullsized":"2023-10-06T03:10:43.087093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'82","last_scrub_stamp":"2023-10-06T03:10:43.086690+0000","last_deep_scrub":"26'82","last_deep_scrub_stamp":"2023-10-06T03:10:43.086690+0000","last_clean_scrub_stamp":"2023-10-06T03:10:43.086690+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:08.511337+0000","scrub_duration":0.004458994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'118","reported_seq":141,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:05.967468+0000","last_change":"2023-10-06T03:10:05.967386+0000","last_active":"2023-10-06T03:10:05.967468+0000","last_peered":"2023-10-06T03:10:05.967468+0000","last_clean":"2023-10-06T03:10:05.967468+0000","last_became_active":"2023-10-06T02:59:53.300797+0000","last_became_peered":"2023-10-06T02:59:53.300797+0000","last_unstale":"2023-10-06T03:10:05.967468+0000","last_undegraded":"2023-10-06T03:10:05.967468+0000","last_fullsized":"2023-10-06T03:10:05.967468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'118","last_scrub_stamp":"2023-10-06T03:10:05.967098+0000","last_deep_scrub":"26'118","last_deep_scrub_stamp":"2023-10-06T03:10:05.967098+0000","last_clean_scrub_stamp":"2023-10-06T03:10:05.967098+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:44.663720+0000","scrub_duration":0.0045722510000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"26'77","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:45.160972+0000","last_change":"2023-10-06T03:10:45.160901+0000","last_active":"2023-10-06T03:10:45.160972+0000","last_peered":"2023-10-06T03:10:45.160972+0000","last_clean":"2023-10-06T03:10:45.160972+0000","last_became_active":"2023-10-06T02:59:53.683301+0000","last_became_peered":"2023-10-06T02:59:53.683301+0000","last_unstale":"2023-10-06T03:10:45.160972+0000","last_undegraded":"2023-10-06T03:10:45.160972+0000","last_fullsized":"2023-10-06T03:10:45.160972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'77","last_scrub_stamp":"2023-10-06T03:10:45.160641+0000","last_deep_scrub":"26'77","last_deep_scrub_stamp":"2023-10-06T03:10:45.160641+0000","last_clean_scrub_stamp":"2023-10-06T03:10:45.160641+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:10.585287+0000","scrub_duration":0.0040883109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'490","reported_seq":513,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:29.274764+0000","last_change":"2023-10-06T03:10:29.274712+0000","last_active":"2023-10-06T03:10:29.274764+0000","last_peered":"2023-10-06T03:10:29.274764+0000","last_clean":"2023-10-06T03:10:29.274764+0000","last_became_active":"2023-10-06T02:59:53.297724+0000","last_became_peered":"2023-10-06T02:59:53.297724+0000","last_unstale":"2023-10-06T03:10:29.274764+0000","last_undegraded":"2023-10-06T03:10:29.274764+0000","last_fullsized":"2023-10-06T03:10:29.274764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'490","last_scrub_stamp":"2023-10-06T03:10:29.274528+0000","last_deep_scrub":"26'490","last_deep_scrub_stamp":"2023-10-06T03:10:29.274528+0000","last_clean_scrub_stamp":"2023-10-06T03:10:29.274528+0000","objects_scrubbed":1,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:26.102454+0000","scrub_duration":0.021059049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":4283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'74","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:01.727031+0000","last_change":"2023-10-06T03:10:01.726976+0000","last_active":"2023-10-06T03:10:01.727031+0000","last_peered":"2023-10-06T03:10:01.727031+0000","last_clean":"2023-10-06T03:10:01.727031+0000","last_became_active":"2023-10-06T02:59:53.684378+0000","last_became_peered":"2023-10-06T02:59:53.684378+0000","last_unstale":"2023-10-06T03:10:01.727031+0000","last_undegraded":"2023-10-06T03:10:01.727031+0000","last_fullsized":"2023-10-06T03:10:01.727031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'74","last_scrub_stamp":"2023-10-06T03:10:01.726739+0000","last_deep_scrub":"26'74","last_deep_scrub_stamp":"2023-10-06T03:10:01.726739+0000","last_clean_scrub_stamp":"2023-10-06T03:10:01.726739+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:19.568134+0000","scrub_duration":0.0023701149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"26'936","reported_seq":959,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:01.195525+0000","last_change":"2023-10-06T03:10:01.195483+0000","last_active":"2023-10-06T03:10:01.195525+0000","last_peered":"2023-10-06T03:10:01.195525+0000","last_clean":"2023-10-06T03:10:01.195525+0000","last_became_active":"2023-10-06T02:59:53.297471+0000","last_became_peered":"2023-10-06T02:59:53.297471+0000","last_unstale":"2023-10-06T03:10:01.195525+0000","last_undegraded":"2023-10-06T03:10:01.195525+0000","last_fullsized":"2023-10-06T03:10:01.195525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'936","last_scrub_stamp":"2023-10-06T03:10:01.195322+0000","last_deep_scrub":"26'936","last_deep_scrub_stamp":"2023-10-06T03:10:01.195322+0000","last_clean_scrub_stamp":"2023-10-06T03:10:01.195322+0000","objects_scrubbed":1,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:01.239609+0000","scrub_duration":0.024228012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":4592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'78","reported_seq":100,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:46.171072+0000","last_change":"2023-10-06T03:10:46.170996+0000","last_active":"2023-10-06T03:10:46.171072+0000","last_peered":"2023-10-06T03:10:46.171072+0000","last_clean":"2023-10-06T03:10:46.171072+0000","last_became_active":"2023-10-06T02:59:53.678831+0000","last_became_peered":"2023-10-06T02:59:53.678831+0000","last_unstale":"2023-10-06T03:10:46.171072+0000","last_undegraded":"2023-10-06T03:10:46.171072+0000","last_fullsized":"2023-10-06T03:10:46.171072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'78","last_scrub_stamp":"2023-10-06T03:10:46.170732+0000","last_deep_scrub":"26'78","last_deep_scrub_stamp":"2023-10-06T03:10:46.170732+0000","last_clean_scrub_stamp":"2023-10-06T03:10:46.170732+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:40.603564+0000","scrub_duration":0.0045047560000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"26'114","reported_seq":137,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:26.476464+0000","last_change":"2023-10-06T03:10:26.476389+0000","last_active":"2023-10-06T03:10:26.476464+0000","last_peered":"2023-10-06T03:10:26.476464+0000","last_clean":"2023-10-06T03:10:26.476464+0000","last_became_active":"2023-10-06T02:59:53.295697+0000","last_became_peered":"2023-10-06T02:59:53.295697+0000","last_unstale":"2023-10-06T03:10:26.476464+0000","last_undegraded":"2023-10-06T03:10:26.476464+0000","last_fullsized":"2023-10-06T03:10:26.476464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'114","last_scrub_stamp":"2023-10-06T03:10:26.476117+0000","last_deep_scrub":"26'114","last_deep_scrub_stamp":"2023-10-06T03:10:26.476117+0000","last_clean_scrub_stamp":"2023-10-06T03:10:26.476117+0000","objects_scrubbed":1,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:54.598101+0000","scrub_duration":0.0072948750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'99","reported_seq":121,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:09.384832+0000","last_change":"2023-10-06T03:10:09.384741+0000","last_active":"2023-10-06T03:10:09.384832+0000","last_peered":"2023-10-06T03:10:09.384832+0000","last_clean":"2023-10-06T03:10:09.384832+0000","last_became_active":"2023-10-06T02:59:53.672629+0000","last_became_peered":"2023-10-06T02:59:53.672629+0000","last_unstale":"2023-10-06T03:10:09.384832+0000","last_undegraded":"2023-10-06T03:10:09.384832+0000","last_fullsized":"2023-10-06T03:10:09.384832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2023-10-06T03:10:09.384456+0000","last_deep_scrub":"26'99","last_deep_scrub_stamp":"2023-10-06T03:10:09.384456+0000","last_clean_scrub_stamp":"2023-10-06T03:10:09.384456+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:37.265971+0000","scrub_duration":0.0040951579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'1074","reported_seq":1097,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:25.484981+0000","last_change":"2023-10-06T03:10:25.484904+0000","last_active":"2023-10-06T03:10:25.484981+0000","last_peered":"2023-10-06T03:10:25.484981+0000","last_clean":"2023-10-06T03:10:25.484981+0000","last_became_active":"2023-10-06T02:59:53.296843+0000","last_became_peered":"2023-10-06T02:59:53.296843+0000","last_unstale":"2023-10-06T03:10:25.484981+0000","last_undegraded":"2023-10-06T03:10:25.484981+0000","last_fullsized":"2023-10-06T03:10:25.484981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1074","last_scrub_stamp":"2023-10-06T03:10:25.484703+0000","last_deep_scrub":"26'1074","last_deep_scrub_stamp":"2023-10-06T03:10:25.484703+0000","last_clean_scrub_stamp":"2023-10-06T03:10:25.484703+0000","objects_scrubbed":3,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:30.945538+0000","scrub_duration":0.040221699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":8534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"26'89","reported_seq":111,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:33.170566+0000","last_change":"2023-10-06T03:10:33.170491+0000","last_active":"2023-10-06T03:10:33.170566+0000","last_peered":"2023-10-06T03:10:33.170566+0000","last_clean":"2023-10-06T03:10:33.170566+0000","last_became_active":"2023-10-06T02:59:53.673662+0000","last_became_peered":"2023-10-06T02:59:53.673662+0000","last_unstale":"2023-10-06T03:10:33.170566+0000","last_undegraded":"2023-10-06T03:10:33.170566+0000","last_fullsized":"2023-10-06T03:10:33.170566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'89","last_scrub_stamp":"2023-10-06T03:10:33.170232+0000","last_deep_scrub":"26'89","last_deep_scrub_stamp":"2023-10-06T03:10:33.170232+0000","last_clean_scrub_stamp":"2023-10-06T03:10:33.170232+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:29.998158+0000","scrub_duration":0.0040621269999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"26'538","reported_seq":561,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:04.152442+0000","last_change":"2023-10-06T03:10:04.152368+0000","last_active":"2023-10-06T03:10:04.152442+0000","last_peered":"2023-10-06T03:10:04.152442+0000","last_clean":"2023-10-06T03:10:04.152442+0000","last_became_active":"2023-10-06T02:59:53.298881+0000","last_became_peered":"2023-10-06T02:59:53.298881+0000","last_unstale":"2023-10-06T03:10:04.152442+0000","last_undegraded":"2023-10-06T03:10:04.152442+0000","last_fullsized":"2023-10-06T03:10:04.152442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'538","last_scrub_stamp":"2023-10-06T03:10:04.152201+0000","last_deep_scrub":"26'538","last_deep_scrub_stamp":"2023-10-06T03:10:04.152201+0000","last_clean_scrub_stamp":"2023-10-06T03:10:04.152201+0000","objects_scrubbed":1,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:04.196488+0000","scrub_duration":0.023718249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'87","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:15.347106+0000","last_change":"2023-10-06T03:10:15.347035+0000","last_active":"2023-10-06T03:10:15.347106+0000","last_peered":"2023-10-06T03:10:15.347106+0000","last_clean":"2023-10-06T03:10:15.347106+0000","last_became_active":"2023-10-06T02:59:53.675092+0000","last_became_peered":"2023-10-06T02:59:53.675092+0000","last_unstale":"2023-10-06T03:10:15.347106+0000","last_undegraded":"2023-10-06T03:10:15.347106+0000","last_fullsized":"2023-10-06T03:10:15.347106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'87","last_scrub_stamp":"2023-10-06T03:10:15.346771+0000","last_deep_scrub":"26'87","last_deep_scrub_stamp":"2023-10-06T03:10:15.346771+0000","last_clean_scrub_stamp":"2023-10-06T03:10:15.346771+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:42.790125+0000","scrub_duration":0.0041187369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"26'555","reported_seq":578,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:10:17.213065+0000","last_change":"2023-10-06T03:10:17.213012+0000","last_active":"2023-10-06T03:10:17.213065+0000","last_peered":"2023-10-06T03:10:17.213065+0000","last_clean":"2023-10-06T03:10:17.213065+0000","last_became_active":"2023-10-06T02:59:53.293752+0000","last_became_peered":"2023-10-06T02:59:53.293752+0000","last_unstale":"2023-10-06T03:10:17.213065+0000","last_undegraded":"2023-10-06T03:10:17.213065+0000","last_fullsized":"2023-10-06T03:10:17.213065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'555","last_scrub_stamp":"2023-10-06T03:10:17.212836+0000","last_deep_scrub":"26'555","last_deep_scrub_stamp":"2023-10-06T03:10:17.212836+0000","last_clean_scrub_stamp":"2023-10-06T03:10:17.212836+0000","objects_scrubbed":3,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:55.054409+0000","scrub_duration":0.024957905999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":438,"num_write_kb":4309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":75513604,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":483,"num_read_kb":1079,"num_write":11546,"num_write_kb":80285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151085056,"data_stored":151027208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15227,"ondisk_log_size":15227,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574988,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314548,"kb_used_data":17260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057292,"statfs":{"total":96636764160,"available":96314667008,"internally_reserved":0,"allocated":17674240,"data_stored":17475112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.91600000000000004,"15min":0.87},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.41099999999999998},"max":{"1min":1.1950000000000001,"5min":1.893,"15min":1.893},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.004,"15min":0.98699999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.216,"5min":1.8,"15min":1.8},"last":0.88300000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92600000000000005,"15min":0.92400000000000004},"min":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.51900000000000002},"max":{"1min":1.2170000000000001,"5min":1.349,"15min":1.389},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.38500000000000001},"max":{"1min":1.2350000000000001,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.81999999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90800000000000003,"15min":0.94799999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.55800000000000005},"max":{"1min":1.248,"5min":1.333,"15min":1.4199999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.069,"15min":1.119},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.302,"5min":1.3779999999999999,"15min":1.6359999999999999},"last":1.151}]},{"osd":3,"last update":"Fri Oct 6 03:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.95299999999999996,"15min":0.94799999999999995},"min":{"1min":0.63200000000000001,"5min":0.56599999999999995,"15min":0.44600000000000001},"max":{"1min":1.2689999999999999,"5min":3.609,"15min":3.609},"last":1.105},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.081,"15min":1.0840000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.66900000000000004},"max":{"1min":1.3340000000000001,"5min":2.444,"15min":2.444},"last":0.995}]},{"osd":4,"last update":"Fri Oct 6 03:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89900000000000002,"15min":0.90700000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.50600000000000001},"max":{"1min":1.1819999999999999,"5min":1.855,"15min":1.855},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0189999999999999,"15min":1.0429999999999999},"min":{"1min":0.69199999999999995,"5min":0.68700000000000006,"15min":0.57499999999999996},"max":{"1min":1.2729999999999999,"5min":1.3919999999999999,"15min":1.4590000000000001},"last":1.0229999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:10:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.071,"15min":1.1279999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.61099999999999999},"max":{"1min":1.3100000000000001,"5min":1.51,"15min":1.833},"last":1.274},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.034,"15min":1.052},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.59199999999999997},"max":{"1min":1.2889999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.238}]},{"osd":6,"last update":"Fri Oct 6 03:10:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0900000000000001,"15min":1.1080000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3029999999999999,"5min":1.929,"15min":1.929},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.153,"15min":1.181},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76100000000000001},"max":{"1min":1.353,"5min":1.5660000000000001,"15min":1.5860000000000001},"last":1.2050000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574987,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309848,"kb_used_data":4368,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94061992,"statfs":{"total":96636764160,"available":96319479808,"internally_reserved":0,"allocated":4472832,"data_stored":4300972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94199999999999995,"15min":1.0009999999999999},"min":{"1min":0.53600000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.302,"5min":1.548,"15min":6.6989999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.98599999999999999,"15min":1.0629999999999999},"min":{"1min":0.58399999999999996,"5min":0.54900000000000004,"15min":0.53200000000000003},"max":{"1min":1.196,"5min":1.9450000000000001,"15min":6.9199999999999999},"last":0.83699999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.84999999999999998,"15min":0.871},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.434},"max":{"1min":1.264,"5min":1.73,"15min":1.73},"last":0.623},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.87,"15min":0.89100000000000001},"min":{"1min":0.58299999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.88,"15min":0.88300000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.51700000000000002},"max":{"1min":1.1870000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90500000000000003,"15min":0.93300000000000005},"min":{"1min":0.67900000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0620000000000001,"5min":1.798,"15min":1.798},"last":0.77500000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.94499999999999995},"min":{"1min":0.72299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.45,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0129999999999999,"15min":1.0169999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.52500000000000002},"max":{"1min":1.302,"5min":2.278,"15min":2.278},"last":1.0589999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.93300000000000005,"15min":1.2130000000000001},"min":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.56000000000000005},"max":{"1min":1.5449999999999999,"5min":1.7609999999999999,"15min":17.757000000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.115,"15min":1.3979999999999999},"min":{"1min":0.84999999999999998,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.381,"5min":2.734,"15min":17.382999999999999},"last":0.97899999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.0029999999999999,"15min":1.0980000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.61599999999999999},"max":{"1min":1.173,"5min":2.548,"15min":4.3090000000000002},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1799999999999999,"15min":1.2310000000000001},"min":{"1min":1.0029999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.516,"5min":3.3500000000000001,"15min":4.5709999999999997},"last":1.4079999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1020000000000001,"15min":1.1359999999999999},"min":{"1min":0.73999999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.4510000000000001,"5min":2.476,"15min":2.476},"last":1.153},{"interface":"front","average":{"1min":1.056,"5min":1.1279999999999999,"15min":1.1619999999999999},"min":{"1min":0.83999999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.226,"5min":3.919,"15min":3.919},"last":1.103}]}]},{"osd":5,"up_from":13,"seq":55834574988,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326240,"kb_used_data":24856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94045600,"statfs":{"total":96636764160,"available":96302694400,"internally_reserved":0,"allocated":25452544,"data_stored":25273116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.878,"15min":0.88500000000000001},"min":{"1min":0.57599999999999996,"5min":0.47599999999999998,"15min":0.40799999999999997},"max":{"1min":1.198,"5min":1.2250000000000001,"15min":1.2849999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.96299999999999997,"15min":1},"min":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.54800000000000004},"max":{"1min":1.2190000000000001,"5min":1.339,"15min":1.339},"last":1.149}]},{"osd":1,"last update":"Fri Oct 6 03:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.87,"15min":0.88200000000000001},"min":{"1min":0.629,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1499999999999999,"5min":1.321,"15min":1.363},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92200000000000004,"15min":0.90700000000000003},"min":{"1min":0.70299999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.755}]},{"osd":2,"last update":"Fri Oct 6 03:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.876,"15min":0.89200000000000002},"min":{"1min":0.65500000000000003,"5min":0.56999999999999995,"15min":0.53400000000000003},"max":{"1min":1.2,"5min":1.27,"15min":1.405},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.98499999999999999,"15min":0.98699999999999999},"min":{"1min":0.81999999999999995,"5min":0.59399999999999997,"15min":0.44500000000000001},"max":{"1min":1.2350000000000001,"5min":1.4610000000000001,"15min":1.6220000000000001},"last":0.95499999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:11:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.96599999999999997,"15min":0.95699999999999996},"min":{"1min":0.77600000000000002,"5min":0.59999999999999998,"15min":0.59599999999999997},"max":{"1min":1.2949999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.234},{"interface":"front","average":{"1min":1.026,"5min":1.056,"15min":1.044},"min":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.68999999999999995},"max":{"1min":1.276,"5min":1.3720000000000001,"15min":1.53},"last":1.127}]},{"osd":4,"last update":"Fri Oct 6 03:11:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.97899999999999998,"15min":0.93700000000000006},"min":{"1min":0.75600000000000001,"5min":0.61399999999999999,"15min":0.46999999999999997},"max":{"1min":1.4399999999999999,"5min":1.446,"15min":1.446},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.099,"15min":1.077},"min":{"1min":0.81200000000000006,"5min":0.68400000000000005,"15min":0.60599999999999998},"max":{"1min":1.496,"5min":1.577,"15min":1.657},"last":1.3129999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:11:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.087,"15min":1.0549999999999999},"min":{"1min":0.72199999999999998,"5min":0.68600000000000005,"15min":0.58399999999999996},"max":{"1min":1.3180000000000001,"5min":1.546,"15min":1.546},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1240000000000001,"15min":1.0900000000000001},"min":{"1min":0.86199999999999999,"5min":0.77200000000000002,"15min":0.441},"max":{"1min":1.5329999999999999,"5min":1.536,"15min":1.538},"last":1.097}]},{"osd":7,"last update":"Fri Oct 6 03:11:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.169,"15min":1.1679999999999999},"min":{"1min":0.99399999999999999,"5min":0.748,"15min":0.748},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2190000000000001},"min":{"1min":0.90600000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.4399999999999999,"5min":1.637,"15min":2.048},"last":1.1850000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574989,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335192,"kb_used_data":29712,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94036648,"statfs":{"total":96636764160,"available":96293527552,"internally_reserved":0,"allocated":30425088,"data_stored":30237520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.55200000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0629999999999999,"5min":1.302,"15min":1.4830000000000001},"last":1.014},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.89200000000000002,"15min":0.92300000000000004},"min":{"1min":0.56499999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.5289999999999999},"last":0.82299999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86199999999999999,"15min":0.86799999999999999},"min":{"1min":0.52200000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.879,"15min":0.88900000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.49199999999999999},"max":{"1min":1.091,"5min":1.387,"15min":1.387},"last":1.2150000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94699999999999995,"15min":0.96499999999999997},"min":{"1min":0.59299999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.4159999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.75600000000000001,"5min":0.63900000000000001,"15min":0.53700000000000003},"max":{"1min":1.3049999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.165}]},{"osd":3,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.94899999999999995,"15min":0.97099999999999997},"min":{"1min":0.66300000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3759999999999999,"5min":1.3839999999999999,"15min":1.3859999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97299999999999998,"15min":0.999},"min":{"1min":0.61899999999999999,"5min":0.57399999999999995,"15min":0.56200000000000006},"max":{"1min":1.351,"5min":1.625,"15min":1.625},"last":1.0640000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92000000000000004,"15min":0.95399999999999996},"min":{"1min":0.53400000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.87},{"interface":"front","average":{"1min":1.109,"5min":1.0309999999999999,"15min":1.075},"min":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4610000000000001,"5min":1.526,"15min":1.526},"last":1.1060000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.018,"15min":1.0549999999999999},"min":{"1min":0.71399999999999997,"5min":0.629,"15min":0.61299999999999999},"max":{"1min":1.3839999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.046,"15min":1.083},"min":{"1min":0.71399999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.141}]},{"osd":7,"last update":"Fri Oct 6 03:10:09 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.1160000000000001,"15min":1.1699999999999999},"min":{"1min":0.82099999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4970000000000001,"5min":1.5629999999999999,"15min":1.7629999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.1619999999999999,"15min":1.2050000000000001},"min":{"1min":0.84599999999999997,"5min":0.753,"15min":0.56299999999999994},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.6140000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574988,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333692,"kb_used_data":28212,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94038148,"statfs":{"total":96636764160,"available":96295063552,"internally_reserved":0,"allocated":28889088,"data_stored":28711580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70299999999999996,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.0700000000000001,"5min":1.27,"15min":1.464},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.502,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.008,"5min":1.252,"15min":2.0310000000000001},"last":0.60999999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.72399999999999998,"15min":0.91900000000000004},"min":{"1min":0.53900000000000003,"5min":0.38800000000000001,"15min":0.375},"max":{"1min":1.091,"5min":1.3049999999999999,"15min":10.970000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80500000000000005,"15min":0.82699999999999996},"min":{"1min":0.56399999999999995,"5min":0.371,"15min":0.371},"max":{"1min":1.125,"5min":1.387,"15min":1.694},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.81299999999999994,"15min":0.85699999999999998},"min":{"1min":0.64400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.0940000000000001,"5min":1.2110000000000001,"15min":1.6419999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.89600000000000002,"15min":0.92300000000000004},"min":{"1min":0.73399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2909999999999999,"5min":1.323,"15min":1.333},"last":0.94499999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.96299999999999997,"15min":1.008},"min":{"1min":0.68400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.272,"5min":1.4099999999999999,"15min":1.855},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.087,"15min":1.1319999999999999},"min":{"1min":0.84799999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.373,"5min":1.421,"15min":2.3570000000000002},"last":1.004}]},{"osd":5,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0369999999999999,"15min":1.099},"min":{"1min":0.876,"5min":0.621,"15min":0.61099999999999999},"max":{"1min":1.373,"5min":1.518,"15min":2.218},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.133,"15min":1.246},"min":{"1min":0.86899999999999999,"5min":0.629,"15min":0.629},"max":{"1min":1.478,"5min":1.5649999999999999,"15min":5.585},"last":1.0940000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.0880000000000001,"15min":1.1950000000000001},"min":{"1min":0.84599999999999997,"5min":0.63,"15min":0.63},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":5.0860000000000003},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.1830000000000001,"15min":1.2190000000000001},"min":{"1min":1.1040000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.1930000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.212,"15min":1.3149999999999999},"min":{"1min":1.093,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.554,"5min":1.8500000000000001,"15min":5.6239999999999997},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.155,"15min":1.252},"min":{"1min":0.93500000000000005,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.601,"5min":1.601,"15min":5.1310000000000002},"last":1.4490000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574989,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318040,"kb_used_data":8464,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94053800,"statfs":{"total":96636764160,"available":96311091200,"internally_reserved":0,"allocated":8667136,"data_stored":8495276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64200000000000002,"15min":0.68899999999999995},"min":{"1min":0.498,"5min":0.33300000000000002,"15min":0.29799999999999999},"max":{"1min":0.79700000000000004,"5min":0.99099999999999999,"15min":1.4019999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.70499999999999996,"15min":0.749},"min":{"1min":0.63500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1,"5min":1.0840000000000001,"15min":1.8799999999999999},"last":0.875}]},{"osd":1,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73799999999999999,"15min":0.72999999999999998},"min":{"1min":0.53800000000000003,"5min":0.49299999999999999,"15min":0.33300000000000002},"max":{"1min":1.01,"5min":1.224,"15min":1.224},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83599999999999997,"15min":0.83999999999999997},"min":{"1min":0.442,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.056,"5min":1.1719999999999999,"15min":1.341},"last":1.0369999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.85499999999999998,"15min":0.86299999999999999},"min":{"1min":0.52300000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.163,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.073},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91300000000000003,"15min":0.96199999999999997},"min":{"1min":0.67800000000000005,"5min":0.51200000000000001,"15min":0.46000000000000002},"max":{"1min":1.179,"5min":1.296,"15min":1.587},"last":0.94699999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96299999999999997,"15min":1.0169999999999999},"min":{"1min":0.627,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.617,"5min":1.6419999999999999,"15min":1.6779999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0820000000000001,"15min":1.099},"min":{"1min":0.85999999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4850000000000001,"5min":1.611,"15min":1.9350000000000001},"last":1.25}]},{"osd":5,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.1220000000000001,"15min":1.139},"min":{"1min":0.79200000000000004,"5min":0.75900000000000001,"15min":0.64900000000000002},"max":{"1min":1.3540000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.292},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.077,"15min":1.109},"min":{"1min":0.73999999999999999,"5min":0.63,"15min":0.60499999999999998},"max":{"1min":1.468,"5min":1.6459999999999999,"15min":2.048},"last":1.4199999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1579999999999999,"15min":1.1910000000000001},"min":{"1min":0.89800000000000002,"5min":0.70499999999999996,"15min":0.68600000000000005},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":2.7040000000000002},"last":1.355},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1950000000000001,"15min":1.2350000000000001},"min":{"1min":0.77800000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4199999999999999,"5min":1.677,"15min":2.2000000000000002},"last":1.2090000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:10:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.1419999999999999,"15min":1.208},"min":{"1min":0.879,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.528,"5min":1.6359999999999999,"15min":2.286},"last":1.528},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.244,"15min":1.2829999999999999},"min":{"1min":0.97499999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.6200000000000001,"5min":1.669,"15min":2.3940000000000001},"last":1.468}]}]},{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313944,"kb_used_data":16656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94057896,"statfs":{"total":96636764160,"available":96315285504,"internally_reserved":0,"allocated":17055744,"data_stored":16883884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.69199999999999995,"15min":0.68300000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.23599999999999999},"max":{"1min":0.873,"5min":1.179,"15min":1.179},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79900000000000004,"15min":0.79600000000000004},"min":{"1min":0.434,"5min":0.42299999999999999,"15min":0.39300000000000002},"max":{"1min":0.99399999999999999,"5min":1.218,"15min":1.3089999999999999},"last":0.96299999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69699999999999995,"15min":0.70099999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.264,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.83499999999999996,"15min":0.85799999999999998},"min":{"1min":0.54600000000000004,"5min":0.42299999999999999,"15min":0.36599999999999999},"max":{"1min":1.222,"5min":1.3109999999999999,"15min":1.3169999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91900000000000004,"15min":0.88300000000000001},"min":{"1min":0.63100000000000001,"5min":0.5,"15min":0.42299999999999999},"max":{"1min":1.226,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.54000000000000004,"5min":0.503,"15min":0.49199999999999999},"max":{"1min":1.119,"5min":1.2270000000000001,"15min":1.337},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.95299999999999996,"15min":0.97699999999999998},"min":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.51300000000000001},"max":{"1min":1.3540000000000001,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.129,"15min":1.1040000000000001},"min":{"1min":0.68600000000000005,"5min":0.65800000000000003,"15min":0.437},"max":{"1min":1.4299999999999999,"5min":1.556,"15min":1.6060000000000001},"last":0.83699999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0680000000000001,"15min":1.0760000000000001},"min":{"1min":0.76300000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4239999999999999,"5min":1.587,"15min":1.587},"last":1.046},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.081,"15min":1.075},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.61199999999999999},"max":{"1min":1.496,"5min":1.911,"15min":1.911},"last":0.92500000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.155,"15min":1.1519999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.70499999999999996},"max":{"1min":1.591,"5min":2.081,"15min":2.081},"last":1.129},{"interface":"front","average":{"1min":1.159,"5min":1.1359999999999999,"15min":1.163},"min":{"1min":0.79000000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4950000000000001,"5min":1.996,"15min":1.996},"last":1.022}]},{"osd":7,"last update":"Fri Oct 6 03:10:04 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.206,"15min":1.1990000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.498},"max":{"1min":1.472,"5min":1.6879999999999999,"15min":1.8999999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.181,"5min":1.2090000000000001,"15min":1.2230000000000001},"min":{"1min":0.82499999999999996,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.5009999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.204}]}]},{"osd":0,"up_from":13,"seq":55834574989,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322736,"kb_used_data":21352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94049104,"statfs":{"total":96636764160,"available":96306282496,"internally_reserved":0,"allocated":21864448,"data_stored":21683828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.68500000000000005,"15min":0.66900000000000004},"min":{"1min":0.38200000000000001,"5min":0.30199999999999999,"15min":0.26900000000000002},"max":{"1min":0.72799999999999998,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.755,"15min":0.747},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.34899999999999998},"max":{"1min":1.0429999999999999,"5min":1.2290000000000001,"15min":1.2849999999999999},"last":0.83299999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.504,"5min":0.40600000000000003,"15min":0.33900000000000002},"max":{"1min":1.04,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.012},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.69599999999999995,"15min":0.71099999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.871,"5min":1.0720000000000001,"15min":1.2669999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83199999999999996,"15min":0.81200000000000006},"min":{"1min":0.59399999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0940000000000001,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.89200000000000002,"15min":0.92000000000000004},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.34599999999999997},"max":{"1min":1.159,"5min":1.3580000000000001,"15min":1.599},"last":0.629}]},{"osd":4,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.92100000000000004,"15min":0.94799999999999995},"min":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.179,"5min":1.5129999999999999,"15min":1.52},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.091,"15min":1.0960000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.248,"5min":1.859,"15min":1.859},"last":0.92700000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.1100000000000001,"15min":1.1299999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3779999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.999},{"interface":"front","average":{"1min":1.05,"5min":1.151,"15min":1.153},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.411,"5min":1.573,"15min":1.573},"last":1.0980000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.155,"15min":1.165},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.466,"5min":1.6359999999999999,"15min":1.7050000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.014,"5min":1.0880000000000001,"15min":1.105},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3759999999999999,"5min":1.579,"15min":2.1579999999999999},"last":1.042}]},{"osd":7,"last update":"Fri Oct 6 03:09:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1479999999999999,"15min":1.1539999999999999},"min":{"1min":0.78500000000000003,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.4359999999999999,"5min":1.7090000000000001,"15min":2.2480000000000002},"last":1.202},{"interface":"front","average":{"1min":1.079,"5min":1.2190000000000001,"15min":1.2370000000000001},"min":{"1min":0.64700000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.329,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.173}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20992000,"data_stored":20986792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28610560,"data_stored":28604912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30146560,"data_stored":30130852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16801792,"data_stored":16778076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:11:03.690 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T03:11:03.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.795+0000 7f56b1ecc700 1 Processor -- start 2023-10-06T03:11:03.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.795+0000 7f56b1ecc700 1 -- start start 2023-10-06T03:11:03.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56b1ecc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56ac0a2670 0x7f56ac0b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:03.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56b1ecc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f56ac0b4c80 0x7f56ac0b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:03.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56b1ecc700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ac06c2c0 con 0x7f56ac0a22a0 2023-10-06T03:11:03.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56b1ecc700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ac0ba980 con 0x7f56ac0a2670 2023-10-06T03:11:03.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56b1ecc700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac06bc70 con 0x7f56ac0b4c80 2023-10-06T03:11:03.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56ab7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f56ac0a22a0 0x7f56ac067ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51680/0 (socket says 172.21.15.27:51680) 2023-10-06T03:11:03.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56ab7fe700 1 -- 172.21.15.27:0/3652743384 learned_addr learned my addr 172.21.15.27:0/3652743384 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:11:03.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56a2ffd700 1 --2- 172.21.15.27:0/3652743384 >> v2:172.21.15.123:3300/0 conn(0x7f56ac0a2670 0x7f56ac0b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:03.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56abfff700 1 --2- 172.21.15.27:0/3652743384 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f56ac0b4c80 0x7f56ac0b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:03.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56aaffd700 1 -- 172.21.15.27:0/3652743384 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775996593 0 0) 0x7f56ac06c2c0 con 0x7f56ac0a22a0 2023-10-06T03:11:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56aaffd700 1 -- 172.21.15.27:0/3652743384 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f568c003570 con 0x7f56ac0a22a0 2023-10-06T03:11:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56a2ffd700 1 -- 172.21.15.27:0/3652743384 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f56ac0b4c80 msgr2=0x7f56ac0b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:11:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56a2ffd700 1 --2- 172.21.15.27:0/3652743384 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f56ac0b4c80 0x7f56ac0b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56a2ffd700 1 -- 172.21.15.27:0/3652743384 >> v1:172.21.15.27:6789/0 conn(0x7f56ac0a22a0 legacy=0x7f56ac067ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56a2ffd700 1 -- 172.21.15.27:0/3652743384 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac06bf50 con 0x7f56ac0a2670 2023-10-06T03:11:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56a2ffd700 1 --2- 172.21.15.27:0/3652743384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56ac0a2670 0x7f56ac0b57a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f56940098e0 tx=0x7f56940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfc090deb7cf7377 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56aaffd700 1 -- 172.21.15.27:0/3652743384 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694011630 con 0x7f56ac0a2670 2023-10-06T03:11:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56aaffd700 1 -- 172.21.15.27:0/3652743384 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694011790 con 0x7f56ac0a2670 2023-10-06T03:11:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56aaffd700 1 -- 172.21.15.27:0/3652743384 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694011b30 con 0x7f56ac0a2670 2023-10-06T03:11:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56b1ecc700 1 -- 172.21.15.27:0/3652743384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56ac0a2670 msgr2=0x7f56ac0b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56b1ecc700 1 --2- 172.21.15.27:0/3652743384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56ac0a2670 0x7f56ac0b57a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f56940098e0 tx=0x7f56940091a0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56b1ecc700 1 -- 172.21.15.27:0/3652743384 shutdown_connections 2023-10-06T03:11:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56b1ecc700 1 --2- 172.21.15.27:0/3652743384 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f56ac0b4c80 0x7f56ac0b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56b1ecc700 1 --2- 172.21.15.27:0/3652743384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56ac0a2670 0x7f56ac0b57a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56b1ecc700 1 -- 172.21.15.27:0/3652743384 >> 172.21.15.27:0/3652743384 conn(0x7f56ac0bfec0 msgr2=0x7f56ac0c02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56b1ecc700 1 -- 172.21.15.27:0/3652743384 shutdown_connections 2023-10-06T03:11:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.799+0000 7f56b1ecc700 1 -- 172.21.15.27:0/3652743384 wait complete. 2023-10-06T03:11:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56b1ecc700 1 Processor -- start 2023-10-06T03:11:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56b1ecc700 1 -- start start 2023-10-06T03:11:03.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56b1ecc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f56ac0a22a0 0x7f56ac0a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:03.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56b1ecc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56ac0a2670 0x7f56ac0b9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:03.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56b1ecc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ac0b4c80 0x7f56ac1590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:03.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56b1ecc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0b78b0 con 0x7f56ac0b4c80 2023-10-06T03:11:03.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56b1ecc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0a3fb0 con 0x7f56ac0a2670 2023-10-06T03:11:03.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56b1ecc700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0ba150 con 0x7f56ac0a22a0 2023-10-06T03:11:03.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56abfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ac0b4c80 0x7f56ac1590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56abfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ac0b4c80 0x7f56ac1590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42138/0 (socket says 172.21.15.27:42138) 2023-10-06T03:11:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56abfff700 1 -- 172.21.15.27:0/636256493 learned_addr learned my addr 172.21.15.27:0/636256493 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:11:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56a2ffd700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56ac0a2670 0x7f56ac0b9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56ab7fe700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f56ac0a22a0 0x7f56ac0a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56abfff700 1 -- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f56ac0a22a0 msgr2=0x7f56ac0a3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56abfff700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f56ac0a22a0 0x7f56ac0a3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56abfff700 1 -- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56ac0a2670 msgr2=0x7f56ac0b9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56abfff700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56ac0a2670 0x7f56ac0b9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56abfff700 1 -- 172.21.15.27:0/636256493 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5694009420 con 0x7f56ac0b4c80 2023-10-06T03:11:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56abfff700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ac0b4c80 0x7f56ac1590c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009e20 tx=0x7f56a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:03.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56a3fff700 1 -- 172.21.15.27:0/636256493 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a400caa0 con 0x7f56ac0b4c80 2023-10-06T03:11:03.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56a3fff700 1 -- 172.21.15.27:0/636256493 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a400f040 con 0x7f56ac0b4c80 2023-10-06T03:11:03.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56b1ecc700 1 -- 172.21.15.27:0/636256493 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac159cd0 con 0x7f56ac0b4c80 2023-10-06T03:11:03.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56a3fff700 1 -- 172.21.15.27:0/636256493 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a400ce70 con 0x7f56ac0b4c80 2023-10-06T03:11:03.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.803+0000 7f56b1ecc700 1 -- 172.21.15.27:0/636256493 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac1456e0 con 0x7f56ac0b4c80 2023-10-06T03:11:03.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.807+0000 7f56b1ecc700 1 -- 172.21.15.27:0/636256493 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac0a3520 con 0x7f56ac0b4c80 2023-10-06T03:11:03.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.807+0000 7f56a3fff700 1 -- 172.21.15.27:0/636256493 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f56a4014690 con 0x7f56ac0b4c80 2023-10-06T03:11:03.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.807+0000 7f56a3fff700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5690060550 0x7f5690062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:03.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.807+0000 7f56a3fff700 1 -- 172.21.15.27:0/636256493 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f56a407d4e0 con 0x7f56ac0b4c80 2023-10-06T03:11:03.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.807+0000 7f56ab7fe700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5690060550 0x7f5690062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:03.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.807+0000 7f56ab7fe700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5690060550 0x7f5690062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f569c007fd0 tx=0x7f569c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:03.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.815+0000 7f56a3fff700 1 -- 172.21.15.27:0/636256493 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f56ac0a3520 con 0x7f56ac0b4c80 2023-10-06T03:11:03.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.983+0000 7f56b1ecc700 1 -- 172.21.15.27:0/636256493 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f56ac0a3520 con 0x7f56ac0b4c80 2023-10-06T03:11:03.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.987+0000 7f56a3fff700 1 -- 172.21.15.27:0/636256493 <== mon.0 v2:172.21.15.27:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f56a4051320 con 0x7f56ac0b4c80 2023-10-06T03:11:03.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.991+0000 7f56a3fff700 1 -- 172.21.15.27:0/636256493 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f56ac0a3520 con 0x7f56ac0b4c80 2023-10-06T03:11:03.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.991+0000 7f56b1ecc700 1 -- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5690060550 msgr2=0x7f5690062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:03.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.991+0000 7f56b1ecc700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5690060550 0x7f5690062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f569c007fd0 tx=0x7f569c009040 comp rx=0 tx=0).stop 2023-10-06T03:11:03.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.991+0000 7f56b1ecc700 1 -- 172.21.15.27:0/636256493 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ac0b4c80 msgr2=0x7f56ac1590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:03.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.991+0000 7f56b1ecc700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ac0b4c80 0x7f56ac1590c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009e20 tx=0x7f56a400b040 comp rx=0 tx=0).stop 2023-10-06T03:11:03.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.991+0000 7f56b1ecc700 1 -- 172.21.15.27:0/636256493 shutdown_connections 2023-10-06T03:11:03.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.991+0000 7f56b1ecc700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f5690060550 0x7f5690062a00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.991+0000 7f56b1ecc700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ac0b4c80 0x7f56ac1590c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.991+0000 7f56b1ecc700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56ac0a2670 0x7f56ac0b9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.991+0000 7f56b1ecc700 1 --2- 172.21.15.27:0/636256493 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f56ac0a22a0 0x7f56ac0a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:03.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.991+0000 7f56b1ecc700 1 -- 172.21.15.27:0/636256493 >> 172.21.15.27:0/636256493 conn(0x7f56ac0bfec0 msgr2=0x7f56ac067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:03.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.991+0000 7f56b1ecc700 1 -- 172.21.15.27:0/636256493 shutdown_connections 2023-10-06T03:11:03.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:03.991+0000 7f56b1ecc700 1 -- 172.21.15.27:0/636256493 wait complete. 2023-10-06T03:11:04.009 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:11:04.009 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:11:04.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb25b9e4700 1 Processor -- start 2023-10-06T03:11:04.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb25b9e4700 1 -- start start 2023-10-06T03:11:04.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb25b9e4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2540bc710 0x7fb25406c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb25b9e4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb25406ce50 0x7fb2540a2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb25b9e4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2540b8fc0 con 0x7fb25414f470 2023-10-06T03:11:04.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb25b9e4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2540b8d70 con 0x7fb25406ce50 2023-10-06T03:11:04.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb25b9e4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2540b7de0 con 0x7fb2540bc710 2023-10-06T03:11:04.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb258f7f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2540bc710 0x7fb25406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb259f81700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb25406ce50 0x7fb2540a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb259780700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb25414f470 0x7fb25414f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.27:56356/0 (socket says 172.21.15.27:56356) 2023-10-06T03:11:04.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb259f81700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb25406ce50 0x7fb2540a2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:48508/0 (socket says 172.21.15.27:48508) 2023-10-06T03:11:04.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb259780700 1 -- 172.21.15.27:0/4183886817 learned_addr learned my addr 172.21.15.27:0/4183886817 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:11:04.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb259f81700 1 -- 172.21.15.27:0/4183886817 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2540bc710 msgr2=0x7fb25406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:11:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb259f81700 1 --2- 172.21.15.27:0/4183886817 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2540bc710 0x7fb25406c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb253fff700 1 -- 172.21.15.27:0/4183886817 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044822186 0 0) 0x7fb23c001490 con 0x7fb25414f470 2023-10-06T03:11:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb259f81700 1 -- 172.21.15.27:0/4183886817 >> v1:172.21.15.123:6789/0 conn(0x7fb25414f470 legacy=0x7fb25414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb259f81700 1 -- 172.21.15.27:0/4183886817 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2540bd400 con 0x7fb25406ce50 2023-10-06T03:11:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb258f7f700 1 --2- 172.21.15.27:0/4183886817 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2540bc710 0x7fb25406c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:11:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb259f81700 1 --2- 172.21.15.27:0/4183886817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406ce50 0x7fb2540a2530 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0098e0 tx=0x7fb24c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d856e0e2fe34991 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb253fff700 1 -- 172.21.15.27:0/4183886817 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00b640 con 0x7fb25406ce50 2023-10-06T03:11:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb253fff700 1 -- 172.21.15.27:0/4183886817 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb24c00b7a0 con 0x7fb25406ce50 2023-10-06T03:11:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.115+0000 7fb253fff700 1 -- 172.21.15.27:0/4183886817 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00bb60 con 0x7fb25406ce50 2023-10-06T03:11:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 -- 172.21.15.27:0/4183886817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406ce50 msgr2=0x7fb2540a2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 --2- 172.21.15.27:0/4183886817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406ce50 0x7fb2540a2530 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0098e0 tx=0x7fb24c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 -- 172.21.15.27:0/4183886817 shutdown_connections 2023-10-06T03:11:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 --2- 172.21.15.27:0/4183886817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406ce50 0x7fb2540a2530 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 --2- 172.21.15.27:0/4183886817 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb2540bc710 0x7fb25406c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 -- 172.21.15.27:0/4183886817 >> 172.21.15.27:0/4183886817 conn(0x7fb2540beb40 msgr2=0x7fb2540bef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 -- 172.21.15.27:0/4183886817 shutdown_connections 2023-10-06T03:11:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 -- 172.21.15.27:0/4183886817 wait complete. 2023-10-06T03:11:04.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 Processor -- start 2023-10-06T03:11:04.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 -- start start 2023-10-06T03:11:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406ce50 0x7fb25415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2540bc710 0x7fb2540970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb25414f470 0x7fb2540ba150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25415b770 con 0x7fb2540bc710 2023-10-06T03:11:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2540992e0 con 0x7fb25406ce50 2023-10-06T03:11:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb25b9e4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb254097620 con 0x7fb25414f470 2023-10-06T03:11:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb258f7f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2540bc710 0x7fb2540970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb258f7f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2540bc710 0x7fb2540970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42152/0 (socket says 172.21.15.27:42152) 2023-10-06T03:11:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb258f7f700 1 -- 172.21.15.27:0/2308928210 learned_addr learned my addr 172.21.15.27:0/2308928210 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:11:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb259f81700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb25414f470 0x7fb2540ba150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.119+0000 7fb259780700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406ce50 0x7fb25415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb258f7f700 1 -- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb25414f470 msgr2=0x7fb2540ba150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb258f7f700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb25414f470 0x7fb2540ba150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb258f7f700 1 -- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406ce50 msgr2=0x7fb25415bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb258f7f700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406ce50 0x7fb25415bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb258f7f700 1 -- 172.21.15.27:0/2308928210 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb244009420 con 0x7fb2540bc710 2023-10-06T03:11:04.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb259f81700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb25414f470 0x7fb2540ba150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:11:04.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb258f7f700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2540bc710 0x7fb2540970e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb24400ec80 tx=0x7fb2440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:04.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb2517fa700 1 -- 172.21.15.27:0/2308928210 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400c920 con 0x7fb2540bc710 2023-10-06T03:11:04.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb2517fa700 1 -- 172.21.15.27:0/2308928210 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb24400ca80 con 0x7fb2540bc710 2023-10-06T03:11:04.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb25b9e4700 1 -- 172.21.15.27:0/2308928210 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c009420 con 0x7fb2540bc710 2023-10-06T03:11:04.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb2517fa700 1 -- 172.21.15.27:0/2308928210 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400ce20 con 0x7fb2540bc710 2023-10-06T03:11:04.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb25b9e4700 1 -- 172.21.15.27:0/2308928210 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb254098c50 con 0x7fb2540bc710 2023-10-06T03:11:04.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb25b9e4700 1 -- 172.21.15.27:0/2308928210 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25415b920 con 0x7fb2540bc710 2023-10-06T03:11:04.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.123+0000 7fb2517fa700 1 -- 172.21.15.27:0/2308928210 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb244013680 con 0x7fb2540bc710 2023-10-06T03:11:04.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.127+0000 7fb2517fa700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb234060580 0x7fb234062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.127+0000 7fb2517fa700 1 -- 172.21.15.27:0/2308928210 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb24407cd90 con 0x7fb2540bc710 2023-10-06T03:11:04.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.127+0000 7fb259780700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb234060580 0x7fb234062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.127+0000 7fb259780700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb234060580 0x7fb234062a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0072e0 tx=0x7fb23c001a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:04.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.135+0000 7fb2517fa700 1 -- 172.21.15.27:0/2308928210 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb25415b920 con 0x7fb2540bc710 2023-10-06T03:11:04.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb25b9e4700 1 -- 172.21.15.27:0/2308928210 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb25415b920 con 0x7fb2540bc710 2023-10-06T03:11:04.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb2517fa700 1 -- 172.21.15.27:0/2308928210 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3082 (secure 0 0 0) 0x7fb244021c20 con 0x7fb2540bc710 2023-10-06T03:11:04.338 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:11:04.338 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3318688789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3318688789},{"type":"v1","addr":"172.21.15.123:6835","nonce":3318688789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:53.638660+0000","modified":"2023-10-06T02:59:56.293208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6833/3144883581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3144883581},{"type":"v1","addr":"172.21.15.27:6833","nonce":3144883581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:11:04.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb25b9e4700 1 -- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb234060580 msgr2=0x7fb234062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb25b9e4700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb234060580 0x7fb234062a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0072e0 tx=0x7fb23c001a10 comp rx=0 tx=0).stop 2023-10-06T03:11:04.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb25b9e4700 1 -- 172.21.15.27:0/2308928210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2540bc710 msgr2=0x7fb2540970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb25b9e4700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2540bc710 0x7fb2540970e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb24400ec80 tx=0x7fb2440091a0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb25b9e4700 1 -- 172.21.15.27:0/2308928210 shutdown_connections 2023-10-06T03:11:04.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb25b9e4700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb234060580 0x7fb234062a30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb25b9e4700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb25414f470 0x7fb2540ba150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb25b9e4700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2540bc710 0x7fb2540970e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb25b9e4700 1 --2- 172.21.15.27:0/2308928210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406ce50 0x7fb25415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb25b9e4700 1 -- 172.21.15.27:0/2308928210 >> 172.21.15.27:0/2308928210 conn(0x7fb2540beb40 msgr2=0x7fb2540a2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:04.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb25b9e4700 1 -- 172.21.15.27:0/2308928210 shutdown_connections 2023-10-06T03:11:04.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.335+0000 7fb25b9e4700 1 -- 172.21.15.27:0/2308928210 wait complete. 2023-10-06T03:11:04.342 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 6 2023-10-06T03:11:04.352 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:11:04.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd6315e1700 1 Processor -- start 2023-10-06T03:11:04.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd6315e1700 1 -- start start 2023-10-06T03:11:04.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd6315e1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd62c0b5520 0x7fd62c06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd6315e1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd62c14eef0 0x7fd62c14f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd6315e1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62c0a2310 con 0x7fd62c0be150 2023-10-06T03:11:04.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd6315e1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c06d0f0 con 0x7fd62c0b5520 2023-10-06T03:11:04.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd6315e1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0a2680 con 0x7fd62c14eef0 2023-10-06T03:11:04.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd62b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd62c0b5520 0x7fd62c06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd62b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd62c0b5520 0x7fd62c06cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42166/0 (socket says 172.21.15.27:42166) 2023-10-06T03:11:04.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd62b7fe700 1 -- 172.21.15.27:0/2264354362 learned_addr learned my addr 172.21.15.27:0/2264354362 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:11:04.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd62bfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd62c0be150 0x7fd62c0b5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51692/0 (socket says 172.21.15.27:51692) 2023-10-06T03:11:04.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd630de0700 1 --2- 172.21.15.27:0/2264354362 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd62c14eef0 0x7fd62c14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd62b7fe700 1 -- 172.21.15.27:0/2264354362 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd62c14eef0 msgr2=0x7fd62c14f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:11:04.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd62b7fe700 1 --2- 172.21.15.27:0/2264354362 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd62c14eef0 0x7fd62c14f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd62b7fe700 1 -- 172.21.15.27:0/2264354362 >> v1:172.21.15.27:6789/0 conn(0x7fd62c0be150 legacy=0x7fd62c0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd62b7fe700 1 -- 172.21.15.27:0/2264354362 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c0bd1d0 con 0x7fd62c0b5520 2023-10-06T03:11:04.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd630de0700 1 --2- 172.21.15.27:0/2264354362 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd62c14eef0 0x7fd62c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:11:04.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.455+0000 7fd62b7fe700 1 --2- 172.21.15.27:0/2264354362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd62c0b5520 0x7fd62c06cbb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0099b0 tx=0x7fd61c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555998b7850d69b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:04.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd62affd700 1 -- 172.21.15.27:0/2264354362 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c00b860 con 0x7fd62c0b5520 2023-10-06T03:11:04.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd62affd700 1 -- 172.21.15.27:0/2264354362 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd61c00b9c0 con 0x7fd62c0b5520 2023-10-06T03:11:04.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd62affd700 1 -- 172.21.15.27:0/2264354362 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c00bd80 con 0x7fd62c0b5520 2023-10-06T03:11:04.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd6315e1700 1 -- 172.21.15.27:0/2264354362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd62c0b5520 msgr2=0x7fd62c06cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd6315e1700 1 --2- 172.21.15.27:0/2264354362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd62c0b5520 0x7fd62c06cbb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0099b0 tx=0x7fd61c009250 comp rx=0 tx=0).stop 2023-10-06T03:11:04.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd6315e1700 1 -- 172.21.15.27:0/2264354362 shutdown_connections 2023-10-06T03:11:04.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd6315e1700 1 --2- 172.21.15.27:0/2264354362 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd62c14eef0 0x7fd62c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd6315e1700 1 --2- 172.21.15.27:0/2264354362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd62c0b5520 0x7fd62c06cbb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd6315e1700 1 -- 172.21.15.27:0/2264354362 >> 172.21.15.27:0/2264354362 conn(0x7fd62c0bf440 msgr2=0x7fd62c06df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:04.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd6315e1700 1 -- 172.21.15.27:0/2264354362 shutdown_connections 2023-10-06T03:11:04.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd6315e1700 1 -- 172.21.15.27:0/2264354362 wait complete. 2023-10-06T03:11:04.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd6315e1700 1 Processor -- start 2023-10-06T03:11:04.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd6315e1700 1 -- start start 2023-10-06T03:11:04.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd6315e1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd62c0b5520 0x7fd62c0a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd6315e1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd62c0be150 0x7fd62c14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.459+0000 7fd6315e1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd62c14eef0 0x7fd62c15eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd6315e1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c151cb0 con 0x7fd62c0b5520 2023-10-06T03:11:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd6315e1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c15f610 con 0x7fd62c14eef0 2023-10-06T03:11:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd6315e1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c151ec0 con 0x7fd62c0be150 2023-10-06T03:11:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd62bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd62c0b5520 0x7fd62c0a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd62bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd62c0b5520 0x7fd62c0a68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42182/0 (socket says 172.21.15.27:42182) 2023-10-06T03:11:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd62bfff700 1 -- 172.21.15.27:0/1649979428 learned_addr learned my addr 172.21.15.27:0/1649979428 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:11:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd62b7fe700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd62c0be150 0x7fd62c14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd630de0700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd62c14eef0 0x7fd62c15eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd62bfff700 1 -- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd62c0be150 msgr2=0x7fd62c14f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd62bfff700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd62c0be150 0x7fd62c14f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd62bfff700 1 -- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd62c14eef0 msgr2=0x7fd62c15eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd62bfff700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd62c14eef0 0x7fd62c15eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd62bfff700 1 -- 172.21.15.27:0/1649979428 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c0094f0 con 0x7fd62c0b5520 2023-10-06T03:11:04.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd62bfff700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd62c0b5520 0x7fd62c0a68c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd62000c790 tx=0x7fd620007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:04.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd613fff700 1 -- 172.21.15.27:0/1649979428 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620007360 con 0x7fd62c0b5520 2023-10-06T03:11:04.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd613fff700 1 -- 172.21.15.27:0/1649979428 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd6200074c0 con 0x7fd62c0b5520 2023-10-06T03:11:04.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd6315e1700 1 -- 172.21.15.27:0/1649979428 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62c14f850 con 0x7fd62c0b5520 2023-10-06T03:11:04.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd613fff700 1 -- 172.21.15.27:0/1649979428 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620004830 con 0x7fd62c0b5520 2023-10-06T03:11:04.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd6315e1700 1 -- 172.21.15.27:0/1649979428 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c15f2f0 con 0x7fd62c0b5520 2023-10-06T03:11:04.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.463+0000 7fd6315e1700 1 -- 172.21.15.27:0/1649979428 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62c04be40 con 0x7fd62c0b5520 2023-10-06T03:11:04.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.467+0000 7fd613fff700 1 -- 172.21.15.27:0/1649979428 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd620004be0 con 0x7fd62c0b5520 2023-10-06T03:11:04.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.467+0000 7fd613fff700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd618060550 0x7fd618062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.467+0000 7fd613fff700 1 -- 172.21.15.27:0/1649979428 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fd62007ce40 con 0x7fd62c0b5520 2023-10-06T03:11:04.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.467+0000 7fd62b7fe700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd618060550 0x7fd618062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.471+0000 7fd62b7fe700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd618060550 0x7fd618062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0099b0 tx=0x7fd61c009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:04.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.471+0000 7fd613fff700 1 -- 172.21.15.27:0/1649979428 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd62004d2f0 con 0x7fd62c0b5520 2023-10-06T03:11:04.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd6315e1700 1 -- 172.21.15.27:0/1649979428 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd62c152030 con 0x7fd62c0b5520 2023-10-06T03:11:04.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd613fff700 1 -- 172.21.15.27:0/1649979428 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3082 (secure 0 0 0) 0x7fd620050910 con 0x7fd62c0b5520 2023-10-06T03:11:04.674 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:11:04.674 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3318688789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3318688789},{"type":"v1","addr":"172.21.15.123:6835","nonce":3318688789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:53.638660+0000","modified":"2023-10-06T02:59:56.293208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6833/3144883581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3144883581},{"type":"v1","addr":"172.21.15.27:6833","nonce":3144883581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:11:04.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd6315e1700 1 -- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd618060550 msgr2=0x7fd618062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd6315e1700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd618060550 0x7fd618062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0099b0 tx=0x7fd61c009250 comp rx=0 tx=0).stop 2023-10-06T03:11:04.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd6315e1700 1 -- 172.21.15.27:0/1649979428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd62c0b5520 msgr2=0x7fd62c0a68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd6315e1700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd62c0b5520 0x7fd62c0a68c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd62000c790 tx=0x7fd620007f20 comp rx=0 tx=0).stop 2023-10-06T03:11:04.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd6315e1700 1 -- 172.21.15.27:0/1649979428 shutdown_connections 2023-10-06T03:11:04.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd6315e1700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fd618060550 0x7fd618062a00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd6315e1700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd62c14eef0 0x7fd62c15eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd6315e1700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd62c0be150 0x7fd62c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd6315e1700 1 --2- 172.21.15.27:0/1649979428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd62c0b5520 0x7fd62c0a68c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd6315e1700 1 -- 172.21.15.27:0/1649979428 >> 172.21.15.27:0/1649979428 conn(0x7fd62c0bf440 msgr2=0x7fd62c14ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:04.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd6315e1700 1 -- 172.21.15.27:0/1649979428 shutdown_connections 2023-10-06T03:11:04.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.671+0000 7fd6315e1700 1 -- 172.21.15.27:0/1649979428 wait complete. 2023-10-06T03:11:04.678 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 6 2023-10-06T03:11:04.688 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:11:04.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.787+0000 7f4a5caf7700 1 Processor -- start 2023-10-06T03:11:04.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.787+0000 7f4a5caf7700 1 -- start start 2023-10-06T03:11:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.787+0000 7f4a5caf7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4a5814aed0 0x7f4a5814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.787+0000 7f4a5caf7700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a580a18e0 con 0x7f4a580a4760 2023-10-06T03:11:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.787+0000 7f4a5caf7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5814f970 con 0x7f4a580b7f40 2023-10-06T03:11:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.787+0000 7f4a5caf7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a580bdbb0 con 0x7f4a5814aed0 2023-10-06T03:11:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.787+0000 7f4a56ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4a580a4760 0x7f4a5806b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51700/0 (socket says 172.21.15.27:51700) 2023-10-06T03:11:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.787+0000 7f4a56ffd700 1 -- 172.21.15.27:0/4245465773 learned_addr learned my addr 172.21.15.27:0/4245465773 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:11:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.787+0000 7f4a577fe700 1 --2- 172.21.15.27:0/4245465773 >> v2:172.21.15.27:3300/0 conn(0x7f4a5814aed0 0x7f4a5814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a567fc700 1 -- 172.21.15.27:0/4245465773 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492755624 0 0) 0x7f4a580a18e0 con 0x7f4a580a4760 2023-10-06T03:11:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a567fc700 1 -- 172.21.15.27:0/4245465773 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a44003570 con 0x7f4a580a4760 2023-10-06T03:11:04.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a567fc700 1 -- 172.21.15.27:0/4245465773 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41251493 0 0) 0x7f4a5814f970 con 0x7f4a580b7f40 2023-10-06T03:11:04.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a567fc700 1 -- 172.21.15.27:0/4245465773 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a580a18e0 con 0x7f4a580b7f40 2023-10-06T03:11:04.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a577fe700 1 -- 172.21.15.27:0/4245465773 >> v1:172.21.15.123:6789/0 conn(0x7f4a580b7f40 legacy=0x7f4a5814c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a577fe700 1 -- 172.21.15.27:0/4245465773 >> v1:172.21.15.27:6789/0 conn(0x7f4a580a4760 legacy=0x7f4a5806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a577fe700 1 -- 172.21.15.27:0/4245465773 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5814c950 con 0x7f4a5814aed0 2023-10-06T03:11:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a577fe700 1 --2- 172.21.15.27:0/4245465773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a5814aed0 0x7f4a5814b2a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4a400098e0 tx=0x7f4a400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8901e31a91c48d3d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a567fc700 1 -- 172.21.15.27:0/4245465773 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40011630 con 0x7f4a5814aed0 2023-10-06T03:11:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a567fc700 1 -- 172.21.15.27:0/4245465773 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4a40011790 con 0x7f4a5814aed0 2023-10-06T03:11:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a567fc700 1 -- 172.21.15.27:0/4245465773 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40011b50 con 0x7f4a5814aed0 2023-10-06T03:11:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a5caf7700 1 -- 172.21.15.27:0/4245465773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a5814aed0 msgr2=0x7f4a5814b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a5caf7700 1 --2- 172.21.15.27:0/4245465773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a5814aed0 0x7f4a5814b2a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4a400098e0 tx=0x7f4a400091a0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a5caf7700 1 -- 172.21.15.27:0/4245465773 shutdown_connections 2023-10-06T03:11:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a5caf7700 1 --2- 172.21.15.27:0/4245465773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a5814aed0 0x7f4a5814b2a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a5caf7700 1 -- 172.21.15.27:0/4245465773 >> 172.21.15.27:0/4245465773 conn(0x7f4a580beae0 msgr2=0x7f4a580beee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a5caf7700 1 -- 172.21.15.27:0/4245465773 shutdown_connections 2023-10-06T03:11:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a5caf7700 1 -- 172.21.15.27:0/4245465773 wait complete. 2023-10-06T03:11:04.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a5caf7700 1 Processor -- start 2023-10-06T03:11:04.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.791+0000 7f4a5caf7700 1 -- start start 2023-10-06T03:11:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a5caf7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a580a4760 0x7f4a580bbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a5caf7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a580b7f40 0x7f4a5814e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a5caf7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a5814aed0 0x7f4a580a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a5caf7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580b8830 con 0x7f4a5814aed0 2023-10-06T03:11:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a5caf7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580bb830 con 0x7f4a580b7f40 2023-10-06T03:11:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a5caf7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5814e690 con 0x7f4a580a4760 2023-10-06T03:11:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a57fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a5814aed0 0x7f4a580a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a57fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a5814aed0 0x7f4a580a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42196/0 (socket says 172.21.15.27:42196) 2023-10-06T03:11:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a57fff700 1 -- 172.21.15.27:0/18972654 learned_addr learned my addr 172.21.15.27:0/18972654 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:11:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a56ffd700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a580b7f40 0x7f4a5814e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a577fe700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a580a4760 0x7f4a580bbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a57fff700 1 -- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a580a4760 msgr2=0x7f4a580bbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a57fff700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a580a4760 0x7f4a580bbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a57fff700 1 -- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a580b7f40 msgr2=0x7f4a5814e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a57fff700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a580b7f40 0x7f4a5814e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a57fff700 1 -- 172.21.15.27:0/18972654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a40009420 con 0x7f4a5814aed0 2023-10-06T03:11:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a57fff700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a5814aed0 0x7f4a580a0580 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000c590 tx=0x7f4a50007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a4f7fe700 1 -- 172.21.15.27:0/18972654 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50016070 con 0x7f4a5814aed0 2023-10-06T03:11:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a4f7fe700 1 -- 172.21.15.27:0/18972654 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4a50011660 con 0x7f4a5814aed0 2023-10-06T03:11:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a5caf7700 1 -- 172.21.15.27:0/18972654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a580a7d30 con 0x7f4a5814aed0 2023-10-06T03:11:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a4f7fe700 1 -- 172.21.15.27:0/18972654 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50011a20 con 0x7f4a5814aed0 2023-10-06T03:11:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a5caf7700 1 -- 172.21.15.27:0/18972654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a580a79c0 con 0x7f4a5814aed0 2023-10-06T03:11:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.795+0000 7f4a5caf7700 1 -- 172.21.15.27:0/18972654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a580bb9a0 con 0x7f4a5814aed0 2023-10-06T03:11:04.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.799+0000 7f4a4f7fe700 1 -- 172.21.15.27:0/18972654 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4a50012420 con 0x7f4a5814aed0 2023-10-06T03:11:04.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.799+0000 7f4a4f7fe700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4a38060550 0x7f4a38062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:04.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.799+0000 7f4a4f7fe700 1 -- 172.21.15.27:0/18972654 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f4a5007c680 con 0x7f4a5814aed0 2023-10-06T03:11:04.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.799+0000 7f4a577fe700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4a38060550 0x7f4a38062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:04.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.799+0000 7f4a577fe700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4a38060550 0x7f4a38062a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a400093f0 tx=0x7f4a400091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:04.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.803+0000 7f4a4f7fe700 1 -- 172.21.15.27:0/18972654 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4a5004cab0 con 0x7f4a5814aed0 2023-10-06T03:11:04.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.967+0000 7f4a5caf7700 1 -- 172.21.15.27:0/18972654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a580b7370 con 0x7f4a5814aed0 2023-10-06T03:11:04.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.967+0000 7f4a4f7fe700 1 -- 172.21.15.27:0/18972654 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16961 (secure 0 0 0) 0x7f4a500500d0 con 0x7f4a5814aed0 2023-10-06T03:11:04.972 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-06T03:11:04.972 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":26,"fsid":"e03fe5a6-e2a4-4ef7-9a46-008590473953","created":"2023-10-06T02:59:28.693659+0000","modified":"2023-10-06T03:00:34.725027+0000","last_up_change":"2023-10-06T02:59:41.013190+0000","last_in_change":"2023-10-06T02:59:31.641681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:59:43.021608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:59:47.570918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:51.949130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:52.638817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1a922f3-a57d-4ee4-8863-36dd4dbdeade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":33281},{"type":"v1","addr":"172.21.15.27:6825","nonce":33281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":33281},{"type":"v1","addr":"172.21.15.27:6827","nonce":33281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":33281},{"type":"v1","addr":"172.21.15.27:6831","nonce":33281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":33281},{"type":"v1","addr":"172.21.15.27:6829","nonce":33281}]},"public_addr":"172.21.15.27:6825/33281","cluster_addr":"172.21.15.27:6827/33281","heartbeat_back_addr":"172.21.15.27:6831/33281","heartbeat_front_addr":"172.21.15.27:6829/33281","state":["exists","up"]},{"osd":1,"uuid":"82f01570-4085-4e2a-b4e8-8c9bf3e3d412","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":33280},{"type":"v1","addr":"172.21.15.27:6801","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":33280},{"type":"v1","addr":"172.21.15.27:6803","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":33280},{"type":"v1","addr":"172.21.15.27:6807","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":33280},{"type":"v1","addr":"172.21.15.27:6805","nonce":33280}]},"public_addr":"172.21.15.27:6801/33280","cluster_addr":"172.21.15.27:6803/33280","heartbeat_back_addr":"172.21.15.27:6807/33280","heartbeat_front_addr":"172.21.15.27:6805/33280","state":["exists","up"]},{"osd":2,"uuid":"c66d843c-8b3b-42ad-9ced-84b982956c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":33282},{"type":"v1","addr":"172.21.15.27:6809","nonce":33282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":33282},{"type":"v1","addr":"172.21.15.27:6811","nonce":33282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":33282},{"type":"v1","addr":"172.21.15.27:6815","nonce":33282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":33282},{"type":"v1","addr":"172.21.15.27:6813","nonce":33282}]},"public_addr":"172.21.15.27:6809/33282","cluster_addr":"172.21.15.27:6811/33282","heartbeat_back_addr":"172.21.15.27:6815/33282","heartbeat_front_addr":"172.21.15.27:6813/33282","state":["exists","up"]},{"osd":3,"uuid":"80a37b15-cb9a-4cf9-8a52-cb49ae4a2773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":33279},{"type":"v1","addr":"172.21.15.27:6817","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":33279},{"type":"v1","addr":"172.21.15.27:6819","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":33279},{"type":"v1","addr":"172.21.15.27:6823","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":33279},{"type":"v1","addr":"172.21.15.27:6821","nonce":33279}]},"public_addr":"172.21.15.27:6817/33279","cluster_addr":"172.21.15.27:6819/33279","heartbeat_back_addr":"172.21.15.27:6823/33279","heartbeat_front_addr":"172.21.15.27:6821/33279","state":["exists","up"]},{"osd":4,"uuid":"d8558fb1-df1c-4c7e-bbe5-3dc157e0374a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":33673},{"type":"v1","addr":"172.21.15.123:6818","nonce":33673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":33673},{"type":"v1","addr":"172.21.15.123:6821","nonce":33673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":33673},{"type":"v1","addr":"172.21.15.123:6827","nonce":33673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":33673},{"type":"v1","addr":"172.21.15.123:6824","nonce":33673}]},"public_addr":"172.21.15.123:6818/33673","cluster_addr":"172.21.15.123:6821/33673","heartbeat_back_addr":"172.21.15.123:6827/33673","heartbeat_front_addr":"172.21.15.123:6824/33673","state":["exists","up"]},{"osd":5,"uuid":"2d799694-1af9-43ef-b7c8-5bdda38668f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":33671},{"type":"v1","addr":"172.21.15.123:6801","nonce":33671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":33671},{"type":"v1","addr":"172.21.15.123:6803","nonce":33671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":33671},{"type":"v1","addr":"172.21.15.123:6807","nonce":33671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":33671},{"type":"v1","addr":"172.21.15.123:6805","nonce":33671}]},"public_addr":"172.21.15.123:6801/33671","cluster_addr":"172.21.15.123:6803/33671","heartbeat_back_addr":"172.21.15.123:6807/33671","heartbeat_front_addr":"172.21.15.123:6805/33671","state":["exists","up"]},{"osd":6,"uuid":"15c386f4-8e30-4314-a81f-4685707175f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":33672},{"type":"v1","addr":"172.21.15.123:6820","nonce":33672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":33672},{"type":"v1","addr":"172.21.15.123:6826","nonce":33672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":33672},{"type":"v1","addr":"172.21.15.123:6831","nonce":33672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":33672},{"type":"v1","addr":"172.21.15.123:6829","nonce":33672}]},"public_addr":"172.21.15.123:6820/33672","cluster_addr":"172.21.15.123:6826/33672","heartbeat_back_addr":"172.21.15.123:6831/33672","heartbeat_front_addr":"172.21.15.123:6829/33672","state":["exists","up"]},{"osd":7,"uuid":"52c83e1a-d0ae-4e84-97f7-bebd8bf7cfb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":33674},{"type":"v1","addr":"172.21.15.123:6809","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":33674},{"type":"v1","addr":"172.21.15.123:6811","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":33674},{"type":"v1","addr":"172.21.15.123:6815","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":33674},{"type":"v1","addr":"172.21.15.123:6813","nonce":33674}]},"public_addr":"172.21.15.123:6809/33674","cluster_addr":"172.21.15.123:6811/33674","heartbeat_back_addr":"172.21.15.123:6815/33674","heartbeat_front_addr":"172.21.15.123:6813/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.151182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.859941+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.920587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.014751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.084401+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.961629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:36.817214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:59:37.045661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:11:04.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.971+0000 7f4a5caf7700 1 -- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4a38060550 msgr2=0x7f4a38062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.971+0000 7f4a5caf7700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4a38060550 0x7f4a38062a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a400093f0 tx=0x7f4a400091a0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.971+0000 7f4a5caf7700 1 -- 172.21.15.27:0/18972654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a5814aed0 msgr2=0x7f4a580a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:04.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.971+0000 7f4a5caf7700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a5814aed0 0x7f4a580a0580 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000c590 tx=0x7f4a50007d80 comp rx=0 tx=0).stop 2023-10-06T03:11:04.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.971+0000 7f4a5caf7700 1 -- 172.21.15.27:0/18972654 shutdown_connections 2023-10-06T03:11:04.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.971+0000 7f4a5caf7700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f4a38060550 0x7f4a38062a00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.971+0000 7f4a5caf7700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a5814aed0 0x7f4a580a0580 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.971+0000 7f4a5caf7700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a580b7f40 0x7f4a5814e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.971+0000 7f4a5caf7700 1 --2- 172.21.15.27:0/18972654 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a580a4760 0x7f4a580bbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:04.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.971+0000 7f4a5caf7700 1 -- 172.21.15.27:0/18972654 >> 172.21.15.27:0/18972654 conn(0x7f4a580beae0 msgr2=0x7f4a5814b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:04.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.971+0000 7f4a5caf7700 1 -- 172.21.15.27:0/18972654 shutdown_connections 2023-10-06T03:11:04.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:04.971+0000 7f4a5caf7700 1 -- 172.21.15.27:0/18972654 wait complete. 2023-10-06T03:11:04.987 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:11:05.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.095+0000 7f6bea446700 1 Processor -- start 2023-10-06T03:11:05.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.095+0000 7f6bea446700 1 -- start start 2023-10-06T03:11:05.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.095+0000 7f6bea446700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6be40bb2c0 0x7f6be40ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:05.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.095+0000 7f6bea446700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6be40a3550 0x7f6be409f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:05.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.095+0000 7f6bea446700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be409ef80 con 0x7f6be40b9c50 2023-10-06T03:11:05.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.095+0000 7f6bea446700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be40a0f20 con 0x7f6be40bb2c0 2023-10-06T03:11:05.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.095+0000 7f6bea446700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be40a39d0 con 0x7f6be40a3550 2023-10-06T03:11:05.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.095+0000 7f6be8c43700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6be40bb2c0 0x7f6be40ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:05.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.095+0000 7f6be8c43700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6be40bb2c0 0x7f6be40ba020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42204/0 (socket says 172.21.15.27:42204) 2023-10-06T03:11:05.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.095+0000 7f6be8c43700 1 -- 172.21.15.27:0/2826051988 learned_addr learned my addr 172.21.15.27:0/2826051988 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:11:05.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.095+0000 7f6be9c45700 1 --2- 172.21.15.27:0/2826051988 >> v2:172.21.15.123:3300/0 conn(0x7f6be40a3550 0x7f6be409f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:05.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6be8c43700 1 -- 172.21.15.27:0/2826051988 >> v2:172.21.15.123:3300/0 conn(0x7f6be40a3550 msgr2=0x7f6be409f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:11:05.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6be8c43700 1 --2- 172.21.15.27:0/2826051988 >> v2:172.21.15.123:3300/0 conn(0x7f6be40a3550 0x7f6be409f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6be8c43700 1 -- 172.21.15.27:0/2826051988 >> v1:172.21.15.123:6789/0 conn(0x7f6be40b9c50 legacy=0x7f6be406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:05.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6be8c43700 1 -- 172.21.15.27:0/2826051988 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be40a2c50 con 0x7f6be40bb2c0 2023-10-06T03:11:05.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6be8c43700 1 --2- 172.21.15.27:0/2826051988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be40bb2c0 0x7f6be40ba020 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6be40683a0 tx=0x7f6bd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ece3e87f19e0c90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:05.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6bdbfff700 1 -- 172.21.15.27:0/2826051988 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4009e70 con 0x7f6be40bb2c0 2023-10-06T03:11:05.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6bdbfff700 1 -- 172.21.15.27:0/2826051988 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6bd400b860 con 0x7f6be40bb2c0 2023-10-06T03:11:05.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6bdbfff700 1 -- 172.21.15.27:0/2826051988 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd400bc20 con 0x7f6be40bb2c0 2023-10-06T03:11:05.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6bea446700 1 -- 172.21.15.27:0/2826051988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be40bb2c0 msgr2=0x7f6be40ba020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:05.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6bea446700 1 --2- 172.21.15.27:0/2826051988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be40bb2c0 0x7f6be40ba020 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6be40683a0 tx=0x7f6bd4009250 comp rx=0 tx=0).stop 2023-10-06T03:11:05.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6bea446700 1 -- 172.21.15.27:0/2826051988 shutdown_connections 2023-10-06T03:11:05.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6bea446700 1 --2- 172.21.15.27:0/2826051988 >> v2:172.21.15.123:3300/0 conn(0x7f6be40a3550 0x7f6be409f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6bea446700 1 --2- 172.21.15.27:0/2826051988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be40bb2c0 0x7f6be40ba020 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6bea446700 1 -- 172.21.15.27:0/2826051988 >> 172.21.15.27:0/2826051988 conn(0x7f6be406eb10 msgr2=0x7f6be40ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:05.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6bea446700 1 -- 172.21.15.27:0/2826051988 shutdown_connections 2023-10-06T03:11:05.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.099+0000 7f6bea446700 1 -- 172.21.15.27:0/2826051988 wait complete. 2023-10-06T03:11:05.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6bea446700 1 Processor -- start 2023-10-06T03:11:05.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6bea446700 1 -- start start 2023-10-06T03:11:05.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6bea446700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6be40a3550 0x7f6be40b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:05.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6bea446700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6be40b9c50 0x7f6be406a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:05.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6bea446700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be40bb2c0 0x7f6be415ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:05.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6bea446700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40b49c0 con 0x7f6be40bb2c0 2023-10-06T03:11:05.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6bea446700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40b4400 con 0x7f6be40b9c50 2023-10-06T03:11:05.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6bea446700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40b46e0 con 0x7f6be40a3550 2023-10-06T03:11:05.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6be9c45700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be40bb2c0 0x7f6be415ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:05.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6be9c45700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be40bb2c0 0x7f6be415ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42214/0 (socket says 172.21.15.27:42214) 2023-10-06T03:11:05.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6be9c45700 1 -- 172.21.15.27:0/760595041 learned_addr learned my addr 172.21.15.27:0/760595041 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:11:05.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6be9444700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6be40a3550 0x7f6be40b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:05.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6be8c43700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6be40b9c50 0x7f6be406a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:05.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6be9c45700 1 -- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6be40a3550 msgr2=0x7f6be40b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:05.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6be9c45700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6be40a3550 0x7f6be40b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6be9c45700 1 -- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6be40b9c50 msgr2=0x7f6be406a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:05.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6be9c45700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6be40b9c50 0x7f6be406a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.103+0000 7f6be9c45700 1 -- 172.21.15.27:0/760595041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd40094f0 con 0x7f6be40bb2c0 2023-10-06T03:11:05.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.107+0000 7f6be9c45700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be40bb2c0 0x7f6be415ffa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009df0 tx=0x7f6bdc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:05.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.107+0000 7f6bd97fa700 1 -- 172.21.15.27:0/760595041 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc00caa0 con 0x7f6be40bb2c0 2023-10-06T03:11:05.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.107+0000 7f6bea446700 1 -- 172.21.15.27:0/760595041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be40b37b0 con 0x7f6be40bb2c0 2023-10-06T03:11:05.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.107+0000 7f6bd97fa700 1 -- 172.21.15.27:0/760595041 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6bdc00f040 con 0x7f6be40bb2c0 2023-10-06T03:11:05.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.107+0000 7f6bd97fa700 1 -- 172.21.15.27:0/760595041 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc00ce90 con 0x7f6be40bb2c0 2023-10-06T03:11:05.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.107+0000 7f6bea446700 1 -- 172.21.15.27:0/760595041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be415f840 con 0x7f6be40bb2c0 2023-10-06T03:11:05.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.107+0000 7f6bea446700 1 -- 172.21.15.27:0/760595041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be40b4260 con 0x7f6be40bb2c0 2023-10-06T03:11:05.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.107+0000 7f6bd97fa700 1 -- 172.21.15.27:0/760595041 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6bdc014690 con 0x7f6be40bb2c0 2023-10-06T03:11:05.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.107+0000 7f6bd97fa700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6bc8060550 0x7f6bc8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:05.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.107+0000 7f6bd97fa700 1 -- 172.21.15.27:0/760595041 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f6bdc07d260 con 0x7f6be40bb2c0 2023-10-06T03:11:05.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.107+0000 7f6be9444700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6bc8060550 0x7f6bc8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:05.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.107+0000 7f6be9444700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6bc8060550 0x7f6bc8062a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6be00039f0 tx=0x7f6be0007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:05.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.115+0000 7f6bd97fa700 1 -- 172.21.15.27:0/760595041 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6be40b4260 con 0x7f6be40bb2c0 2023-10-06T03:11:05.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.307+0000 7f6bea446700 1 -- 172.21.15.27:0/760595041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6be40b4260 con 0x7f6be40bb2c0 2023-10-06T03:11:05.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.319+0000 7f6bd97fa700 1 -- 172.21.15.27:0/760595041 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6be40b4260 con 0x7f6be40bb2c0 2023-10-06T03:11:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.323+0000 7f6bea446700 1 -- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6bc8060550 msgr2=0x7f6bc8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.323+0000 7f6bea446700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6bc8060550 0x7f6bc8062a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6be00039f0 tx=0x7f6be0007ec0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.323+0000 7f6bea446700 1 -- 172.21.15.27:0/760595041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be40bb2c0 msgr2=0x7f6be415ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.323+0000 7f6bea446700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be40bb2c0 0x7f6be415ffa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009df0 tx=0x7f6bdc00b040 comp rx=0 tx=0).stop 2023-10-06T03:11:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.323+0000 7f6bea446700 1 -- 172.21.15.27:0/760595041 shutdown_connections 2023-10-06T03:11:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.323+0000 7f6bea446700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f6bc8060550 0x7f6bc8062a00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.323+0000 7f6bea446700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be40bb2c0 0x7f6be415ffa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.323+0000 7f6bea446700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6be40b9c50 0x7f6be406a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.323+0000 7f6bea446700 1 --2- 172.21.15.27:0/760595041 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6be40a3550 0x7f6be40b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.323+0000 7f6bea446700 1 -- 172.21.15.27:0/760595041 >> 172.21.15.27:0/760595041 conn(0x7f6be406eb10 msgr2=0x7f6be414ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.323+0000 7f6bea446700 1 -- 172.21.15.27:0/760595041 shutdown_connections 2023-10-06T03:11:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.323+0000 7f6bea446700 1 -- 172.21.15.27:0/760595041 wait complete. 2023-10-06T03:11:05.328 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:11:05.337 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:11:05.363 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-10-06T03:11:05.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91d251700 1 Processor -- start 2023-10-06T03:11:05.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91d251700 1 -- start start 2023-10-06T03:11:05.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91d251700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9180b5700 0x7fb9180be460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:05.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91d251700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9180a4820 0x7fb91806c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:05.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91d251700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9180a2590 con 0x7fb9180be090 2023-10-06T03:11:05.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91d251700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9180a22b0 con 0x7fb9180b5700 2023-10-06T03:11:05.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91d251700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180b8e50 con 0x7fb9180a4820 2023-10-06T03:11:05.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91659c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9180b5700 0x7fb9180be460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:05.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91659c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9180b5700 0x7fb9180be460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42246/0 (socket says 172.21.15.27:42246) 2023-10-06T03:11:05.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91659c700 1 -- 172.21.15.27:0/2009478873 learned_addr learned my addr 172.21.15.27:0/2009478873 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:11:05.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91759e700 1 --2- 172.21.15.27:0/2009478873 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9180a4820 0x7fb91806c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:05.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91659c700 1 -- 172.21.15.27:0/2009478873 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9180a4820 msgr2=0x7fb91806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:11:05.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91659c700 1 --2- 172.21.15.27:0/2009478873 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9180a4820 0x7fb91806c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.439+0000 7fb91659c700 1 -- 172.21.15.27:0/2009478873 >> v1:172.21.15.123:6789/0 conn(0x7fb9180be090 legacy=0x7fb9180b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:05.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.443+0000 7fb91659c700 1 -- 172.21.15.27:0/2009478873 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9180bd4e0 con 0x7fb9180b5700 2023-10-06T03:11:05.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.443+0000 7fb91659c700 1 --2- 172.21.15.27:0/2009478873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9180b5700 0x7fb9180be460 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb9000099b0 tx=0x7fb900009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7c82fee90bb8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:05.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.443+0000 7fb915d9b700 1 -- 172.21.15.27:0/2009478873 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90000b860 con 0x7fb9180b5700 2023-10-06T03:11:05.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.443+0000 7fb915d9b700 1 -- 172.21.15.27:0/2009478873 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb90000b9c0 con 0x7fb9180b5700 2023-10-06T03:11:05.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.443+0000 7fb915d9b700 1 -- 172.21.15.27:0/2009478873 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90000bd80 con 0x7fb9180b5700 2023-10-06T03:11:05.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.443+0000 7fb91d251700 1 -- 172.21.15.27:0/2009478873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9180b5700 msgr2=0x7fb9180be460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:05.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.443+0000 7fb91d251700 1 --2- 172.21.15.27:0/2009478873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9180b5700 0x7fb9180be460 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb9000099b0 tx=0x7fb900009250 comp rx=0 tx=0).stop 2023-10-06T03:11:05.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.443+0000 7fb91d251700 1 -- 172.21.15.27:0/2009478873 shutdown_connections 2023-10-06T03:11:05.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.443+0000 7fb91d251700 1 --2- 172.21.15.27:0/2009478873 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9180a4820 0x7fb91806c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.443+0000 7fb91d251700 1 --2- 172.21.15.27:0/2009478873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9180b5700 0x7fb9180be460 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.443+0000 7fb91d251700 1 -- 172.21.15.27:0/2009478873 >> 172.21.15.27:0/2009478873 conn(0x7fb9180bf620 msgr2=0x7fb91806dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:05.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.443+0000 7fb91d251700 1 -- 172.21.15.27:0/2009478873 shutdown_connections 2023-10-06T03:11:05.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.443+0000 7fb91d251700 1 -- 172.21.15.27:0/2009478873 wait complete. 2023-10-06T03:11:05.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb91d251700 1 Processor -- start 2023-10-06T03:11:05.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb91d251700 1 -- start start 2023-10-06T03:11:05.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb91d251700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9180a4820 0x7fb9180bb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:05.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb91d251700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9180b5700 0x7fb9180bbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:05.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb91d251700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9180be090 0x7fb91814bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:05.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb91d251700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180bc340 con 0x7fb9180a4820 2023-10-06T03:11:05.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb91d251700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91815bec0 con 0x7fb9180b5700 2023-10-06T03:11:05.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb91d251700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91815c110 con 0x7fb9180be090 2023-10-06T03:11:05.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb916d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9180a4820 0x7fb9180bb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:05.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb91659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9180b5700 0x7fb9180bbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:05.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb916d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9180a4820 0x7fb9180bb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42260/0 (socket says 172.21.15.27:42260) 2023-10-06T03:11:05.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb916d9d700 1 -- 172.21.15.27:0/2025501056 learned_addr learned my addr 172.21.15.27:0/2025501056 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:11:05.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb91759e700 1 --2- 172.21.15.27:0/2025501056 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9180be090 0x7fb91814bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:05.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb916d9d700 1 -- 172.21.15.27:0/2025501056 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9180be090 msgr2=0x7fb91814bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:05.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb916d9d700 1 --2- 172.21.15.27:0/2025501056 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9180be090 0x7fb91814bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb916d9d700 1 -- 172.21.15.27:0/2025501056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9180b5700 msgr2=0x7fb9180bbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:05.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb916d9d700 1 --2- 172.21.15.27:0/2025501056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9180b5700 0x7fb9180bbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:05.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb916d9d700 1 -- 172.21.15.27:0/2025501056 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9000094f0 con 0x7fb9180a4820 2023-10-06T03:11:05.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb916d9d700 1 --2- 172.21.15.27:0/2025501056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9180a4820 0x7fb9180bb8c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb90800cb10 tx=0x7fb9080017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:05.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb90effd700 1 -- 172.21.15.27:0/2025501056 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90800ce20 con 0x7fb9180a4820 2023-10-06T03:11:05.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb90effd700 1 -- 172.21.15.27:0/2025501056 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb90800a7e0 con 0x7fb9180a4820 2023-10-06T03:11:05.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb91d251700 1 -- 172.21.15.27:0/2025501056 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9180b8a90 con 0x7fb9180a4820 2023-10-06T03:11:05.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb90effd700 1 -- 172.21.15.27:0/2025501056 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90800abc0 con 0x7fb9180a4820 2023-10-06T03:11:05.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.447+0000 7fb91d251700 1 -- 172.21.15.27:0/2025501056 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9180b7fb0 con 0x7fb9180a4820 2023-10-06T03:11:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.451+0000 7fb90effd700 1 -- 172.21.15.27:0/2025501056 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb908003030 con 0x7fb9180a4820 2023-10-06T03:11:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.451+0000 7fb91d251700 1 -- 172.21.15.27:0/2025501056 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91804be40 con 0x7fb9180a4820 2023-10-06T03:11:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.451+0000 7fb90effd700 1 --2- 172.21.15.27:0/2025501056 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb8f8060580 0x7fb8f8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.451+0000 7fb90effd700 1 -- 172.21.15.27:0/2025501056 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fb90807cc00 con 0x7fb9180a4820 2023-10-06T03:11:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.451+0000 7fb91659c700 1 --2- 172.21.15.27:0/2025501056 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb8f8060580 0x7fb8f8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:05.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.451+0000 7fb91659c700 1 --2- 172.21.15.27:0/2025501056 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb8f8060580 0x7fb8f8062a30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9000099b0 tx=0x7fb900009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:05.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.463+0000 7fb90effd700 1 -- 172.21.15.27:0/2025501056 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb908083080 con 0x7fb9180a4820 2023-10-06T03:11:05.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:05.659+0000 7fb91d251700 1 -- 172.21.15.27:0/2025501056 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb9180a1a50 con 0x7fb9180a4820 2023-10-06T03:11:06.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.319+0000 7fb90effd700 1 -- 172.21.15.27:0/2025501056 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb90804d080 con 0x7fb9180a4820 2023-10-06T03:11:06.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.323+0000 7fb91d251700 1 -- 172.21.15.27:0/2025501056 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb8f8060580 msgr2=0x7fb8f8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:06.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.323+0000 7fb91d251700 1 --2- 172.21.15.27:0/2025501056 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb8f8060580 0x7fb8f8062a30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9000099b0 tx=0x7fb900009250 comp rx=0 tx=0).stop 2023-10-06T03:11:06.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.323+0000 7fb91d251700 1 -- 172.21.15.27:0/2025501056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9180a4820 msgr2=0x7fb9180bb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:06.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.323+0000 7fb91d251700 1 --2- 172.21.15.27:0/2025501056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9180a4820 0x7fb9180bb8c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb90800cb10 tx=0x7fb9080017b0 comp rx=0 tx=0).stop 2023-10-06T03:11:06.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.323+0000 7fb91d251700 1 -- 172.21.15.27:0/2025501056 shutdown_connections 2023-10-06T03:11:06.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.323+0000 7fb91d251700 1 --2- 172.21.15.27:0/2025501056 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7fb8f8060580 0x7fb8f8062a30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:06.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.323+0000 7fb91d251700 1 --2- 172.21.15.27:0/2025501056 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9180be090 0x7fb91814bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:06.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.323+0000 7fb91d251700 1 --2- 172.21.15.27:0/2025501056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9180b5700 0x7fb9180bbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:06.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.323+0000 7fb91d251700 1 --2- 172.21.15.27:0/2025501056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9180a4820 0x7fb9180bb8c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:06.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.323+0000 7fb91d251700 1 -- 172.21.15.27:0/2025501056 >> 172.21.15.27:0/2025501056 conn(0x7fb9180bf620 msgr2=0x7fb91806c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:06.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.327+0000 7fb91d251700 1 -- 172.21.15.27:0/2025501056 shutdown_connections 2023-10-06T03:11:06.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.327+0000 7fb91d251700 1 -- 172.21.15.27:0/2025501056 wait complete. 2023-10-06T03:11:06.345 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:11:06.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.467+0000 7f920cb49700 1 Processor -- start 2023-10-06T03:11:06.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.467+0000 7f920cb49700 1 -- start start 2023-10-06T03:11:06.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f920cb49700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f920806c3c0 0x7f92080bf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:06.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f920cb49700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f92080be990 0x7f920814ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:06.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f920cb49700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f920814b0d0 0x7f92080ba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:06.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f920cb49700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92080bdb60 con 0x7f920814b0d0 2023-10-06T03:11:06.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f920cb49700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920806aa00 con 0x7f920806c3c0 2023-10-06T03:11:06.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f920cb49700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9208069ba0 con 0x7f92080be990 2023-10-06T03:11:06.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f9206d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f920814b0d0 0x7f92080ba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:06.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f9206d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f920814b0d0 0x7f92080ba4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42266/0 (socket says 172.21.15.27:42266) 2023-10-06T03:11:06.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f9206d9d700 1 -- 172.21.15.27:0/3920956742 learned_addr learned my addr 172.21.15.27:0/3920956742 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:11:06.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f920659c700 1 --2- 172.21.15.27:0/3920956742 >> v2:172.21.15.123:3300/0 conn(0x7f920806c3c0 0x7f92080bf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:06.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f91fffff700 1 --2- 172.21.15.27:0/3920956742 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f92080be990 0x7f920814ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:06.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f9206d9d700 1 -- 172.21.15.27:0/3920956742 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f92080be990 msgr2=0x7f920814ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:11:06.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f9206d9d700 1 --2- 172.21.15.27:0/3920956742 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f92080be990 0x7f920814ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:06.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f9206d9d700 1 -- 172.21.15.27:0/3920956742 >> v2:172.21.15.123:3300/0 conn(0x7f920806c3c0 msgr2=0x7f92080bf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:11:06.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f9206d9d700 1 --2- 172.21.15.27:0/3920956742 >> v2:172.21.15.123:3300/0 conn(0x7f920806c3c0 0x7f92080bf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:06.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f9206d9d700 1 -- 172.21.15.27:0/3920956742 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9208069900 con 0x7f920814b0d0 2023-10-06T03:11:06.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f9206d9d700 1 --2- 172.21.15.27:0/3920956742 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f920814b0d0 0x7f92080ba4c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f920806d270 tx=0x7f9200009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69278cd5a2b2e6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:06.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f9205d9b700 1 -- 172.21.15.27:0/3920956742 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920000e070 con 0x7f920814b0d0 2023-10-06T03:11:06.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f9205d9b700 1 -- 172.21.15.27:0/3920956742 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f920000ba20 con 0x7f920814b0d0 2023-10-06T03:11:06.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.471+0000 7f9205d9b700 1 -- 172.21.15.27:0/3920956742 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92000092e0 con 0x7f920814b0d0 2023-10-06T03:11:06.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 -- 172.21.15.27:0/3920956742 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f920814b0d0 msgr2=0x7f92080ba4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:06.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 --2- 172.21.15.27:0/3920956742 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f920814b0d0 0x7f92080ba4c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f920806d270 tx=0x7f9200009840 comp rx=0 tx=0).stop 2023-10-06T03:11:06.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 -- 172.21.15.27:0/3920956742 shutdown_connections 2023-10-06T03:11:06.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 --2- 172.21.15.27:0/3920956742 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f920814b0d0 0x7f92080ba4c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:06.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 --2- 172.21.15.27:0/3920956742 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f92080be990 0x7f920814ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 --2- 172.21.15.27:0/3920956742 >> v2:172.21.15.123:3300/0 conn(0x7f920806c3c0 0x7f92080bf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 -- 172.21.15.27:0/3920956742 >> 172.21.15.27:0/3920956742 conn(0x7f9208067ad0 msgr2=0x7f92080beeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 -- 172.21.15.27:0/3920956742 shutdown_connections 2023-10-06T03:11:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 -- 172.21.15.27:0/3920956742 wait complete. 2023-10-06T03:11:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 Processor -- start 2023-10-06T03:11:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 -- start start 2023-10-06T03:11:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f920806c3c0 0x7f920814e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92080be990 0x7f920815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f920814b0d0 0x7f92080bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920815ee10 con 0x7f920814b0d0 2023-10-06T03:11:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9208150450 con 0x7f92080be990 2023-10-06T03:11:06.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920814f410 con 0x7f920806c3c0 2023-10-06T03:11:06.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f9206d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f920814b0d0 0x7f92080bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:06.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f91fffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92080be990 0x7f920815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:06.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920659c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f920806c3c0 0x7f920814e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:06.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f91fffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92080be990 0x7f920815e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.27:48594/0 (socket says 172.21.15.27:48594) 2023-10-06T03:11:06.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f91fffff700 1 -- 172.21.15.27:0/658966512 learned_addr learned my addr 172.21.15.27:0/658966512 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:11:06.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f9206d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f920814b0d0 0x7f92080bb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42278/0 (socket says 172.21.15.27:42278) 2023-10-06T03:11:06.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f9206d9d700 1 -- 172.21.15.27:0/658966512 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f920806c3c0 msgr2=0x7f920814e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:06.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f9206d9d700 1 --2- 172.21.15.27:0/658966512 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f920806c3c0 0x7f920814e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:06.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f9206d9d700 1 -- 172.21.15.27:0/658966512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92080be990 msgr2=0x7f920815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:06.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f9206d9d700 1 --2- 172.21.15.27:0/658966512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92080be990 0x7f920815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:06.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f9206d9d700 1 -- 172.21.15.27:0/658966512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9200009ae0 con 0x7f920814b0d0 2023-10-06T03:11:06.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f9206d9d700 1 --2- 172.21.15.27:0/658966512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f920814b0d0 0x7f92080bb4d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9200015000 tx=0x7f9200009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:06.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f91fe7fc700 1 -- 172.21.15.27:0/658966512 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920000be60 con 0x7f920814b0d0 2023-10-06T03:11:06.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f91fe7fc700 1 -- 172.21.15.27:0/658966512 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9200008d20 con 0x7f920814b0d0 2023-10-06T03:11:06.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 -- 172.21.15.27:0/658966512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920815eaa0 con 0x7f920814b0d0 2023-10-06T03:11:06.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f91fe7fc700 1 -- 172.21.15.27:0/658966512 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92000266b0 con 0x7f920814b0d0 2023-10-06T03:11:06.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.475+0000 7f920cb49700 1 -- 172.21.15.27:0/658966512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920814eef0 con 0x7f920814b0d0 2023-10-06T03:11:06.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.479+0000 7f920cb49700 1 -- 172.21.15.27:0/658966512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920814e3f0 con 0x7f920814b0d0 2023-10-06T03:11:06.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.479+0000 7f91fe7fc700 1 -- 172.21.15.27:0/658966512 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9200003040 con 0x7f920814b0d0 2023-10-06T03:11:06.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.479+0000 7f91fe7fc700 1 --2- 172.21.15.27:0/658966512 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f91e8060550 0x7f91e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:06.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.479+0000 7f91fe7fc700 1 -- 172.21.15.27:0/658966512 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f920007e830 con 0x7f920814b0d0 2023-10-06T03:11:06.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.479+0000 7f920659c700 1 --2- 172.21.15.27:0/658966512 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f91e8060550 0x7f91e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:06.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.479+0000 7f920659c700 1 --2- 172.21.15.27:0/658966512 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f91e8060550 0x7f91e8062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009d10 tx=0x7f91f80091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:06.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.487+0000 7f91fe7fc700 1 -- 172.21.15.27:0/658966512 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f920814e3f0 con 0x7f920814b0d0 2023-10-06T03:11:06.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:06.647+0000 7f920cb49700 1 -- 172.21.15.27:0/658966512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f920814e3f0 con 0x7f920814b0d0 2023-10-06T03:11:07.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.331+0000 7f91fe7fc700 1 -- 172.21.15.27:0/658966512 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f920814e3f0 con 0x7f920814b0d0 2023-10-06T03:11:07.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.339+0000 7f920cb49700 1 -- 172.21.15.27:0/658966512 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f91e8060550 msgr2=0x7f91e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:07.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.339+0000 7f920cb49700 1 --2- 172.21.15.27:0/658966512 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f91e8060550 0x7f91e8062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009d10 tx=0x7f91f80091a0 comp rx=0 tx=0).stop 2023-10-06T03:11:07.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.339+0000 7f920cb49700 1 -- 172.21.15.27:0/658966512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f920814b0d0 msgr2=0x7f92080bb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:07.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.339+0000 7f920cb49700 1 --2- 172.21.15.27:0/658966512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f920814b0d0 0x7f92080bb4d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9200015000 tx=0x7f9200009840 comp rx=0 tx=0).stop 2023-10-06T03:11:07.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.339+0000 7f920cb49700 1 -- 172.21.15.27:0/658966512 shutdown_connections 2023-10-06T03:11:07.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.339+0000 7f920cb49700 1 --2- 172.21.15.27:0/658966512 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f91e8060550 0x7f91e8062a00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:07.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.339+0000 7f920cb49700 1 --2- 172.21.15.27:0/658966512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f920814b0d0 0x7f92080bb4d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:07.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.339+0000 7f920cb49700 1 --2- 172.21.15.27:0/658966512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92080be990 0x7f920815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:07.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.339+0000 7f920cb49700 1 --2- 172.21.15.27:0/658966512 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f920806c3c0 0x7f920814e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:07.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.339+0000 7f920cb49700 1 -- 172.21.15.27:0/658966512 >> 172.21.15.27:0/658966512 conn(0x7f9208067ad0 msgr2=0x7f920806d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:07.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.339+0000 7f920cb49700 1 -- 172.21.15.27:0/658966512 shutdown_connections 2023-10-06T03:11:07.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.339+0000 7f920cb49700 1 -- 172.21.15.27:0/658966512 wait complete. 2023-10-06T03:11:07.346 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:11:07.360 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:11:07.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d916d2700 1 Processor -- start 2023-10-06T03:11:07.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d916d2700 1 -- start start 2023-10-06T03:11:07.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d916d2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1d8c0bf550 0x7f1d8c14be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:07.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d916d2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c14b9c0 con 0x7f1d8c06da00 2023-10-06T03:11:07.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d916d2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c06a410 con 0x7f1d8c06de90 2023-10-06T03:11:07.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d916d2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8c0b4420 con 0x7f1d8c0bf550 2023-10-06T03:11:07.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d837fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1d8c06da00 0x7f1d8c0695f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51716/0 (socket says 172.21.15.27:51716) 2023-10-06T03:11:07.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d837fe700 1 -- 172.21.15.27:0/2703127603 learned_addr learned my addr 172.21.15.27:0/2703127603 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-10-06T03:11:07.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d8bfff700 1 --2- 172.21.15.27:0/2703127603 >> v2:172.21.15.123:3300/0 conn(0x7f1d8c0bf550 0x7f1d8c14be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d8b7fe700 1 -- 172.21.15.27:0/2703127603 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112396077 0 0) 0x7f1d8c14b9c0 con 0x7f1d8c06da00 2023-10-06T03:11:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d8b7fe700 1 -- 172.21.15.27:0/2703127603 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d78003570 con 0x7f1d8c06da00 2023-10-06T03:11:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d8bfff700 1 -- 172.21.15.27:0/2703127603 >> v1:172.21.15.123:6789/0 conn(0x7f1d8c06de90 legacy=0x7f1d8c069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d8bfff700 1 -- 172.21.15.27:0/2703127603 >> v1:172.21.15.27:6789/0 conn(0x7f1d8c06da00 legacy=0x7f1d8c0695f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d8bfff700 1 -- 172.21.15.27:0/2703127603 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c0b40d0 con 0x7f1d8c0bf550 2023-10-06T03:11:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d8bfff700 1 --2- 172.21.15.27:0/2703127603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0bf550 0x7f1d8c14be50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0098e0 tx=0x7f1d7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=635b05efcc5af3e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d8b7fe700 1 -- 172.21.15.27:0/2703127603 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c00b640 con 0x7f1d8c0bf550 2023-10-06T03:11:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d8b7fe700 1 -- 172.21.15.27:0/2703127603 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1d7c00b7a0 con 0x7f1d8c0bf550 2023-10-06T03:11:07.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.455+0000 7f1d8b7fe700 1 -- 172.21.15.27:0/2703127603 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c00bb60 con 0x7f1d8c0bf550 2023-10-06T03:11:07.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 -- 172.21.15.27:0/2703127603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0bf550 msgr2=0x7f1d8c14be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:07.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 --2- 172.21.15.27:0/2703127603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0bf550 0x7f1d8c14be50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0098e0 tx=0x7f1d7c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:11:07.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 -- 172.21.15.27:0/2703127603 shutdown_connections 2023-10-06T03:11:07.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 --2- 172.21.15.27:0/2703127603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0bf550 0x7f1d8c14be50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:07.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 -- 172.21.15.27:0/2703127603 >> 172.21.15.27:0/2703127603 conn(0x7f1d8c067b30 msgr2=0x7f1d8c0bec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:07.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 -- 172.21.15.27:0/2703127603 shutdown_connections 2023-10-06T03:11:07.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 -- 172.21.15.27:0/2703127603 wait complete. 2023-10-06T03:11:07.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 Processor -- start 2023-10-06T03:11:07.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 -- start start 2023-10-06T03:11:07.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c06da00 0x7f1d8c0be260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:07.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d8c06de90 0x7f1d8c1432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:07.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0bf550 0x7f1d8c143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:07.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c143d60 con 0x7f1d8c06de90 2023-10-06T03:11:07.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c15f1a0 con 0x7f1d8c0bf550 2023-10-06T03:11:07.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d916d2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c0be7a0 con 0x7f1d8c06da00 2023-10-06T03:11:07.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d837fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d8c06de90 0x7f1d8c1432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:07.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d837fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d8c06de90 0x7f1d8c1432e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42292/0 (socket says 172.21.15.27:42292) 2023-10-06T03:11:07.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d90ed1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0bf550 0x7f1d8c143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:07.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d837fe700 1 -- 172.21.15.27:0/4006068337 learned_addr learned my addr 172.21.15.27:0/4006068337 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-10-06T03:11:07.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.459+0000 7f1d8bfff700 1 --2- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c06da00 0x7f1d8c0be260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:07.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d90ed1700 1 -- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c06da00 msgr2=0x7f1d8c0be260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:07.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d90ed1700 1 --2- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c06da00 0x7f1d8c0be260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:07.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d90ed1700 1 -- 172.21.15.27:0/4006068337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d8c06de90 msgr2=0x7f1d8c1432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:07.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d90ed1700 1 --2- 172.21.15.27:0/4006068337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d8c06de90 0x7f1d8c1432e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:07.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d90ed1700 1 -- 172.21.15.27:0/4006068337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c009420 con 0x7f1d8c0bf550 2023-10-06T03:11:07.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d90ed1700 1 --2- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0bf550 0x7f1d8c143820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400c790 tx=0x7f1d840015f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:07.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d88ff9700 1 -- 172.21.15.27:0/4006068337 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84012630 con 0x7f1d8c0bf550 2023-10-06T03:11:07.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d88ff9700 1 -- 172.21.15.27:0/4006068337 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1d840127b0 con 0x7f1d8c0bf550 2023-10-06T03:11:07.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d88ff9700 1 -- 172.21.15.27:0/4006068337 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84012b90 con 0x7f1d8c0bf550 2023-10-06T03:11:07.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d916d2700 1 -- 172.21.15.27:0/4006068337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c15eb50 con 0x7f1d8c0bf550 2023-10-06T03:11:07.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d916d2700 1 -- 172.21.15.27:0/4006068337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c14eae0 con 0x7f1d8c0bf550 2023-10-06T03:11:07.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d88ff9700 1 -- 172.21.15.27:0/4006068337 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1d84003030 con 0x7f1d8c0bf550 2023-10-06T03:11:07.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d916d2700 1 -- 172.21.15.27:0/4006068337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c15f350 con 0x7f1d8c0bf550 2023-10-06T03:11:07.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.463+0000 7f1d88ff9700 1 --2- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1d6c060620 0x7f1d6c062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:11:07.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.467+0000 7f1d88ff9700 1 -- 172.21.15.27:0/4006068337 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5764+0+0 (secure 0 0 0) 0x7f1d8407c880 con 0x7f1d8c0bf550 2023-10-06T03:11:07.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.467+0000 7f1d8bfff700 1 --2- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1d6c060620 0x7f1d6c062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:11:07.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.467+0000 7f1d8bfff700 1 --2- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1d6c060620 0x7f1d6c062ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0093f0 tx=0x7f1d7c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:11:07.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.471+0000 7f1d88ff9700 1 -- 172.21.15.27:0/4006068337 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1d8c15f350 con 0x7f1d8c0bf550 2023-10-06T03:11:07.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:07.655+0000 7f1d916d2700 1 -- 172.21.15.27:0/4006068337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1d8c15f350 con 0x7f1d8c0bf550 2023-10-06T03:11:08.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:08.343+0000 7f1d88ff9700 1 -- 172.21.15.27:0/4006068337 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1d8c15f350 con 0x7f1d8c0bf550 2023-10-06T03:11:08.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:08.347+0000 7f1d916d2700 1 -- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1d6c060620 msgr2=0x7f1d6c062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:08.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:08.347+0000 7f1d916d2700 1 --2- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1d6c060620 0x7f1d6c062ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0093f0 tx=0x7f1d7c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:11:08.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:08.347+0000 7f1d916d2700 1 -- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0bf550 msgr2=0x7f1d8c143820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:11:08.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:08.347+0000 7f1d916d2700 1 --2- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0bf550 0x7f1d8c143820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400c790 tx=0x7f1d840015f0 comp rx=0 tx=0).stop 2023-10-06T03:11:08.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:08.347+0000 7f1d916d2700 1 -- 172.21.15.27:0/4006068337 shutdown_connections 2023-10-06T03:11:08.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:08.347+0000 7f1d916d2700 1 --2- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:6832/33327,v1:172.21.15.123:6833/33327] conn(0x7f1d6c060620 0x7f1d6c062ad0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:08.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:08.347+0000 7f1d916d2700 1 --2- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0bf550 0x7f1d8c143820 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:08.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:08.347+0000 7f1d916d2700 1 --2- 172.21.15.27:0/4006068337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d8c06de90 0x7f1d8c1432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:08.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:08.347+0000 7f1d916d2700 1 --2- 172.21.15.27:0/4006068337 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c06da00 0x7f1d8c0be260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:11:08.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:08.347+0000 7f1d916d2700 1 -- 172.21.15.27:0/4006068337 >> 172.21.15.27:0/4006068337 conn(0x7f1d8c067b30 msgr2=0x7f1d8c14be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:11:08.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:08.347+0000 7f1d916d2700 1 -- 172.21.15.27:0/4006068337 shutdown_connections 2023-10-06T03:11:08.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-06T03:11:08.347+0000 7f1d916d2700 1 -- 172.21.15.27:0/4006068337 wait complete. 2023-10-06T03:11:08.352 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2023-10-06T03:11:08.366 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T03:11:08.366 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:11:08.367 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:08.377 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:11:08.377 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:11:08.378 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:08.386 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:11:08.387 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T03:11:08.387 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T03:11:08.387 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:08.458 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T03:11:08.458 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T03:11:08.458 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:08.544 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T03:11:08.545 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T03:11:08.545 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:08.628 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T03:11:08.628 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T03:11:08.628 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:08.718 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T03:11:08.719 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T03:11:08.719 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:08.807 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T03:11:08.807 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T03:11:08.807 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:08.879 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T03:11:08.879 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T03:11:08.879 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:08.955 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T03:11:08.956 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T03:11:08.956 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:09.025 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T03:11:09.026 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T03:11:09.026 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T03:11:09.026 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:09.058 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T03:11:09.059 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T03:11:09.059 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:09.084 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T03:11:09.084 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T03:11:09.084 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T03:11:09.085 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:09.120 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T03:11:09.121 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T03:11:09.121 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:09.147 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T03:11:09.148 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T03:11:09.148 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:11:09.162 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-06T03:11:09.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-06T03:11:09.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-06T03:11:09.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-06T03:11:09.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-06T03:11:09.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-06T03:11:09.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-06T03:11:09.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-06T03:11:09.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-06T03:11:09.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-06T03:11:09.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-06T03:11:09.164 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T03:11:09.164 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T03:11:09.164 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:11:09.184 INFO:teuthology.orchestra.run.smithi027.stdout:1696561189.6505396 mon.a (mon.0) 129 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:11:09.185 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T03:11:09.185 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:11:09.202 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:11:09.268 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:11:09.283 INFO:teuthology.orchestra.run.smithi027.stdout:1696561189.6505396 mon.a (mon.0) 129 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:11:09.283 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-06T03:11:09.283 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T03:11:09.640 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-06T03:11:09.640 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T03:11:09.841 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-06T03:11:09.842 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T03:11:10.032 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi027.front.sepia.ceph.com 2023-10-06T03:11:10.032 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T03:11:10.236 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-06T03:11:10.237 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T03:11:10.432 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-06T03:11:10.432 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T03:11:10.738 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-06T03:11:10.738 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T03:11:10.965 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-06T03:11:10.965 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T03:11:11.172 INFO:tasks.ceph:Archiving mon data... 2023-10-06T03:11:11.173 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/data/mon.a.tgz 2023-10-06T03:11:11.174 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2023-10-06T03:11:11.180 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.2obo4bJ4x4 2023-10-06T03:11:11.181 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.2obo4bJ4x4 2023-10-06T03:11:11.256 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.2obo4bJ4x4 2023-10-06T03:11:11.280 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.2obo4bJ4x4 is 234KB 2023-10-06T03:11:11.343 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.2obo4bJ4x4 2023-10-06T03:11:11.349 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/data/mon.b.tgz 2023-10-06T03:11:11.349 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2023-10-06T03:11:11.356 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.rRoy4E0TIz 2023-10-06T03:11:11.356 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.rRoy4E0TIz 2023-10-06T03:11:11.425 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.rRoy4E0TIz 2023-10-06T03:11:11.447 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.rRoy4E0TIz is 243KB 2023-10-06T03:11:11.507 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.rRoy4E0TIz 2023-10-06T03:11:11.513 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/data/mon.c.tgz 2023-10-06T03:11:11.513 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2023-10-06T03:11:11.520 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.MKvDwkl2eZ 2023-10-06T03:11:11.520 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.MKvDwkl2eZ 2023-10-06T03:11:11.592 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.MKvDwkl2eZ 2023-10-06T03:11:11.664 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.MKvDwkl2eZ is 243KB 2023-10-06T03:11:11.728 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.MKvDwkl2eZ 2023-10-06T03:11:11.735 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T03:11:11.735 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:11:11.737 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:11:11.739 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:11:11.742 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:11:11.744 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:11:11.763 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T03:11:11.763 DEBUG:teuthology.orchestra.run.smithi027:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:11:11.795 DEBUG:teuthology.orchestra.run.smithi123:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:11:11.799 DEBUG:teuthology.orchestra.run.smithi124:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:11:11.801 DEBUG:teuthology.orchestra.run.smithi158:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:11:11.803 DEBUG:teuthology.orchestra.run.smithi174:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:11:11.816 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:11:11.823 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:11:11.825 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:11:11.826 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:11:11.828 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:11:11.835 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T03:11:11.836 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi027/crash 2023-10-06T03:11:11.837 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:11:11.854 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi123/crash 2023-10-06T03:11:11.855 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:11:11.873 DEBUG:teuthology.misc:Transferring archived files from smithi124:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi124/crash 2023-10-06T03:11:11.874 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:11:11.890 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi158/crash 2023-10-06T03:11:11.891 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:11:11.907 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi174/crash 2023-10-06T03:11:11.908 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:11:11.923 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T03:11:11.923 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:11:11.925 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:11:11.928 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:11:11.937 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:11:11.939 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:11:11.986 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:11:12.004 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:11:12.019 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:11:12.034 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:11:12.051 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:11:12.067 INFO:tasks.ceph:Compressing logs... 2023-10-06T03:11:12.067 DEBUG:teuthology.orchestra.run.smithi027:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:11:12.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:11:12.072 DEBUG:teuthology.orchestra.run.smithi124:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:11:12.074 DEBUG:teuthology.orchestra.run.smithi158:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:11:12.076 DEBUG:teuthology.orchestra.run.smithi174:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:11:14.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-10-06T03:11:14.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-10-06T03:11:14.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-10-06T03:11:14.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-06T03:11:14.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-10-06T03:11:14.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-06T03:11:14.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-06T03:11:14.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-06T03:11:14.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-06T03:11:14.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-06T03:11:14.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-06T03:11:53.435 INFO:tasks.ceph:Archiving logs... 2023-10-06T03:11:53.436 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi027/log 2023-10-06T03:11:53.437 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:11:57.989 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi123/log 2023-10-06T03:11:57.990 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:11:58.473 DEBUG:teuthology.misc:Transferring archived files from smithi124:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi124/log 2023-10-06T03:11:58.474 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:11:58.924 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi158/log 2023-10-06T03:11:58.925 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:11:59.378 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi174/log 2023-10-06T03:11:59.379 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:11:59.830 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T03:11:59.839 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T03:11:59.840 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:11:59.842 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:11:59.844 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:11:59.846 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:11:59.849 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:11:59.994 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T03:12:00.003 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T03:12:00.004 DEBUG:teuthology.orchestra.run.smithi027:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:12:00.006 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:12:00.008 DEBUG:teuthology.orchestra.run.smithi124:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:12:00.010 DEBUG:teuthology.orchestra.run.smithi158:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:12:00.012 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:12:00.025 INFO:teuthology.orchestra.run.smithi027.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T03:12:00.025 INFO:teuthology.orchestra.run.smithi027.stdout:============================================================================== 2023-10-06T03:12:00.025 INFO:teuthology.orchestra.run.smithi027.stdout:*hv01.front.sepi 44.4.53.2 2 u 54 64 377 0.079 -1.864 0.578 2023-10-06T03:12:00.026 INFO:teuthology.orchestra.run.smithi027.stdout:+hv02.front.sepi 63.231.80.2 3 u 50 64 377 0.079 -1.845 0.574 2023-10-06T03:12:00.026 INFO:teuthology.orchestra.run.smithi027.stdout:+hv03.front.sepi 74.6.168.72 3 u 37 64 377 0.072 -1.753 0.823 2023-10-06T03:12:00.026 INFO:teuthology.orchestra.run.smithi027.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2023-10-06T03:12:00.029 INFO:teuthology.orchestra.run.smithi123.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T03:12:00.029 INFO:teuthology.orchestra.run.smithi123.stdout:============================================================================== 2023-10-06T03:12:00.029 INFO:teuthology.orchestra.run.smithi123.stdout:*hv01.front.sepi 44.4.53.2 2 u 51 64 377 0.129 -0.278 0.405 2023-10-06T03:12:00.029 INFO:teuthology.orchestra.run.smithi123.stdout:+hv02.front.sepi 63.231.80.2 3 u 47 64 377 0.086 -0.607 0.215 2023-10-06T03:12:00.029 INFO:teuthology.orchestra.run.smithi123.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.070 -1.612 0.229 2023-10-06T03:12:00.029 INFO:teuthology.orchestra.run.smithi123.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2023-10-06T03:12:00.031 INFO:teuthology.orchestra.run.smithi124.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T03:12:00.031 INFO:teuthology.orchestra.run.smithi124.stdout:============================================================================== 2023-10-06T03:12:00.031 INFO:teuthology.orchestra.run.smithi124.stdout:*hv01.front.sepi 44.4.53.2 2 u 45 64 377 0.088 9.777 4.505 2023-10-06T03:12:00.031 INFO:teuthology.orchestra.run.smithi124.stdout:+hv02.front.sepi 63.231.80.2 3 u 46 64 377 0.078 2.362 6.015 2023-10-06T03:12:00.031 INFO:teuthology.orchestra.run.smithi124.stdout:+hv03.front.sepi 74.6.168.72 3 u 40 64 377 0.086 10.259 5.572 2023-10-06T03:12:00.031 INFO:teuthology.orchestra.run.smithi124.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2023-10-06T03:12:00.033 INFO:teuthology.orchestra.run.smithi158.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T03:12:00.033 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================== 2023-10-06T03:12:00.033 INFO:teuthology.orchestra.run.smithi158.stdout:*hv01.front.sepi 44.4.53.2 2 u 51 64 377 0.093 5.544 2.920 2023-10-06T03:12:00.033 INFO:teuthology.orchestra.run.smithi158.stdout:+hv02.front.sepi 63.231.80.2 3 u 52 64 377 0.086 1.340 2.750 2023-10-06T03:12:00.033 INFO:teuthology.orchestra.run.smithi158.stdout:+hv03.front.sepi 74.6.168.72 3 u 45 64 377 0.100 4.105 2.481 2023-10-06T03:12:00.034 INFO:teuthology.orchestra.run.smithi158.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2023-10-06T03:12:00.036 INFO:teuthology.orchestra.run.smithi174.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T03:12:00.036 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================== 2023-10-06T03:12:00.036 INFO:teuthology.orchestra.run.smithi174.stdout:*hv01.front.sepi 44.4.53.2 2 u 43 64 377 0.097 1.681 2.713 2023-10-06T03:12:00.036 INFO:teuthology.orchestra.run.smithi174.stdout:+hv02.front.sepi 63.231.80.2 3 u 51 64 377 0.096 2.250 2.183 2023-10-06T03:12:00.036 INFO:teuthology.orchestra.run.smithi174.stdout:+hv03.front.sepi 74.6.168.72 3 u 40 64 377 0.094 2.598 1.455 2023-10-06T03:12:00.036 INFO:teuthology.orchestra.run.smithi174.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2023-10-06T03:12:00.037 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T03:12:00.047 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T03:12:00.047 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T03:12:00.058 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T03:12:00.075 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T03:12:00.086 INFO:teuthology.task.internal:Duration was 1334.442533 seconds 2023-10-06T03:12:00.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T03:12:00.097 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T03:12:00.097 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:12:00.099 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:12:00.101 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:12:00.103 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:12:00.105 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:12:00.156 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T03:12:00.156 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi027.front.sepia.ceph.com 2023-10-06T03:12:00.156 DEBUG:teuthology.orchestra.run.smithi027:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:12:00.167 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2023-10-06T03:12:00.168 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:12:00.182 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi124.front.sepia.ceph.com 2023-10-06T03:12:00.182 DEBUG:teuthology.orchestra.run.smithi124:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:12:00.205 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi158.front.sepia.ceph.com 2023-10-06T03:12:00.206 DEBUG:teuthology.orchestra.run.smithi158:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:12:00.221 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2023-10-06T03:12:00.221 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:12:00.236 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T03:12:00.236 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:12:00.238 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:12:00.241 DEBUG:teuthology.orchestra.run.smithi124:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:12:00.243 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:12:00.245 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:12:00.277 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T03:12:00.278 DEBUG:teuthology.orchestra.run.smithi027:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:12:00.280 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:12:00.282 DEBUG:teuthology.orchestra.run.smithi124:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:12:00.284 DEBUG:teuthology.orchestra.run.smithi158:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:12:00.321 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:12:00.395 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T03:12:00.406 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T03:12:00.406 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:12:00.424 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:12:00.440 DEBUG:teuthology.orchestra.run.smithi124:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:12:00.458 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:12:00.475 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:12:00.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T03:12:00.503 DEBUG:teuthology.orchestra.run.smithi027:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:12:00.505 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:12:00.507 DEBUG:teuthology.orchestra.run.smithi124:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:12:00.510 DEBUG:teuthology.orchestra.run.smithi158:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:12:00.512 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:12:00.518 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = core 2023-10-06T03:12:00.520 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2023-10-06T03:12:00.522 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = core 2023-10-06T03:12:00.524 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = core 2023-10-06T03:12:00.526 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2023-10-06T03:12:00.552 DEBUG:teuthology.orchestra.run.smithi027:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:12:00.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:12:00.597 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:12:00.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:12:00.603 DEBUG:teuthology.orchestra.run.smithi124:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:12:00.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:12:00.609 DEBUG:teuthology.orchestra.run.smithi158:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:12:00.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:12:00.615 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:12:00.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:12:00.621 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T03:12:00.631 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T03:12:00.632 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi027 2023-10-06T03:12:00.632 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:12:00.658 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi123 2023-10-06T03:12:00.658 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:12:00.681 DEBUG:teuthology.misc:Transferring archived files from smithi124:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi124 2023-10-06T03:12:00.682 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:12:00.705 DEBUG:teuthology.misc:Transferring archived files from smithi158:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi158 2023-10-06T03:12:00.705 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:12:00.728 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173/remote/smithi174 2023-10-06T03:12:00.729 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:12:00.753 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T03:12:00.753 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:12:00.756 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:12:00.758 DEBUG:teuthology.orchestra.run.smithi124:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:12:00.760 DEBUG:teuthology.orchestra.run.smithi158:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:12:00.769 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:12:00.775 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T03:12:00.786 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T03:12:00.786 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T03:12:00.798 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T03:12:00.798 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:12:00.807 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:12:00.809 DEBUG:teuthology.orchestra.run.smithi124:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:12:00.811 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:12:00.812 INFO:teuthology.orchestra.run.smithi027.stdout: 924113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:12 /home/ubuntu/cephtest 2023-10-06T03:12:00.813 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:12:00.815 INFO:teuthology.orchestra.run.smithi123.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:12 /home/ubuntu/cephtest 2023-10-06T03:12:00.817 INFO:teuthology.orchestra.run.smithi124.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:12 /home/ubuntu/cephtest 2023-10-06T03:12:00.819 INFO:teuthology.orchestra.run.smithi158.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:12 /home/ubuntu/cephtest 2023-10-06T03:12:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:12 /home/ubuntu/cephtest 2023-10-06T03:12:00.824 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T03:12:00.835 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T03:12:00.885 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T03:12:00.939 DEBUG:teuthology.nuke:shortname: smithi027 2023-10-06T03:12:00.939 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:12:00.962 DEBUG:teuthology.nuke:shortname: smithi123 2023-10-06T03:12:00.962 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:12:00.967 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:39:15.710676', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-06T03:12:00.985 DEBUG:teuthology.nuke:shortname: smithi124 2023-10-06T03:12:00.986 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:12:00.992 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:39:15.712409', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-06T03:12:01.008 DEBUG:teuthology.nuke:shortname: smithi158 2023-10-06T03:12:01.008 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:12:01.025 INFO:teuthology.orchestra.console.smithi027:Power off 2023-10-06T03:12:01.025 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:12:01.035 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:39:15.708913', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-06T03:12:01.040 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:39:15.706880', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-06T03:12:01.042 DEBUG:teuthology.nuke:shortname: smithi174 2023-10-06T03:12:01.042 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:12:01.051 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-10-06T03:12:01.051 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:01.068 INFO:teuthology.orchestra.console.smithi123:Power off 2023-10-06T03:12:01.068 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:12:01.080 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:39:15.713515', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-06T03:12:01.083 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-10-06T03:12:01.089 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-10-06T03:12:01.090 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:01.114 INFO:teuthology.orchestra.console.smithi158:Power off 2023-10-06T03:12:01.115 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:12:01.131 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-06T03:12:01.132 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:12:01.142 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-06T03:12:01.143 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-10-06T03:12:01.143 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:01.154 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-06T03:12:01.154 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:01.168 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-06T03:12:01.182 INFO:teuthology.orchestra.console.smithi174:Power off 2023-10-06T03:12:01.182 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:12:01.193 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-06T03:12:01.205 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-10-06T03:12:01.206 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:01.232 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-10-06T03:12:05.084 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:05.143 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:05.169 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:05.194 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:05.203 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-10-06T03:12:05.233 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:05.253 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-06T03:12:05.280 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-06T03:12:05.304 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-06T03:12:05.347 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-10-06T03:12:09.204 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:09.254 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:09.281 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:09.305 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:09.314 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-10-06T03:12:09.348 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:09.365 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-06T03:12:09.391 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-06T03:12:09.414 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-06T03:12:09.416 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-10-06T03:12:09.459 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-10-06T03:12:09.491 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-10-06T03:12:13.367 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:13.415 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:13.460 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:12:13.478 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-06T03:12:13.526 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-06T03:12:13.570 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-10-06T03:12:13.579 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-10-06T03:12:13.626 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-06T03:12:13.671 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-10-06T03:12:13.776 INFO:teuthology.run:Summary data: description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} duration: 1334.4425325393677 failure_reason: '"1696561189.6505396 mon.a (mon.0) 129 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T03:12:13.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T03:12:13.857 INFO:teuthology.run:FAIL